You’re forgetting the activation function to break linearity, otherwise you can only model linear trends. Many activation functions have “if” hidden in them (e.g. ReLU with the “max”).