Regression with a Linear Unit
A single linear unit for regression, including squared loss, chain-rule gradients, and parameter updates.
Classification with a Logistic Unit
Binary classification with a linear score, sigmoid probability, log loss, and chain-rule parameter gradients.
Classification with a Neural Network
Forward propagation, backpropagation, and parameter updates in a one-hidden-layer classifier.