Skip to main content

13 docs tagged with "deep-learning"

View all tags

Attention Mechanism

Understand content addressing, Q/K/V, masks, multi-head variants, efficient implementations, and interpretation limits through a numerical example.

Convolutional Neural Networks

Convolutional inductive bias, channels, padding, stride, pooling, and the distinction between translation equivariance and invariance.

How LLMs work

Follow one prompt through a large language model, then see how post-training and LoRA shape its behaviour.

Multilayer Perceptron

Understand MLP capacity, backpropagation, optimization failures, and inductive bias through tensor shapes and a worked XOR construction.

Recurrent Neural Networks

Understand recurrent state compression, backpropagation through time, LSTM gating, and the boundary with modern state-space sequence models.