Build your intuition for deep learning from scratch. Understand layers, activations, and why depth enables hierarchical feature learning.
ReLU Activation
~10 min· Easy
Softmax Activation
~15 min· Medium
Dense Layer Forward Pass
~18 min· Medium
Two-Layer Network Forward Pass (and Why It Solves XOR)
~15 min· Easy
The Perceptron Learning Rule
The XOR Wall by Grid Search
~12 min· Easy
He and Glorot Initialization Scales
~10 min· Intro
Residual Block Forward Pass
Dead ReLU Fraction
~8 min· Easy
Sign in for the concept check
Optional multiple-choice questions on the ideas behind this section. Most useful after you have tried the coding problems above.