Recurrent Neural Networks

Pro

Hard

Sequences have order, and that order matters. RNNs maintain a hidden state that accumulates context across timesteps for tasks like language modeling.

Learning Objectives

→Implement the RNN forward pass
→Understand backpropagation through time (BPTT)
→Explain vanishing gradients in deep RNNs
→Describe LSTM gating mechanisms conceptually

Coding Problems (3)

RNN Forward Step

Pro

~20 min· Hard

RNN Over a Sequence

Pro

~20 min· Hard

LSTM Cell Forward Pass

Pro

~35 min· Hard

Concept Check

Optional multiple-choice questions on the ideas behind this section. Most useful after you have tried the coding problems above.