Gradient Descent

The optimization engine behind all of machine learning. Learn how parameters update iteratively by following the direction of steepest descent.

Learning Objectives

• →Understand loss surfaces and gradients
• →Implement the gradient update rule
• →Tune learning rate and convergence
• →Distinguish batch, mini-batch, and SGD

Practice