Gradient Descent Explained

Gradient descent is an optimization algorithm that adjusts model parameters step by step to minimize prediction error. Learning rate controls how large each adjustment step is.