Loss Landscapes: Part 2
And why they matter in Machine learning! Read Loss Landscapes: Part 1 In the previous part, we learned what loss landscapes are, how they are formed, and the difference between simple, convex bowls and rugged, non-convex mountains. But knowing what the landscape looks like is only half the battle. How do we actually find the bottom of those valleys to train our machine learning model? 6: Gradient Descent Gradient descent is the core optimization algorithm in machine learning. Its entire job […]