In part 5 we explored optimization strategies that ensure a solution to local optima problems and can navigate through flat saddle points. From the foundational approach of Gradient Descent we have moved to its refined version of Momentum based methods and techniques that involve Adaptive Learning …