Backtracking
Artificial Intelligence
Improve your Gradient Descent: The Epic Quest for the Optimal Stride Contents Introduction Method 1: Fixed Step Size Method 2: Exact Line Search Method 3: Backtracking Line Search Conclusion
Techniques for Optimizing Step-Size/Learning Rate in Gradient Descent for Machine LearningIn this text, we familiarised ourselves with a few of the useful techniques to optimize for the step size within the gradient descent algorithm....
Recent posts
