Optimal stepsize schedules for stochastic gradient descent in convex minimization
Exact analysis proves monotonically decreasing optimal stepsize schedules for SGD under bounded noise in smooth convex problems.
1 stories, newest first · one card per story
Exact analysis proves monotonically decreasing optimal stepsize schedules for SGD under bounded noise in smooth convex problems.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views