Intermittent noisy gradients can leave learning variance unbounded
Average dynamics may still reach the correct optimum while learning variance grows without bound.
Stories per day · 30 days
1 stories, newest first · one card per story
1 stories, newest first · one card per story
Average dynamics may still reach the correct optimum while learning variance grows without bound.
Today 1.5K readers · 2.4K views · 768 reads · all time 189K views