Broken scale symmetries in undercomplete linear autoencoders
Theory paper shows SGD drives undercomplete linear autoencoders toward large decoder weights along the PCA solution manifold until hitting a finite-stepsize stability boundary.
1 stories, newest first · one card per story
Theory paper shows SGD drives undercomplete linear autoencoders toward large decoder weights along the PCA solution manifold until hitting a finite-stepsize stability boundary.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views