Broken scale symmetries in undercomplete linear autoencoders
Theory paper shows SGD drives undercomplete linear autoencoders toward large decoder weights along the PCA solution manifold until hitting a finite-stepsize stability boundary.
Stories per day · 30 days
3 stories, newest first · one card per story
Stories tagged #autoencoders
Selecting The Most Informative Tokens in Natural Language Autoencoders
Explaining five percent of tokens retains nearly all prompt-injection audit success on three of four datasets.
Sharp Reconstruction Bounds for Autoencoders Using the Same Forward Map
Theoretical work derives sharp reconstruction-derivative error bounds for autoencoders using the same forward map, validated on a 798,452-point LiDAR forest scan.