Eigenvalues of the Hessian in Deep Learning: The Origin of Symmetry and Its Breaking
A symmetry-breaking account explains clustered Hessian spectra in trained deep networks, including ReLU, CNN, graph, and transformer models.
Stories per day · 30 days
2 stories, newest first · one card per story
Stories tagged #symmetry
Groupoid-Based Internal State Representations for Reinforcement Learning with Local Symmetries
Groupoid-based RL discovers local, state-dependent symmetries during interaction, learning in a symmetry-reduced space and beating standard Q-learning efficiency.