Eigenvalues of the Hessian in Deep Learning: The Origin of Symmetry and Its Breaking
A symmetry-breaking account explains clustered Hessian spectra in trained deep networks, including ReLU, CNN, graph, and transformer models.
Stories per day · 30 days
3 stories, newest first · one card per story
Stories tagged #hessian
G^2PTQ: Improving LLM Post-Training Quantization with Generalized Gradient Compensation
G2PTQ refreshes gradients and Hessians during LLM quantization, beating GPTQ-style baselines.
[0day-rubbish] Accurate Online Private Cloud on-prem (current) Unauthenticated Hessian deserialization leading to JNDI remote class loading (9.8)
0day Rubbish disclosed an unauthenticated Hessian deserialization flaw in Accurate Online Private Cloud on-prem allowing JNDI remote class loading, rated 9.8.