Why Linear Models Can Still Work in a Complex and Changing World
Linear models can beat nonlinear ones when unstable curvature fails to transfer across environments.
Stories per day · 30 days
3 stories, newest first · one card per story
Stories tagged #machine-learning-theory
Silver Rate Is (Almost) Optimal for Gradient Descent Acceleration
New optimization theory paper proves near-optimal lower bounds for gradient descent with predetermined stepsizes, confirming silver-schedule optimality.
The Price of Sparsity: Sufficient Conditions for Sparse Recovery using Sparse and Sparsified Measurements
Researchers derive sufficient sample-size conditions for recovering sparse binary signals from sparse Gaussian measurements, quantifying an information-theoretic threshold of order slog(p/s)/log(ds/p).