Mesoscopic theory describes SGD feature learning in wide two-layer networks
Gaussian overlap statistics track linear and quadratic learning until specialization, which quadratic shielding accelerates.
1 stories, newest first · one card per story
Gaussian overlap statistics track linear and quadratic learning until specialization, which quadratic shielding accelerates.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views