CA-DPSGD uses curvature-aware clipping to reduce DPSGD bias
The method pairs a rectified curvature estimator with anisotropic noise and reports better utility than prior clipping methods.
Stories per day · 30 days
3 RSS
2 stories, newest first · one card per story
Stories tagged #gradient-clipping
Decentralized SGD under Heavy-Tailed Noise: Optimal Convergence Rates and the Role of Gradient Clipping
Clipped decentralized SGD reaches order-optimal rates under heavy-tailed noise with linear agent speed-up.