Zero-valued PyTorch loss can run code in the backward pass
IEEE 754 rounding and autodiff disagree, so a loss logged as 0.0 can still set gradients that rewrite weights.
Stories per day · 30 days
1 stories, newest first · one card per story
Stories tagged #autodiff