TRIAGE: Direction-Aware Mismatch Stabilization of Native NVFP4 Reinforcement Learning
TRIAGE stabilizes native NVFP4 RL on Qwen3 models, matching full precision with up to 2.3x rollout throughput.
Stories per day · 30 days
1 RSS
3 stories, newest first · one card per story
Stories tagged #low-precision
Pretraining Transformers with Quantized Softmax in Attention
K-interval quantized softmax nearly matches full-softmax pretraining loss when calibration and the gradient surrogate are chosen carefully.
AERIAL: Adversarial Evaluation of Robustness in Accuracy-Preserving Low-Precision EEG Decoders
A research paper on low-precision EEG decoders examines adversarial robustness across compression techniques.