Low-Discrepancy Dither for Quantized Recurrent State Caches
Golden-ratio Weyl dither keeps quantized Mamba recurrent states closer to full precision than stochastic rounding.
1 stories, newest first · one card per story
Golden-ratio Weyl dither keeps quantized Mamba recurrent states closer to full precision than stochastic rounding.
Today 1.8K readers · 4.2K views · 3.1K reads · all time 162K views