Deletion Tuning matches full fine-tuning by zeroing under 0.05% of weights
A binary mask on gate projections stays near base prior-task accuracy while FFT, LoRA, and random sparse tuning lose up to 5.4 points.
1 stories, newest first · one card per story
A binary mask on gate projections stays near base prior-task accuracy while FFT, LoRA, and random sparse tuning lose up to 5.4 points.
Today 1.5K readers · 2.4K views · 757 reads · all time 189K views