REX moves hazardous knowledge into removable experts in MoE models
Excising those experts lowers WMDP-Bio by 48.4 points on Qwen3.5-35B-A3B while MMLU changes by less than 3 points.
1 stories, newest first · one card per story
Excising those experts lowers WMDP-Bio by 48.4 points on Qwen3.5-35B-A3B while MMLU changes by less than 3 points.
Today 2.1K readers · 2.6K views · 388 reads · all time 108K views