TopKLoRA sparse adapters localize and ablate sleeper-agent backdoors
On three small models, ablating a TopKLoRA circuit removes a planted backdoor while instruction-following holds, with much smaller circuits than dense LoRA.
48
On three small models, ablating a TopKLoRA circuit removes a planted backdoor while instruction-following holds, with much smaller circuits than dense LoRA.
SAE reconstruction converges on far less data, but one-to-one feature matches keep rising with more tokens.
Entities are extracted by the model from each article. First seen , last mentioned . Watching keeps it in this browser only (no account); the watchlist page and dashboard alerts use it.
Today 2K readers · 2.7K views · 411 reads · all time 111K views