TRACE reconstructs unlearned LLM text from pre- and post-unlearning snapshots
The attack needs no data-specific prior and was tested on TOFU, MUSE, and WMDP with six unlearning methods.
2 stories, newest first · one card per story
The attack needs no data-specific prior and was tested on TOFU, MUSE, and WMDP with six unlearning methods.
In a GPT-2 test, returned gradients raised token recovery from 94.20% to 97.38% and exact-document recovery from 13.71% to 37.77%.
Today 1.5K readers · 2.4K views · 757 reads · all time 189K views