Spectral unlearning applies matrix-structured updates to transformers
Applied atop existing objectives, it narrows most of the gap to a retain-trained reference on memorization, privacy, and utility.
14 stories, newest first · one card per story
Applied atop existing objectives, it narrows most of the gap to a retain-trained reference on memorization, privacy, and utility.
On BANKING77, full-to-oracle displacement rose from example deletion to class deletion across 20 configurations.
SURE uses dual-importance estimation and selective perturbation, matching retraining at modest extra cost.
CIFAR-10 forget accuracy fell 61.50 points from BN recalibration with every learnable weight fixed.
On SDXL-Turbo one-step generation, forgetting success rises 36.34 points over the best baseline.
The attack needs no data-specific prior and was tested on TOFU, MUSE, and WMDP with six unlearning methods.
A theory paper shows forget-only machine unlearning can require memorizing far more training data than ordinary learning keeps.
The method forgets hallucination-linked sparse features while retaining successful manipulation behavior in simulation and real robots.
UnAct forgets classes with forward passes only and stays close to retraining when data is scarce.
A 174-language benchmark shows LLM unlearning fails across languages, and COVER improves cross-lingual erasure.
Inverse Distillation Unlearning distills diffusion and flow models into one-step generators while suppressing a designated forget set.
ForgetMimic unlearns selected humanoid motions on Unitree robots while keeping other behaviors.
Researchers introduce FOM-UL, a layer-selective machine unlearning framework that improves forgetting-utility trade-offs and resists knowledge recovery after quantization.
A cs.CR paper defines private retroactive algorithms, showing machine unlearning is a data-maintenance problem and giving DP constructions for linear statistics, clustering, histograms.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views