Continual-ARC scores lifelong skill acquisition on ARC-AGI streams
Harness persistence rarely beats a demonstration cache on memorization, and no harness method gains on unseen tasks, unlike weight updates.
Stories per day · 30 days
3 RSS
Relatedlanguage-models2agent-harness1arc-agi1benchmark1continual-learning1data-filtering1dialogue1in-parameter1pii1privacy1retrieval1
9 stories, newest first · one card per story
Stories tagged #memorization
SKIM stores dialogue turns inside frozen language-model parameters
The model writes self-generated questions as retrieval keys and later answers user questions from parameters alone, with no external store.
Surprise Masking filters private spans during language-model training
Fine-tuning extraction of private values fell from 66.3% to 2.3% while evaluated coding performance held.
Why Forget-Only Unlearning Needs Memorization
A theory paper shows forget-only machine unlearning can require memorizing far more training data than ordinary learning keeps.
Cross-Lingual Transferability of Training Data Extraction Attacks to Recover Memorized PII
Training-data extraction of memorized PII transfers from English prompts into four other languages.
Practical Secrets Extraction against Black-box LLMs
Researchers recover memorized credentials from black-box commercial LLMs, including OpenAI and Claude Code.
Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs
Researchers introduce FOM-UL, a layer-selective machine unlearning framework that improves forgetting-utility trade-offs and resists knowledge recovery after quantization.
Continual Learning Mechanisms Compose for Long-Horizon Memorization
Composing data, function, and weight anchors with merged LoRA raises 100-task long-horizon retention from 1.2% to 34.9% in continual fine-tuning.
Molecular Déjà Vu: Digit-Level Retrieval of Published Values in Frontier Language Models
Audit of 22 frontier models finds widespread verbatim retrieval of published molecular property values, with higher reasoning increasing recall of memorized numbers.