Context-Answer Metamodels Forecast LLM Activations Pre-Answer
Context activations can forecast mean-pooled answer activations with high fidelity and generalize zero-shot to out-of-domain datasets.
Stories per day · 30 days
Relatedforecasting1
2 stories, newest first · one card per story
Stories tagged #activations
LANTERN: Illuminating Hidden Mathematical Knowledge in Language Models
LANTERN uses model activations to surface OEIS relations, verifying 62 links including four claimed novel ones.