Circuit for In-Context Learning in Language Models
The model implements a gated associative lookup using key-value memory over label-token positions and attention heads for few-shot sentence classification.
1 stories, newest first · one card per story
The model implements a gated associative lookup using key-value memory over label-token positions and attention heads for few-shot sentence classification.
Today 1.6K readers · 2.5K views · 777 reads · all time 189K views