Circuit for In-Context Learning in Language Models
The model implements a gated associative lookup using key-value memory over label-token positions and attention heads for few-shot sentence classification.
1 stories, newest first · one card per story
The model implements a gated associative lookup using key-value memory over label-token positions and attention heads for few-shot sentence classification.
Today 1.5K readers · 2.4K views · 757 reads · all time 189K views