Stanford open-sources Memorilla, a latent memory module for frozen LLMs
A 194M-parameter module gives a frozen Qwen3-8B 16 tokens and beat full context on FactKG with 108x fewer document tokens.
48
A 194M-parameter module gives a frozen Qwen3-8B 16 tokens and beat full context on FactKG with 108x fewer document tokens.
Adapted from Qwen3-Embedding-0.6B on more than one million pairs, it scores 0.5488 macro-average on eight FaMTEB tasks.
Entities are extracted by the model from each article. First seen , last mentioned . Watching keeps it in this browser only (no account); the watchlist page and dashboard alerts use it.
Today 1.1K readers · 1.3K views · 248 reads · all time 195K views