REGER adds inter-item relations to generative recommendation with semantic IDs
The method pretrains by generating semantic neighbors' IDs and distills a teacher's full next-token distributions along the target path.
6 stories, newest first · one card per story
The method pretrains by generating semantic neighbors' IDs and distills a teacher's full next-token distributions along the target path.
The paper reports about 26,400 candidate scores per second on one H100, roughly 60 times a vLLM-served teacher.
Study of 12 LLM agents finds systematic source preference bias that overrides requirement satisfaction; hiding or relabeling source info changes selection rates.
TypeSafe AI's Jev holds recommendation quality while latency grows more slowly than pointwise Qwen rerankers.
Jev matches strong recommendation rerankers with slower latency growth than pointwise Qwen models.
Production AutoResearch on book embeddings hit five failure modes; a scaffolding fix lifted Recall@6 1.82x.
Today 507 readers · 588 views · 463 reads · all time 158K views