DecisionRank on-policy distillation beats generative teacher on retrieval tasks
Item-space OPD lets 1.7B DecisionRank surpass 27B LLM teacher on TREC DL while running 24.5x faster.
13 stories, newest first · one card per story
Item-space OPD lets 1.7B DecisionRank surpass 27B LLM teacher on TREC DL while running 24.5x faster.
A resident 9B backbone adds about 0.1 GiB per skill and beats bge-reranker-v2-m3 on SciFact and NFCorpus after 39 minutes of fine-tuning.
At 32 million parameters, per-option scoring gains 5.8 skill points but needs 5 to 13 times more passes.
The post body was unavailable, so sizes, benchmarks, licenses, and release status are not stated.
Biomedical reranking raised clinical-note Hit@10 from 46.6% to 60.6%, while Qwen3-8B correctness reached only 48.6%.
TypeSafe AI's Jev holds recommendation quality while latency grows more slowly than pointwise Qwen rerankers.
Jev matches strong recommendation rerankers with slower latency growth than pointwise Qwen models.
RenderRank reranks documents from compressed visual tokens, using 16.5-35.5% fewer tokens and beating sub-4B text baselines.
Pre-registered tests show raw turns selected by Jev match extracted agent memory at far lower cost.
Order-consistency fine-tuning reduces LLM scorer decision changes from candidate reordering without hurting ranking quality.
MERIT-Rank integrates multiple LLM reasoning trajectories for text reranking; its 4B model outperforms most 7B and 32B rerankers on BRIGHT.
GLIE compresses visual document retrieval embeddings to four vectors per page while retaining nearly 80% of uncompressed nDCG@5 accuracy.
DSR reranks LLM agent skills with Determinantal Point Processes to favor complementary, non-redundant sets, improving multi-skill query coverage.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views