CacheRepair: Learning to Repair Cross-Chunk Context in RAG for KV Cache Fusion
CacheRepair restores cross-chunk KV context in RAG, speeding first token by 1.69-4.61x.
1 stories, newest first · one card per story
CacheRepair restores cross-chunk KV context in RAG, speeding first token by 1.69-4.61x.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views