UniCache: Task- and Type-Aware KV Cache Compression for Unified Multimodal Models
UniCache compresses multimodal KV caches up to 5× with little quality loss and higher throughput.
1 stories, newest first · one card per story
UniCache compresses multimodal KV caches up to 5× with little quality loss and higher throughput.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views