Hugging Face daily papers·19d agoGrouped Value Attention: Efficient KV Caching via On-Demand Key Reconstruction#attention#gqa#inference-efficiency