C2-Routing cuts VLM visual tokens by routing crop or compress
With a 1,024-token cap already applied, the method reports 36.53% fewer FLOPs and a 0.77% mean relative score drop.
Stories per day · 30 days
4 stories, newest first · one card per story
Stories tagged #token-reduction
Learning to Stop without Learning to Stop: Self-Supervised Confidence Training Improves Reasoning Efficiency
Self-supervised confidence fine-tuning cuts reasoning tokens by up to 25% without training models to stop early.
Why Is Video Still So Expensive? A Survey of Inference-Efficiency Mechanisms in Video and Audiovisual LLMs
A survey catalogs inference-efficiency techniques for video and audiovisual LLMs, mapping bottlenecks in sampling, encoding, token reduction, and LLM decoding.
DataGrout helps enterprises control AI usage, governance and LLM costs
SelectHub launched DataGrout, an LLM cost and governance platform combining dynamic context pruning, symbolic inference and MCP gating, claiming about 60% token reduction.
4