BeNice! trains looped models to share one KV-cache across recurrences
In simulated low-memory long-context inference, cache hits rose up to 31.4 percent and throughput up to 23.6 percent.
Stories per day · 30 days
1 stories, newest first · one card per story