Frozen 16 MB codes replace learned embeddings in small models
A Gemma-shaped ternary model fits in a 46 MB file and runs 615–740 tokens per second on a laptop CPU.
1 stories, newest first · one card per story
A Gemma-shaped ternary model fits in a 46 MB file and runs 615–740 tokens per second on a laptop CPU.
Today 94 readers · 94 views · 1 read · all time 108K views