Frozen 16 MB codes replace learned embeddings in small models
A Gemma-shaped ternary model fits in a 46 MB file and runs 615–740 tokens per second on a laptop CPU.
2 stories, newest first · one card per story
A Gemma-shaped ternary model fits in a 46 MB file and runs 615–740 tokens per second on a laptop CPU.
A GitHub project runs a 1.58-bit BitNet language model on an ESP32-S3 cluster.
Today 2.3K readers · 2.8K views · 411 reads · all time 108K views