Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint
Prism ML's Ternary Bonsai 2 27B GGUFs require a custom llama.cpp fork to run.
Simon Willison says Hugging Face GGUFs for Prism ML's Ternary-Bonsai-2-27B, billed as near-lossless compression in about a 9x smaller footprint, do not run on stock llama.cpp. The weights need Prism's llama.cpp fork, including its macOS arm64 runtime, to load the roughly 5.95 GB GGUF. The note is setup guidance for an existing open-weights release rather than a new benchmark paper.
- Ternary Bonsai 2 27B claims near-lossless compression at about 9x smaller size.
- The published GGUF is roughly 5.95 GB on Hugging Face.
- Stock llama.cpp cannot load it; Prism's llama.cpp fork is required.
- Vendors
- Prism ML
- Products
- llama.cpp
- Organizations
- Hugging FacePrism ML
- AI models
- Ternary-Bonsai-2-27B
From the original article
My comment on Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint — Hacker News. If you want to try out out the GGUFs from https://huggingface. co/prism-ml/Ternary-Bonsai-2-27B-gguf#th...
simonwillison.net
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.