prism-ml/Ternary-Bonsai-2-27B-gguf — new model trending #29 on Hugging Face
Prism ML released Ternary-Bonsai-2-27B, a 27B ternary-weight model derived from Qwen3.8-27B that runs full reasoning in ~5.95 GB GGUF.
Stories per day · 30 days
3 stories, newest first · one card per story
Stories tagged #on-device-inference
Edge0/Edge0-35B-A3B-preview — new model trending #30 on Hugging Face
Edge0 released a 35B sparse MoE model running in under 3 GiB of memory at 15 tok/s via SSD expert offload and int4 quantization.
Lightweight Vision Transformer Compression for On-Device Plant Disease Detection in Resource-Constrained Agricultural Field Conditions
A unified ViT compression pipeline (H-BAC pruning, quantization, distillation) cuts plant-disease models 54.5x to 6.01 MB while keeping 95.13% accuracy.