unsloth/Qwen3.8-Flash-Next-GGUF — new model trending #21 on Hugging Face
Qwen released Qwen3.8-Flash-Next, an experimental 125B-parameter open-weight MoE previewing the Qwen4 architecture, with Unsloth shipping optimized GGUF quants.
Qwen released Qwen3.8-Flash-Next, an experimental open-weight preview of the architecture planned to underpin Qwen4. The model has 125B parameters with 6B activated, 512 experts (10 routed plus 1 shared), Qwen Sparse Attention (QSA), Gated DeltaNet, Gated Residual, and n-gram embeddings, with 262,144-token native context extendable to 1,000,000 tokens. Unsloth provides Dynamic 3.0 GGUF quantizations, and multi-token prediction (MTP) delivers 1.3-1.7x faster inference via llama.cpp or Unsloth Desktop.
- 125B-parameter MoE with 6B activated per token
- Qwen Sparse Attention cuts long-context latency
- Native 262K context, extensible to 1M tokens
- Unsloth GGUF quants and MTP speed inference 1.3-1.7x
- Products
- Unsloth Desktopllama.cpp
- AI models
- Qwen3.8-Flash-Next
From the original article
6 min read at huggingface.coimage-text-to-text · 935,568 downloads · 832 likes · license other
By unsloth · huggingface.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.