ZeroHour

Search: “Qwen3.8-Flash-Next”

2 stories

unsloth/Qwen3.8-Flash-Next-GGUF — new model trending #21 on Hugging Face

Qwen released Qwen3.8-Flash-Next, an experimental 125B-parameter open-weight MoE previewing the Qwen4 architecture, with Unsloth shipping optimized GGUF quants.

Qwen released Qwen3.8-Flash-Next, an experimental open-weight preview of the architecture planned to underpin Qwen4. The model has 125B parameters with 6B activated, 512 experts (10 routed plus 1 shared), Qwen Sparse Attention (QSA), Gated DeltaNet, Gated Residual, and n-gram embeddings, with 262,144-token native context extendable to 1,000,000 tokens. Unsloth provides Dynamic 3.0 GGUF quantizations, and multi-token prediction (MTP) delivers 1.3-1.7x faster inference via llama.cpp or Unsloth Desktop.

Hugging Face trending models · 21d agoModel release1

nvidia/Qwen3.8-Flash-Next-NVFP4 — new model trending #28 on Hugging Face

NVIDIA released an NVFP4 4-bit quantized build of Alibaba's Qwen3.8-Flash-Next, a 125B-parameter MoE vision-language model, via Model Optimizer.

The checkpoint quantizes Qwen3.8-Flash-Next — a hybrid-attention (Gated DeltaNet and Qwen Sparse Attention) Mixture-of-Experts model with 125B total and 6B activated parameters, plus 51B n-gram embeddings and 4B MTP — using NVIDIA Model Optimizer v0.46.0. NVFP4 benchmarks stay close to FP8: GPQA Diamond 91.5 vs 92.0, MMMU Pro 78.3 vs 77.1, Terminal-Bench 2.1 82.9 vs 83.3. It targets Blackwell B200/B300 GPUs, runs on vLLM, supports 262K context extendable to 1M tokens, and is licensed under the NVIDIA Open Model License with Qwen Community License 1.0.

Hugging Face trending models · 15d agoModel release