pottokao/Qwen-Image-2.1-Text-Encoder-Heretic-GGUF — new model trending #30 on Hugging Face
Community GGUF, FP8, and BF16 builds of the Qwen-Image-2.1 text encoder are trending on Hugging Face.
A community Hugging Face repo is trending with GGUF, FP8, and BF16 builds of a Heretic Qwen3-VL 8B text encoder for Qwen-Image-2.1. The Q4_K_M GGUF is 5.0 GB and needs a 1.2 GB mmproj; FP8 and BF16 safetensors are 9.3 GB and 17.5 GB. The author says a ComfyUI-GGUF add-on fixes vision-tower loading and unknown-architecture errors so the text encoder and DiT can both run as GGUF. Suggested settings are 25 steps, using CFG 1.0 or a mid-run switch to CFG 3.0 for readable text.
- Trending #30: Heretic Qwen3-VL 8B text-encoder weights for Qwen-Image-2.1.
- GGUF Q4_K_M is 5.0 GB plus a 1.2 GB mmproj; FP8 is 9.3 GB and BF16 is 17.5 GB.
- A ComfyUI add-on loads the Qwen3-VL vision tower so GGUF text-encoder and DiT files run.
- Recommended sampling is 25 steps, with CFG split from 1.0 to 3.0 when rendering text.
- Vendors
- Qwen
- Products
- ComfyUIComfyUI-GGUF
- AI models
- Qwen-Image-2.1Qwen3-VL-8B
From the original article
7 min read at huggingface.co> **Got `got input of size [1, 512, 12288]` with the GGUF? It's fixed. ** > The GGUF files were fine all along — ComfyUI-GGUF just didn't load the Qwen3-VL vision tower.
By pottokao · huggingface.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.