unsloth/Qwen-Image-2.1-GGUF — new model trending #30 on Hugging Face
Unsloth published GGUF quantized versions of Qwen-Image-2.1, Alibaba's 7B text-to-image and editing model, using Dynamic 2.0 per-layer precision.
Unsloth released a GGUF quantization of Qwen-Image-2.1, a unified text-to-image and image-editing model whose visual generation component has 7B parameters across 32 DiT layers. Unsloth's Dynamic 2.0 methodology upcasts sensitivity-critical layers per tensor to preserve quality, with the Q4_K_XL encoder measuring LPIPS 0.029, SSIM 0.959, 5.15 GB footprint, and 36.5 s render time versus Q4_K_M. The GGUF contains only the denoiser and requires the separate BF16 VAE plus the Qwen3-VL-8B text encoder, running in Unsloth Desktop and stable-diffusion.cpp. The model supports native RGBA transparency, up to 10 reference images, and identity-preserving local edits via circles, annotations, or masks.
- GGUF quantization of Qwen-Image-2.1's 7B-parameter DiT visual generation component
- Dynamic 2.0 upcasts sensitivity-critical layers per tensor for near-lossless quality
- Q4_K_XL encoder benchmark: LPIPS 0.029, SSIM 0.959, 5.15 GB, 36.5 s per render
- Requires separate VAE and Qwen3-VL-8B text encoder to run
Full article666 words · extracted from huggingface.co · click to collapse
# Read our How to [Run Qwen-Image-2.1 Guide!](https://unsloth.ai/docs/models/qwen-image-2.1) 💜
This is a GGUF quantized version of [Qwen-Image-2.1](https://huggingface.co/Qwen/Qwen-Image-2.1). <br>
unsloth/Qwen-Image-2.1-GGUF uses [Unsloth Dynamic 2.0](https://docs.unsloth.ai/basics/unsloth-dynamic-2.0-ggufs) methodology for SOTA performance.
- Important layers are upcasted to higher precision, per tensor, from a measured sensitivity scan.
- Run these with [Unsloth Desktop](https://github.com/unslothai/unsloth), stable-diffusion.cpp and more. A GGUF is the denoiser only, so it needs the VAE and the Qwen3-VL text encoder alongside it.
- VAE: [unsloth/Qwen-Image-2.1-FP8](https://huggingface.co/unsloth/Qwen-Image-2.1-FP8) `vae/qwen_image_2.1_vae_bf16.safetensors`. Text encoder: [unsloth/Qwen3-VL-8B-Instruct-GGUF](https://huggingface.co/unsloth/Qwen3-VL-8B-Instruct-GGUF) `Qwen3-VL-8B-Instruct-UD-Q4_K_XL.gguf`, the Dynamic 2.0 4-bit rung rather than the uniform `Q4_K_M`. Measured against the `Q4_K_M` encoder at a shared seed, with the denoiser and VAE held fixed: LPIPS 0.029, SSIM 0.959, 5.15 GB vs 5.03 GB, 36.5 s vs 39.0 s.
<div>
<div style="display: flex; gap: 5px; align-items: center; ">
<a href="https://github.com/unslothai/unsloth/">
<img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
</a>
<a href="https://discord.gg/unsloth">
<img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
</a>
<a href="https://unsloth.ai/docs/models/qwen-image-2.1">
<img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
</a>
</div>
</div>
See below for image editing operating inside of Unsloth Desktop:
<img width="600" alt="qwen-image-2.1 unsloth desktop" src="https://unsloth.ai/docs/~gitbook/image?url=https%3A%2F%2F3215535692-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252FxhOjnexMCB3dmuQFQ2Zq%252Fuploads%252F8E4zaQZmeYBhYIXkvveM%252F01-2edit-multi-image.webp%3Falt%3Dmedia%26token%3Dad7d102c-b304-4c75-b66d-4a68cd518a37&width=768&dpr=3&quality=100&sign=a5a37f593c66ddc27c847bab0d138eda&sv=3" />
```bash
sd-cli --diffusion-model qwen-image-2.1-Q4_K_M.gguf \
--vae qwen_image_2.1_vae_bf16.safetensors \
--llm Qwen3-VL-8B-Instruct-UD-Q4_K_XL.gguf \
-p "a cartoon sloth mascot waving, flat vector illustration, bright colours" \