abenzerps/Qwen-Image-2.1-GGUF — new model trending #14 on Hugging Face
GGUF quantizations of Qwen-Image-2.1 image generation model released for local inference with multiple quantization options.
GGUF quantized versions of Qwen-Image-2.1 image generation model released on Hugging Face for local inference. The release includes multiple quantization levels (Q4_K_M to Q8_0) with companion text encoders and VAE files for ComfyUI integration. The model is marketed as fully uncensored without built-in safety checks.
- GGUF quantizations of Qwen-Image-2.1 released for local image generation.
- Model available in Q4_K_M, Q5_K_M, Q6_K, Q8_0 quantizations with companion text encoders and VAE.
- Release includes uncensored version without safety filters.
- Companion text encoder (8B parameters) requires 17.53 GB in BF16 precision.
Full article584 words · extracted from huggingface.co · click to collapse
> [!IMPORTANT]
> **Notice:** A fully uncensored version is currently in development and will be added to this repository soon.
>
> **Notice regarding Q8_0:** Depending on your GPU and ComfyUI environment, `qwen-image-2.1-Q8_0.gguf` might encounter a shape mismatch error (`[136] vs [128]`). Feel free to test it, but for guaranteed stability, we recommend using [Q4_K_M](https://huggingface.co/abenzerps/Qwen-Image-2.1-GGUF#gguf-files), [Q5_K_M](https://huggingface.co/abenzerps/Qwen-Image-2.1-GGUF#gguf-files), or [Q6_K](https://huggingface.co/abenzerps/Qwen-Image-2.1-GGUF#gguf-files) instead.
# Qwen-Image-2.1 GGUF
GGUF quantizations of [Qwen/Qwen-Image-2.1](https://huggingface.co/Qwen/Qwen-Image-2.1) for local image generation using the original upstream base weights.
## Benchmark

## GGUF files
| **Quantization** | **File** | **Size** |
| --- | --- | ---: |
| Q8_0 | [**qwen-image-2.1-Q8_0.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-GGUF/blob/main/qwen-image-2.1-Q8_0.gguf) | 7.59 GB |
| Q6_K | [**qwen-image-2.1-Q6_K.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-GGUF/blob/main/qwen-image-2.1-Q6_K.gguf) | 5.88 GB |
| Q5_K_M | [**qwen-image-2.1-Q5_K_M.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-GGUF/blob/main/qwen-image-2.1-Q5_K_M.gguf) | 5.22 GB |
| Q4_K_M | [**qwen-image-2.1-Q4_K_M.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-GGUF/blob/main/qwen-image-2.1-Q4_K_M.gguf) | 4.60 GB |
| Q4_0 | [**qwen-image-2.1-Q4_0.gguf**](https://huggingface.co/abenzerps/Qwen-Image-2.1-GGUF/blob/main/qwen-image-2.1-Q4_0.gguf) | 4.05 GB |
**Q4_K_M** is recommended for the best balance of size and quality.
## Text Encoders & VAE
Companion model files packaged for ComfyUI:
| **Type** | **File** | **Precision** | **Size** |
| --- | --- | --- | ---: |
| Text Encoder | [**text_encoders/qwen3vl_8b_bf16.safetensors**](https://huggingface.co/abenzerps/Qwen-Image-2.1-GGUF/blob/main/text_encoders/qwen3vl_8b_bf16.safetensors) | BF16 | 17.53 GB |
| Text Encoder | [**text_encoders/qwen3vl_8b_int8_convrot.safetensors**](https://huggingface.co/abenzerps/Qwen-Image-2.1-GGUF/blob/main/text_encoders/qwen3vl_8b_int8_convrot.safetensors) | Int8 | 9.35 GB |
| VAE | [**vae/qwen_image_2.1_vae_bf16.safetensors**](https://huggingface.co/abenzerps/Qwen-Image-2.1-GGUF/blob/main/vae/qwen_image_2.1_vae_bf16.safetensors) | BF16 | 676 MB |
## Usage