models/Flux.1-Dev GGUF Q2.K Q3.KS Q4/Q4.1/Q4.KS Q5/Q5.1/Q5.KS Q6.K Q8 - Q6.K

Flux.1-Dev GGUF Q2.K Q3.KS Q4/Q4.1/Q4.KS Q5/Q5.1/Q5.KS Q6.K Q8 - Q6.K

9/7/2025

11:23:04 PM

Related Keywords & Tags

base model,checkpoint,comfyui-gguf custom node,flux,flux.1,flux.1 d,flux.1-dev,flux.1-dev gguf q2.k q3.ks q4/q4.1/q4.ks q5/q5.1/q5.ks q6.k q8,flux1.d,gguf,gguf quantized model,q4,q5,q6.k,q8,ralfinger,stable diffusion quantized model

An astronaut roasting a marshmallow by a small campfire beside a glowing alien creature, with a crashed spaceship wreckage and starry night sky in the background.

Orange tabby cat sitting inside a small red toy car designed for children, captured with vivid colors and sharp focus.

Tips

Use the ComfyUI-GGUF custom node to run FLUX.1-dev model by placing model files in ComfyUI/models/unet.

Compatible with Forge since latest commit: https://github.com/lllyasviel/stable-diffusion-webui-forge/commit/1bd6cf0e0ce048eae49f52cf36ce7d0deede9d17.

Review quantization types overview here: https://github.com/ggerganov/llama.cpp/blob/master/examples/perplexity/README.md#llama-3-8b-scoreboard.

Creator Sponsors

☕ Buy me a coffee: https://ko-fi.com/ralfingerai

🍺 Join my discord: https://discord.com/invite/pAz4Bt3rqb

Source https://huggingface.co/city96/FLUX.1-dev-gguf/tree/main by city96

This is a direct GGUF conversion of Flux.1-dev. As this is a quantized model not a finetune, all the same restrictions/original license terms still apply. Basic overview of quantization types.

The model files can be used with the ComfyUI-GGUF custom node.
Place model files in ComfyUI/models/unet - see the GitHub readme for further install instructions.
Also working with Forge since the latest commit!

☕ Buy me a coffee: https://ko-fi.com/ralfingerai
🍺 Join my discord: https://discord.com/invite/pAz4Bt3rqb