24GB Models
Collection
Models optimized for 24GB VRAM • 7 items • Updated
6.11 bpw, a mixture of Q6_K and Q5_K_M
Fits ~32k CTX + MMPROJ on a 24GiB GPU
- Downloads last month
- 55
Hardware compatibility
Log In to add your hardware
We're not able to determine the quantization variants.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for Beinsezii/Qwen3.5-27B-6.11BPW-GGUF
Base model
Qwen/Qwen3.5-27B