Edit Models filters

Showing models from

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

24

Base only

Active filters: QuantLLM

QuantLLM/Llama-3.2-3B-4bit-mlx

Text Generation • 3B • Updated Dec 20, 2025 • 18

QuantLLM/Llama-3.2-3B-2bit-mlx

Text Generation • 3B • Updated Dec 20, 2025 • 19

QuantLLM/Llama-3.2-3B-8bit-mlx

Text Generation • 3B • Updated Dec 20, 2025 • 34

QuantLLM/Llama-3.2-3B-5bit-mlx

Text Generation • 3B • Updated Dec 20, 2025 • 16

QuantLLM/Llama-3.2-3B-5bit-gguf

3B • Updated Dec 20, 2025 • 17

QuantLLM/Llama-3.2-3B-2bit-gguf

3B • Updated Dec 20, 2025 • 17

QuantLLM/functiongemma-270m-it-8bit-gguf

0.3B • Updated Dec 21, 2025 • 21 • 1

QuantLLM/functiongemma-270m-it-4bit-gguf

0.3B • Updated Dec 21, 2025 • 81

QuantLLM/functiongemma-270m-it-4bit-mlx

Text Generation • 0.3B • Updated Dec 21, 2025 • 24

QuantLLM/Meta-Llama-3-70B-Instruct-4bit-gguf

Text Generation • 71B • Updated Apr 24 • 8 • 1

QuantLLM/Qwen3-0.6B-2bit-gguf

0.6B • Updated Apr 25 • 12

QuantLLM/Qwen3-0.6B-4bit-gguf

0.6B • Updated Apr 25 • 25

QuantLLM/Qwen3-0.6B-8bit-gguf

0.6B • Updated Apr 25 • 14

QuantLLM/TinyLlama-1.1B-Chat-GGUF

1B • Updated Apr 29 • 14

QuantLLM/SmolLM2-135M-QuantLLM

Text Generation • 0.1B • Updated Apr 29 • 13

QuantLLM/SmolLM2-135M-GGUF

0.1B • Updated Apr 29 • 35 • 1

QuantLLM/Phi-3.5-mini-instruct-GGUF

4B • Updated Aug 3 • 32

QuantLLM/Phi-3.5-mini-instruct-SafeTensors

4B • Updated Aug 3 • 4

QuantLLM/Phi-3.5-mini-instruct-MLX

4B • Updated Aug 3 • 13

QuantLLM/Phi-3.5-mini-instruct-ONNX

QuantLLM/Qwen2.5-7B-Instruct-GGUF

8B • Updated Aug 3 • 22

QuantLLM/Qwen2.5-7B-Instruct-SafeTensors

8B • Updated Aug 3 • 7

QuantLLM/Qwen2.5-7B-Instruct-ONNX

Updated Aug 3 • 4

QuantLLM/Qwen2.5-7B-Instruct-MLX

8B • Updated Aug 3 • 5