HIGGS-per-tensor - a inference-optimization Collection

Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

inference-optimization 's Collections

HIGGS-per-tensor

HIGGS-per-tensor

updated Apr 23

meta-llama/Llama-3.2-1B-Instruct

Text Generation • 1B • Updated Oct 24, 2024 • 8.29M • • 1.46k
inference-optimization/Llama-3.2-1B-Instruct-FP8-Dynamic

1B • Updated Apr 7 • 5
inference-optimization/Llama-3.2-1B-Instruct-NVFP4

0.8B • Updated Apr 7 • 86
inference-optimization/Llama-3.2-1B-Instruct-5-bits-mode-heuristic-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-5-bits-mode-hybrid-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-5-bits-mode-noise-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-5.5-bits-mode-heuristic-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-5.5-bits-mode-hybrid-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-5.5-bits-mode-noise-per-tensor

1B • Updated Apr 22 • 2
inference-optimization/Llama-3.2-1B-Instruct-6-bits-mode-heuristic-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-6-bits-mode-hybrid-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-6-bits-mode-noise-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-6.5-bits-mode-heuristic-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-6.5-bits-mode-hybrid-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-6.5-bits-mode-noise-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-7-bits-mode-heuristic-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-7-bits-mode-hybrid-per-tensor

1B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-1B-Instruct-7-bits-mode-noise-per-tensor

1B • Updated Apr 22 • 1
meta-llama/Llama-3.2-3B-Instruct

Text Generation • 3B • Updated Oct 24, 2024 • 1.75M • • 2.2k
inference-optimization/Llama-3.2-3B-Instruct-FP8-Dynamic

3B • Updated Apr 7 • 3
inference-optimization/Llama-3.2-3B-Instruct-NVFP4

2B • Updated Apr 7 • 158
inference-optimization/Llama-3.2-3B-Instruct-5-bits-mode-heuristic-per-tensor

3B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-3B-Instruct-5-bits-mode-hybrid-per-tensor

3B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-3B-Instruct-5-bits-mode-noise-per-tensor

3B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-3B-Instruct-5.5-bits-mode-heuristic-per-tensor

3B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-3B-Instruct-5.5-bits-mode-hybrid-per-tensor

3B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-3B-Instruct-5.5-bits-mode-noise-per-tensor

3B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-3B-Instruct-6-bits-mode-heuristic-per-tensor

3B • Updated Apr 22 • 2
inference-optimization/Llama-3.2-3B-Instruct-6-bits-mode-hybrid-per-tensor

3B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-3B-Instruct-6-bits-mode-noise-per-tensor

3B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-3B-Instruct-6.5-bits-mode-heuristic-per-tensor

3B • Updated Apr 22 • 1
inference-optimization/Llama-3.2-3B-Instruct-6.5-bits-mode-hybrid-per-tensor

3B • Updated Apr 22 • 2
inference-optimization/Llama-3.2-3B-Instruct-6.5-bits-mode-noise-per-tensor

3B • Updated Apr 22 • 2
inference-optimization/Llama-3.2-3B-Instruct-7-bits-mode-heuristic-per-tensor

3B • Updated Apr 22 • 2
inference-optimization/Llama-3.2-3B-Instruct-7-bits-mode-hybrid-per-tensor

3B • Updated Apr 22 • 2
inference-optimization/Llama-3.2-3B-Instruct-7-bits-mode-noise-per-tensor

3B • Updated Apr 22 • 2
meta-llama/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Sep 25, 2024 • 11.3M • • 6.01k
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic

Text Generation • 8B • Updated Mar 19 • 46k • 9
RedHatAI/Llama-3.1-8B-Instruct-NVFP4

Text Generation • 5B • Updated Nov 21, 2025 • 16.1k • 1
inference-optimization/Llama-3.1-8B-Instruct-5-bits-mode-heuristic-per-tensor

5B • Updated Apr 22 • 17
inference-optimization/Llama-3.1-8B-Instruct-5-bits-mode-hybrid-per-tensor

5B • Updated Apr 22 • 16
inference-optimization/Llama-3.1-8B-Instruct-5-bits-mode-noise-per-tensor

5B • Updated Apr 22 • 14
inference-optimization/Llama-3.1-8B-Instruct-5.5-bits-mode-heuristic-per-tensor

6B • Updated Apr 22 • 16
inference-optimization/Llama-3.1-8B-Instruct-5.5-bits-mode-hybrid-per-tensor

6B • Updated Apr 22 • 17
inference-optimization/Llama-3.1-8B-Instruct-5.5-bits-mode-noise-per-tensor

6B • Updated Apr 22 • 14
inference-optimization/Llama-3.1-8B-Instruct-6-bits-mode-heuristic-per-tensor

6B • Updated Apr 22 • 17
inference-optimization/Llama-3.1-8B-Instruct-6-bits-mode-hybrid-per-tensor

6B • Updated Apr 22 • 17
inference-optimization/Llama-3.1-8B-Instruct-6-bits-mode-noise-per-tensor

6B • Updated Apr 22 • 18
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-heuristic-per-tensor

7B • Updated Apr 22 • 15
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-hybrid-per-tensor

7B • Updated Apr 22 • 18
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-noise-per-tensor

7B • Updated Apr 22 • 16
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-heuristic-per-tensor

7B • Updated Apr 22 • 16
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-hybrid-per-tensor

7B • Updated Apr 22 • 17
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-noise-per-tensor

7B • Updated Apr 22 • 17
Qwen/Qwen3-8B

Text Generation • 8B • Updated Jul 26, 2025 • 12.1M • • 1.13k
RedHatAI/Qwen3-8B-FP8-dynamic

Text Generation • 8B • Updated Apr 28 • 53.5k • 12
RedHatAI/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Nov 21, 2025 • 3.08k • 2
inference-optimization/Qwen3-8B-5-bits-mode-heuristic-per-tensor

6B • Updated Apr 22 • 15
inference-optimization/Qwen3-8B-5-bits-mode-hybrid-per-tensor

6B • Updated Apr 22 • 15
inference-optimization/Qwen3-8B-5-bits-mode-noise-per-tensor

6B • Updated Apr 22 • 16
inference-optimization/Qwen3-8B-5.5-bits-mode-heuristic-per-tensor

6B • Updated Apr 22 • 17
inference-optimization/Qwen3-8B-5.5-bits-mode-hybrid-per-tensor

6B • Updated Apr 22 • 15
inference-optimization/Qwen3-8B-5.5-bits-mode-noise-per-tensor

6B • Updated Apr 22 • 15
inference-optimization/Qwen3-8B-6-bits-mode-heuristic-per-tensor

6B • Updated Apr 22 • 19
inference-optimization/Qwen3-8B-6-bits-mode-hybrid-per-tensor

6B • Updated Apr 22 • 18
inference-optimization/Qwen3-8B-6-bits-mode-noise-per-tensor

6B • Updated Apr 22 • 17
inference-optimization/Qwen3-8B-6.5-bits-mode-heuristic-per-tensor

7B • Updated Apr 22 • 17
inference-optimization/Qwen3-8B-6.5-bits-mode-hybrid-per-tensor

7B • Updated Apr 22 • 14
inference-optimization/Qwen3-8B-6.5-bits-mode-noise-per-tensor

6B • Updated Apr 22 • 17
inference-optimization/Qwen3-8B-7-bits-mode-heuristic-per-tensor

7B • Updated Apr 22 • 19
inference-optimization/Qwen3-8B-7-bits-mode-hybrid-per-tensor

7B • Updated Apr 22 • 16
inference-optimization/Qwen3-8B-7-bits-mode-noise-per-tensor

6B • Updated Apr 22 • 17
Qwen/Qwen3-30B-A3B

Text Generation • 31B • Updated Jul 26, 2025 • 2.12M • 898
RedHatAI/Qwen3-30B-A3B-FP8-dynamic

Text Generation • 31B • Updated May 13, 2025 • 128k • 3
RedHatAI/Qwen3-30B-A3B-NVFP4

Text Generation • 17B • Updated Dec 4, 2025 • 73.4k • 2
inference-optimization/Qwen3-30B-A3B-5-bits-mode-heuristic-per-tensor

19B • Updated Apr 22 • 3
inference-optimization/Qwen3-30B-A3B-5-bits-mode-hybrid-per-tensor

19B • Updated Apr 22 • 2
inference-optimization/Qwen3-30B-A3B-5-bits-mode-noise-per-tensor

19B • Updated Apr 22 • 2
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-heuristic-per-tensor

21B • Updated Apr 22 • 2
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-hybrid-per-tensor

21B • Updated Apr 22 • 2
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-noise-per-tensor

21B • Updated Apr 22 • 2
inference-optimization/Qwen3-30B-A3B-6-bits-mode-heuristic-per-tensor

23B • Updated Apr 22 • 3
inference-optimization/Qwen3-30B-A3B-6-bits-mode-hybrid-per-tensor

23B • Updated Apr 22 • 6
inference-optimization/Qwen3-30B-A3B-6-bits-mode-noise-per-tensor

23B • Updated Apr 22 • 4
inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-heuristic-per-tensor

25B • Updated Apr 22 • 3
inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-hybrid-per-tensor

25B • Updated Apr 22 • 4
inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-noise-per-tensor

25B • Updated Apr 22 • 5
inference-optimization/Qwen3-30B-A3B-7-bits-mode-heuristic-per-tensor

27B • Updated Apr 22 • 3
inference-optimization/Qwen3-30B-A3B-7-bits-mode-hybrid-per-tensor

27B • Updated Apr 22 • 5
inference-optimization/Qwen3-30B-A3B-7-bits-mode-noise-per-tensor

27B • Updated Apr 22 • 4
Qwen/Qwen3-30B-A3B-Instruct-2507

Text Generation • 31B • Updated Sep 17, 2025 • 930k • • 814
inference-optimization/Qwen3-30B-A3B-Instruct-2507-FP8-Dynamic

31B • Updated Mar 4 • 12
inference-optimization/Qwen3-30B-A3B-Instruct-2507-NVFP4

17B • Updated Mar 4 • 12
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-heuristic-per-tensor

19B • Updated Apr 23 • 5
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-hybrid-per-tensor

19B • Updated Apr 23 • 2
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-noise-per-tensor

19B • Updated Apr 23 • 2
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-heuristic-per-tensor

21B • Updated Apr 23 • 2
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-hybrid-per-tensor

21B • Updated Apr 23 • 2
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-noise-per-tensor

21B • Updated Apr 23 • 7
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-heuristic-per-tensor

23B • Updated Apr 23 • 2
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-hybrid-per-tensor

23B • Updated Apr 23 • 4
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-noise-per-tensor

23B • Updated Apr 23 • 6
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-heuristic-per-tensor

25B • Updated Apr 23 • 4
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-hybrid-per-tensor

25B • Updated Apr 23 • 2
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-noise-per-tensor

25B • Updated Apr 23 • 2
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-heuristic-per-tensor

27B • Updated Apr 23 • 2
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-hybrid-per-tensor

27B • Updated Apr 23 • 6
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-noise-per-tensor

26B • Updated Apr 23 • 6

Collection guide
Browse collections

Company

TOS Privacy About Careers

Website

Models Datasets Spaces Pricing Docs