Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

ChibuUkachi updated a model about 3 hours ago

inference-optimization/Qwen3-235B-A22B-Thinking-2507.w8a8

ChibuUkachi updated a model about 4 hours ago

inference-optimization/Qwen3-235B-A22B-Thinking-2507.w4a16

ChibuUkachi updated a model 2 days ago

inference-optimization/final-ctest-Qwen3-8B-speculator.dflash

View all activity

inference-optimization 's models 336

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_noise

3B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_hybrid

3B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_heuristic

3B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_noise

3B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_hybrid

3B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_heuristic

3B • Updated Mar 12 • 7

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_noise

3B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_hybrid

3B • Updated Mar 12 • 3

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_noise

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_noise

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_hybrid

1B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_noise

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_hybrid

1B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_heuristic

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_noise

1B • Updated Mar 12 • 3

inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_hybrid

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_heuristic

1B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_noise

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_hybrid

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_heuristic

1B • Updated Mar 12 • 4

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_hybrid

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_heuristic

1B • Updated Mar 12 • 5

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_heuristic

1B • Updated Mar 12 • 2

inference-optimization/Qwen3-8B_7_bits_mode_heuristic

7B • Updated Mar 12 • 1

inference-optimization/Qwen3-8B_7_bits_mode_noise

7B • Updated Mar 12 • 3

inference-optimization/Qwen3-8B_7_bits_mode_hybrid

7B • Updated Mar 12 • 1

inference-optimization/Qwen3-8B_6.5_bits_mode_heuristic

7B • Updated Mar 12 • 2

inference-optimization/Qwen3-8B_6.5_bits_mode_noise

7B • Updated Mar 12 • 1

inference-optimization/Qwen3-8B_6.5_bits_mode_hybrid

7B • Updated Mar 12 • 4

inference-optimization/Qwen3-8B_6_bits_mode_heuristic

7B • Updated Mar 12 • 2