inference-optimization/qwen3_8b_6.0_bits_mode_noise_stiched
6B • Updated • 56
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/qwen3_8b_6.0_bits_mode_hybrid_stiched
6B • Updated • 49
inference-optimization/qwen3_8b_6.0_bits_mode_heuristic_stiched
6B • Updated • 55
inference-optimization/qwen3_8b_5.5_bits_mode_noise_stiched
6B • Updated • 52
inference-optimization/qwen3_8b_5.5_bits_mode_hybrid_stiched
6B • Updated • 56
inference-optimization/qwen3_8b_5.5_bits_mode_heuristic_stiched
6B • Updated • 55
inference-optimization/qwen3_8b_5.0_bits_mode_noise_stiched
6B • Updated • 55
inference-optimization/qwen3_8b_5.0_bits_mode_hybrid_stiched
6B • Updated • 56
inference-optimization/qwen3_8b_5.0_bits_mode_heuristic_stiched
6B • Updated • 54
inference-optimization/llama3_8b_7.0_bits_mode_noise_stiched
7B • Updated • 28
inference-optimization/llama3_8b_7.0_bits_mode_hybrid_stiched
7B • Updated • 29
inference-optimization/llama3_8b_7.0_bits_mode_heuristic_stiched
7B • Updated • 25
inference-optimization/llama3_8b_6.5_bits_mode_noise_stiched
7B • Updated • 26
inference-optimization/llama3_8b_6.5_bits_mode_hybrid_stiched
7B • Updated • 27
inference-optimization/llama3_8b_6.5_bits_mode_heuristic_stiched
7B • Updated • 23
inference-optimization/llama3_8b_6.0_bits_mode_noise_stiched
6B • Updated • 29
inference-optimization/llama3_8b_6.0_bits_mode_heuristic_stiched
6B • Updated • 23
inference-optimization/llama3_8b_5.5_bits_mode_noise_stiched
6B • Updated • 29
inference-optimization/llama3_8b_5.5_bits_mode_hybrid_stiched
6B • Updated • 27
inference-optimization/llama3_8b_5.5_bits_mode_heuristic_stiched
6B • Updated • 21
inference-optimization/llama3_8b_5.0_bits_mode_noise_stiched
5B • Updated • 22
inference-optimization/llama3_8b_5.0_bits_mode_hybrid_stiched
5B • Updated • 25
inference-optimization/llama3_8b_5.0_bits_mode_heuristic_stiched
5B • Updated • 26
inference-optimization/llama3_8b_6.0_bits_mode_hybrid_stiched
6B • Updated • 51
inference-optimization/qwen3-8b-peagle-speculators
Updated
inference-optimization/ctest-Qwen3.5-9B-speculator.dflash
2B • Updated • 87
inference-optimization/MiniMax-M2.5-BF16
Text Generation • 229B • Updated • 403
inference-optimization/ctest-Qwen3-8B-speculator.dflash
2B • Updated • 105
inference-optimization/DeepSeek-V4-Flash-bf16-NVFP4-FP8-BLOCK
Updated
inference-optimization/DeepSeek-V4-Flash-bf16
Updated