Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,241

Base only

Active filters: bitsandbytes

SanDiegoDude/Cosmos3-Nano-nf4

Text-to-Image • Updated 23 days ago • 315 • 2

LiteMind/YutaLM-M2-bnb-4bit

Text Generation • 0.9B • Updated 2 days ago • 43 • 2

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 408 • 50

Rorical/0-roleplay

Text Generation • 15B • Updated Jun 11, 2024 • 3 • 5

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Feb 15, 2025 • 90.6k • 101

unsloth/gemma-3-1b-it-unsloth-bnb-4bit

Text Generation • 1B • Updated May 12, 2025 • 11.1k • 11

OrionCAF/TurkishLaw

Text Generation • 15B • Updated Mar 13 • 9 • 8

marianbasti/higgs-audio-argentinian

6B • Updated Aug 1, 2025 • 3 • 2

unsloth/gpt-oss-120b-unsloth-bnb-4bit

Text Generation • 117B • Updated Aug 8, 2025 • 4.44k • 16

FabioSarracino/VibeVoice-Large-Q8

Text-to-Audio • 9B • Updated Oct 1, 2025 • 735 • 98

radlab/polish-qa-v2-bnb

Question Answering • 0.4B • Updated Oct 4, 2025 • 7 • 2

Kavyaah/medical-coding-llm

4B • Updated Oct 8, 2025 • 77 • 7

empero-ai/openNemo-Cascade-2-30B-A3B

Text Generation • 32B • Updated Mar 24 • 623 • 7

Aero-Ex/KIMODO-Meta3_llm2vec_NF4

8B • Updated Apr 4 • 2.19k • 5

SanDiegoDude/LLaDA2.0-Uni-bnb-nf4

Any-to-Any • 16B • Updated Apr 24 • 8 • 3

SanDiegoDude/Cosmos3-Super-Text2Image-nf4

Text-to-Image • Updated 23 days ago • 165 • 4

sktime/Timer-S1-quantized-4bit

Time Series Forecasting • 8B • Updated 21 days ago • 64 • 1

dddx/mehmehmeh

Text Generation • 7B • Updated Apr 4, 2025 • 7

rosyvs/whisat

Automatic Speech Recognition • Updated Apr 29, 2025 • 4 • 3

Sakuna/LLaMaCoder

Text Generation • Updated Jan 3, 2024 • 3 • 1

Mediocreatmybest/instructblip-vicuna-7b_8bit

Image-to-Text • 8B • Updated Nov 19, 2023 • 11 • 3

0prodigy/axolotl

Text Generation • Updated Oct 17, 2023 • 3

Mediocreatmybest/instructblip-vicuna-13b_8bit

Image-Text-to-Text • 14B • Updated Nov 19, 2023 • 4

Mediocreatmybest/instructblip-flan-t5-xl_8bit

Image-to-Text • 4B • Updated Nov 20, 2023 • 12 • 1

Mediocreatmybest/instructblip-flan-t5-xxl_8bit

Image-to-Text • 12B • Updated Nov 20, 2023 • 5

nominate/llama2-13b-chat-hf-jmc-001-merged-q8_0

Text Generation • Updated Aug 11, 2023 • 7

jionlyu/3B-test

Text Generation • Updated Aug 16, 2023 • 2

rajuptvs/bigscience_bloom-560m_sharded_8bit

Text Generation • 0.6B • Updated Sep 27, 2023 • 3

rajuptvs/stabilityai_stablecode-instruct-alpha-3b-sharded-8bit

Text Generation • Updated Aug 16, 2023 • 3

Kashfia/base_model

Updated Aug 25, 2023