Genrius AI

company

https://www.genrius.in/

AI & ML interests

None defined yet.

Recent Activity

harshit-genrius updated a collection 4 days ago

Pingala-8: 2-bit LLMs for llama.cpp

harshit-genrius updated a dataset 4 days ago

Genrius-AI/pingala8-benchmarks

harshit-genrius updated a collection 4 days ago

2-bit GGUFs that fit a 12 GB GPU (measured)

View all activity

Genrius-AI 's Spaces 4

README

2-bit GGUF leaderboard

Measured, paired 2-bit GGUF perplexity, 27B and 2B

Pingala-8 2-bit LLMs

2-bit GGUF LLMs for llama.cpp, 85% smaller, no retraining

LLM GPU fit: Pingala-8 2-bit vs 4-bit

Will a model fit your GPU as Pingala-8 2-bit or Q4_K_M?