Akarshan Biswas
qnixsynapse
AI & ML interests
NLP, models, quantization
Recent Activity
liked a Space 3 days ago
juiceb0xc0de/BYOGGUF reacted to juiceb0xc0de's post with 🔥 3 days ago
🦙 llama.cpp hit v1.0.0, so I built it a party
https://huggingface.co/spaces/juiceb0xc0de/BYOGGUF: Bring Your Own GGUF. Paste any public model repo, pick a quant, and chat with it on an RTX PRO 6000 Blackwell through ZeroGPU, on the minutes your account already has (5 a day free, 40 on PRO).
If you don’t have a GGUF, the Space will make you one. Sign in, point it at any public safetensors or GGUF repo, pick your quant types, and it converts and quantizes on CPU, so it costs you no GPU quota. The finished quants land in your own account with a model card, and one button takes them straight into the chat room. Something the size of Qwen3.8-27B is fine.
Anything up to 48 GB runs on half the card at the normal rate; bigger models get the full 96 GB and burn minutes twice as fast. Public, ungated repos only. Native CUDA 13 binaries for Blackwell, built on the first stable llama.cpp. new activity 4 days ago
google/gemma-4-31B-it:Gemma 4 models are way to paranoid about dates, any tips?Organizations
None yet