thanks!
🏗️ Building on HF
Melvin Vivas
melvindave
AI & ML interests
AI Engineer — Specializing in AI Agents, Local/Open-source models, and AI workflows implementation.
Recent Activity
liked a model 1 day ago
unsloth/Qwen3.8-27B-NVFP4 liked a dataset 1 day ago
nvidia/Nemotron-RL-Instruction-Following-Structured-Outputs-v2 upvoted an article 1 day ago
Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO StepsOrganizations
replied to their post 10 days ago
replied to their post 28 days ago
thank you @John6666 .this is really helpful!
posted an update 29 days ago
Post
84
What's the best small model for training on tool calls?
Basically, the use case is to use it with an agent which processes a customer's inquiry and suggest a travel itinerary via an API call. I'm thinking this will just be wrapped as a tool call). It should be smart enough also to understand when to call multiple tools to achieve its goal.
Any ideas on this? I need to do a POC with a small model which can run in my RTX 3090. Planning to use unsloth for the fine-tune.
Just wanted to know which model I can use as baseline for this use case.
Basically, the use case is to use it with an agent which processes a customer's inquiry and suggest a travel itinerary via an API call. I'm thinking this will just be wrapped as a tool call). It should be smart enough also to understand when to call multiple tools to achieve its goal.
Any ideas on this? I need to do a POC with a small model which can run in my RTX 3090. Planning to use unsloth for the fine-tune.
Just wanted to know which model I can use as baseline for this use case.
- 4 replies
reacted to danielhanchen's post with 🔥 5 months ago
Post
5411
Qwen3.6-27B is out now! Run it locally on 18GB RAM. 💜
Qwen3.6-27B surpasses Qwen3.5-397B-A17B on all major coding benchmarks.
GGUFs to run: unsloth/Qwen3.6-27B-GGUF
Guide + MLX: https://unsloth.ai/docs/models/qwen3.6
Qwen3.6-27B surpasses Qwen3.5-397B-A17B on all major coding benchmarks.
GGUFs to run: unsloth/Qwen3.6-27B-GGUF
Guide + MLX: https://unsloth.ai/docs/models/qwen3.6
replied to their post 5 months ago
thanks a lot @John6666
replied to their post 5 months ago
I am using Qwen2 VL, wondering if there are alternative smaller models
posted an update 5 months ago
Post
190
Is there any VLM which runs on CPU only? Just need basic understanding of images
- 4 replies
posted an update 7 months ago
Post
2438
I made my own avatar banner maker
https://avatar.donvitocodes.com/
Using Claude Code and Opus 4.6 in a day
I use it in my HF profile too
https://avatar.donvitocodes.com/
Using Claude Code and Opus 4.6 in a day
I use it in my HF profile too
replied to their post 8 months ago
thanks, i was looking at the wrong license file
replied to their post 8 months ago
@John6666 can the Distil-PII be used for commercial purposes? I am thinking of creating an open source python library but not sure if I can control usage for those who will download it?
I checked the license and it says it's llama 3.2 and you just need to inform Meta if users reach 700M MAU
"2. Additional Commercial Terms. If, on the Llama 3.2 version release date, the monthly active users
of the products or services made available by or for Licensee, or Licensee’s affiliates,
is greater than 700 million monthly active users in the preceding calendar month, you must request
a license from Meta"
Did I understand the license correctly?
replied to their post 8 months ago
thank you, I'll try these first. really appreciate the help!
replied to their post 8 months ago
I saw this. Is this good enough? https://huggingface.co/mradermacher/Distil-PII-Llama-3.2-1B-Instruct-GGUF
replied to their post 8 months ago
thank you so much for the detailed reply. i was checking the deployment guide for https://huggingface.co/distil-labs/Distil-PII-Llama-3.2-1B-Instruct but it's not available in their website anymore
posted an update 8 months ago
Post
237
I am looking for a model which is good at redaction of sensitive info
Preferably, a small model which I can run locally. If there isn't a small one, I'd be interested to explore even larger ones. I just need it for a project I am building.
Any ideas?
Preferably, a small model which I can run locally. If there isn't a small one, I'd be interested to explore even larger ones. I just need it for a project I am building.
Any ideas?
- 8 replies
reacted to mahimairaja's post with 🚀 8 months ago
Post
4801
Happy New Years 2026!
For next 365 days I will be commit to work on:
- Document AI and OCR Automations
- Voice Agents
- Long Running Tasks - Durable Agents
For next 365 days I will be commit to work on:
- Document AI and OCR Automations
- Voice Agents
- Long Running Tasks - Durable Agents
- 1 reply
reacted to prithivMLmods's post with 🤗 9 months ago
Post
2071
Demo for Molmo2 on Hugging Face is live now, including Single/Multi-Image VQA, Visual Pointing/Grounding, Video VQA, and Video Point Tracking. Find the demo and related collections below. 🔥🤗
● Molmo2 HF Demo🖥️: prithivMLmods/Molmo2-HF-Demo
● Model Collection: https://huggingface.co/collections/allenai/molmo2
● Related Multimodal Space Collection: https://huggingface.co/collections/prithivMLmods/multimodal-implementations
To know more about it, visit the app page or the respective model page!
● Molmo2 HF Demo🖥️: prithivMLmods/Molmo2-HF-Demo
● Model Collection: https://huggingface.co/collections/allenai/molmo2
● Related Multimodal Space Collection: https://huggingface.co/collections/prithivMLmods/multimodal-implementations
To know more about it, visit the app page or the respective model page!
reacted to danielhanchen's post with 🔥 9 months ago
Post
5627
NVIDIA releases Nemotron 3 Nano, a new 30B hybrid reasoning model! 🔥
Has 1M context window & best in class performance for SWE-Bench, reasoning & chat. Run the MoE model locally with 24GB RAM.
GGUF: unsloth/Nemotron-3-Nano-30B-A3B-GGUF
💚 Step-by-step Guide: https://docs.unsloth.ai/models/nemotron-3
Has 1M context window & best in class performance for SWE-Bench, reasoning & chat. Run the MoE model locally with 24GB RAM.
GGUF: unsloth/Nemotron-3-Nano-30B-A3B-GGUF
💚 Step-by-step Guide: https://docs.unsloth.ai/models/nemotron-3
- 1 reply
replied to davidquicast's post 9 months ago
i made mine. too embarassing to post 😂
reacted to davidquicast's post with 🤗 9 months ago
Post
4324
- 3 replies
reacted to Kseniase's post with 👍 9 months ago
Post
6157
6 Comprehensive Resources on AI Coding
AI coding is moving fast, and it’s getting harder to tell what actually works. Agents, workflows, context management and many other aspects are reshaping how software gets built.
We’ve collected a set of resources to help you understand how AI coding is evolving today and what building strategies work best:
1. AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunities (2508.11126)
Provides a clear taxonomy, compares agent architectures, and exposes practical gaps in tools, benchmarks, and reliability that AI coding agents now struggle with
2. Does AI-Assisted Coding Deliver? A Difference-in-Differences Study of Cursor's Impact on Software Projects (2511.04427)
This survey from Carnegie Mellon University shows causal evidence that LLM agent assistants deliver short-term productivity gains but have lasting quality costs that can slow development over time
3. A Survey of Vibe Coding with Large Language Models (2510.12399)
Turns Vibe Coding from hype into a structured field, categorizing real development workflows. It shows which models, infrastructure, tool requirements, context, and collaboration setups affect real software development outcomes
4. From Code Foundation Models to Agents and Applications: A Practical Guide to Code Intelligence (2511.18538) (from Chinese institutes and companies like ByteDance and Alibaba)
Compares real code LLMs, shows how training and alignment choices affect code quality and security, and connects academic benchmarks to everyday software development
5. Build Your Own Coding Agent via a Step-by-Step Workshop⟶ https://github.com/ghuntley/how-to-build-a-coding-agent
A great guide that covers the basics of building an AI-powered coding assistant – from a chatbot to a file reader/explorer/editor and code search
6. State of AI Coding: Context, Trust, and Subagents⟶ https://www.turingpost.com/p/aisoftwarestack
Here is our in-depth analysis of where AI coding is heading and the new directions we see today – like agent swarms and context management importance – offering an emerging playbook beyond the IDE
If you like it, also subscribe to the Turing Post: https://www.turingpost.com/subscribe
AI coding is moving fast, and it’s getting harder to tell what actually works. Agents, workflows, context management and many other aspects are reshaping how software gets built.
We’ve collected a set of resources to help you understand how AI coding is evolving today and what building strategies work best:
1. AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunities (2508.11126)
Provides a clear taxonomy, compares agent architectures, and exposes practical gaps in tools, benchmarks, and reliability that AI coding agents now struggle with
2. Does AI-Assisted Coding Deliver? A Difference-in-Differences Study of Cursor's Impact on Software Projects (2511.04427)
This survey from Carnegie Mellon University shows causal evidence that LLM agent assistants deliver short-term productivity gains but have lasting quality costs that can slow development over time
3. A Survey of Vibe Coding with Large Language Models (2510.12399)
Turns Vibe Coding from hype into a structured field, categorizing real development workflows. It shows which models, infrastructure, tool requirements, context, and collaboration setups affect real software development outcomes
4. From Code Foundation Models to Agents and Applications: A Practical Guide to Code Intelligence (2511.18538) (from Chinese institutes and companies like ByteDance and Alibaba)
Compares real code LLMs, shows how training and alignment choices affect code quality and security, and connects academic benchmarks to everyday software development
5. Build Your Own Coding Agent via a Step-by-Step Workshop⟶ https://github.com/ghuntley/how-to-build-a-coding-agent
A great guide that covers the basics of building an AI-powered coding assistant – from a chatbot to a file reader/explorer/editor and code search
6. State of AI Coding: Context, Trust, and Subagents⟶ https://www.turingpost.com/p/aisoftwarestack
Here is our in-depth analysis of where AI coding is heading and the new directions we see today – like agent swarms and context management importance – offering an emerging playbook beyond the IDE
If you like it, also subscribe to the Turing Post: https://www.turingpost.com/subscribe
- 2 replies