unsloth/Qwen3.8-27B-GGUF
27B • Updated • 868k • 971
Manuel Barca-Grama
jackangel
AI & ML interests
None yet
Recent Activity
liked a model about 13 hours ago
unsloth/Qwen3.8-27B-GGUF liked a dataset 2 days ago
EleutherAI/the_pile_deduplicated liked a model 12 days ago
IAAR-Shanghai/Metis-9BOrganizations
None yet
liked a
model about 13 hours ago
liked a
dataset 2 days ago
liked a
model 12 days ago
liked a
model 13 days ago
reacted to FredyRivera-dev's post with 🚀 18 days ago
Post
6350
We wrote a full technical guide on how to train a bilingual (ES/EN) LLM from scratch: TinyQwen.
Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source
With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.
Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch
Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute.
Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source
With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.
Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch
Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute.
- 3 replies
liked 2
models 18 days ago
liked a
dataset 22 days ago
liked 3
models 22 days ago
liked a
model 23 days ago
liked 2
models 24 days ago
liked 2
models 29 days ago
liked 4
models about 1 month ago
