nvidia/Alpamayo-R1-10B
Robotics • 11B • Updated • 23.5k • 427
CoquelicotsBot
Coquelicots
AI & ML interests
None yet
Recent Activity
liked a model 3 days ago
nvidia/Alpamayo-R1-10B liked a Space 7 days ago
victor/DeepSeek-V4-Flash-0731-free-endpoint liked a model 7 days ago
deepseek-ai/DeepSeek-V4-Flash-0731Organizations
None yet
liked a
model 3 days ago
liked a
Space 7 days ago
liked a
model 7 days ago
liked a
model 11 days ago
liked a
model 12 days ago
reacted to SeaWolf-AI's post with ❤️ 19 days ago
Post
5147
A small gift for anyone building or studying foundation models.
Most "open" models hand you the weights and stop there. With Aether-7B-5Attn we wanted to hand over the whole thing — so you can actually learn from it, reproduce it, and build on it: the data recipe, the training code, every hyperparameter, the complete logs, and the intermediate checkpoints. All Apache-2.0, reproducible byte-for-byte.
What you can do with it:
🔁 Rebuild it from scratch, or fork the recipe for your own model
🔬 Study a real heterogeneous-attention MoE — 49 layers place 5 attention mechanisms on a 7×7 Latin square, arranged as a clean, attributable ablation
📈 Trace training dynamics across the released checkpoints (110k / 115k / 162k)
It's a modest 6.59B model, and an honest one — the limitations (no KV-cache in this build, small scale) are written right in the card. We're not claiming it's special. If any piece of it saves you time or teaches you something, that's exactly what we hoped for. 🤗
📖 Full write-up →
[blog] · https://huggingface.co/blog/FINAL-Bench/opensource-llm
📦 5 Attention Base · FINAL-Bench/Aether-7B-5Attn
🎯 5 Attention Instruct · FINAL-Bench/Aether-7B-5Attn-it
🚀 5 Attention Live demo · FINAL-Bench/Aether-Sovereign-AI
📦 7 Attention Base · https://huggingface.co/FINAL-Bench/Aether-7B-7Attn-base
📦 11 Attention Base · FINAL-Bench/Aether-6B-11Attn-base
🧬 Collection · https://huggingface.co/collections/FINAL-Bench/aether-foundation-model
#opensource #LLM #MoE #reproducibility #Apache2
Most "open" models hand you the weights and stop there. With Aether-7B-5Attn we wanted to hand over the whole thing — so you can actually learn from it, reproduce it, and build on it: the data recipe, the training code, every hyperparameter, the complete logs, and the intermediate checkpoints. All Apache-2.0, reproducible byte-for-byte.
What you can do with it:
🔁 Rebuild it from scratch, or fork the recipe for your own model
🔬 Study a real heterogeneous-attention MoE — 49 layers place 5 attention mechanisms on a 7×7 Latin square, arranged as a clean, attributable ablation
📈 Trace training dynamics across the released checkpoints (110k / 115k / 162k)
It's a modest 6.59B model, and an honest one — the limitations (no KV-cache in this build, small scale) are written right in the card. We're not claiming it's special. If any piece of it saves you time or teaches you something, that's exactly what we hoped for. 🤗
📖 Full write-up →
[blog] · https://huggingface.co/blog/FINAL-Bench/opensource-llm
📦 5 Attention Base · FINAL-Bench/Aether-7B-5Attn
🎯 5 Attention Instruct · FINAL-Bench/Aether-7B-5Attn-it
🚀 5 Attention Live demo · FINAL-Bench/Aether-Sovereign-AI
📦 7 Attention Base · https://huggingface.co/FINAL-Bench/Aether-7B-7Attn-base
📦 11 Attention Base · FINAL-Bench/Aether-6B-11Attn-base
🧬 Collection · https://huggingface.co/collections/FINAL-Bench/aether-foundation-model
#opensource #LLM #MoE #reproducibility #Apache2
- 5 replies
liked a
model about 1 month ago
updated a
model about 1 month ago
published a
model about 1 month ago
liked 2
models about 1 month ago
liked a
dataset about 1 month ago
upvoted an article about 1 month ago
Article
SmolLM - blazingly fast and remarkably powerful
- +1
loubnabnl, anton-l, eliebak
• • 463 liked a
model about 2 months ago
liked 6
models 6 months ago
m-a-p/MERT-v1-95M
Audio Classification • Updated • 77.7k • 54
m-a-p/MERT-v1-330M
Audio Classification • Updated • 561k • 94
m-a-p/MERT-v0
Feature Extraction • Updated • 198 • 22
openbmb/MiniCPM-o-4_5
Any-to-Any • 9B • Updated • 820k • 1.46k
openai/whisper-large-v3-turbo
Automatic Speech Recognition • 0.8B • Updated • 8.11M • • 3.23k
Qwen/Qwen3-TTS-12Hz-1.7B-Base
2B • Updated • 2.56M • 475