Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts
Paper • 2608.20061 • Published • 46
Cheon Jaewon
snob
·
AI & ML interests
Large Language Models
Recent Activity
upvoted a paper 5 months ago
Grounding World Simulation Models in a Real-World Metropolis liked a model 5 months ago
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16Organizations
upvoted a paper 10 days ago
upvoted a paper 5 months ago
liked 5
models 5 months ago
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16
Text Generation • 124B • Updated • 12.6k • 32
moonshotai/Kimi-K2-Base
Text Generation • 1T • Updated • 14.2k • 306
mistralai/Mistral-Large-3-675B-Base-2512
Updated • 79 • 46
zai-org/GLM-4.5-Base
Text Generation • 358B • Updated • 734 • 61
deepseek-ai/DeepSeek-V3.1-Base
Text Generation • 685B • Updated • 30k • 1.01k
liked 5
datasets 6 months ago
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 19.1k • 740
open-thoughts/OpenThoughts-114k
Viewer • Updated • 228k • 113k • 908
galaxyMindAiLabs/stem-reasoning-complex
Viewer • Updated • 118k • 322 • 78
nohurry/Opus-4.6-Reasoning-3000x-filtered
Viewer • Updated • 2.33k • 649 • 645
ronantakizawa/github-top-code
Viewer • Updated • 1.12M • 5.58k • 125
updated a
model about 2 years ago
updated 4
datasets about 2 years ago
updated a
model about 2 years ago
updated a
dataset about 2 years ago
updated a
model over 2 years ago