zai-org/LongBench-v2
Viewer • Updated • 503 • 67.5k • 56
alkinun
AtAndDev
AI & ML interests
decentralize
Recent Activity
liked a dataset 1 day ago
zai-org/LongBench-v2 new activity 2 days ago
AtomixLabs/Neo-Open-SLM-Leaderboard:Add specklabs/Speck2-140M and Speck2-140M-Instruct new activity 2 days ago
AxiomicLabs/Open_SLM_Leaderboard:Add specklabs/Speck2-140M and Speck2-140M-InstructOrganizations
liked a
dataset 1 day ago
Add specklabs/Speck2-140M and Speck2-140M-Instruct
1
#24 opened 2 days ago
by AtAndDev
Add specklabs/Speck2-140M and Speck2-140M-Instruct
1
#121 opened 2 days ago
by AtAndDev
updated a
collection 2 days ago
updated a
model 2 days ago
published a
model 2 days ago
updated a
model 2 days ago
published a
model 2 days ago
liked a
dataset 2 days ago
reacted to Bc-AI's post with 🔥 2 days ago
Post
2508
Building a 6.58B sparse MoE model from scratch on a single GPU.
Hey everyone! Today is day 1 of training Smilyai-Lab's new model I call G1-MINI. It's basically the smaller version of our planned model G1 which will be 20B and activate about 2B per token. MINI activates about 1.16B params per token and is currently training right now. If no errors spring up now, I'd say i can launch sometime around September 15th~ish. Thanks to our beta testers:
@guardamarcos
@ProCreations
@juiceb0xc0de
@Timmy6767
@Sbui503
@atom77777
@Fishtiks
@smartdigitalnetworks
@EmetTheGolum
@smilyai-large-team
@MUK-IS-GOAT
@Bc-AI
@Banaxi-Tech
@vovaRL
@Datdanboi25
Hey everyone! Today is day 1 of training Smilyai-Lab's new model I call G1-MINI. It's basically the smaller version of our planned model G1 which will be 20B and activate about 2B per token. MINI activates about 1.16B params per token and is currently training right now. If no errors spring up now, I'd say i can launch sometime around September 15th~ish. Thanks to our beta testers:
@guardamarcos
@ProCreations
@juiceb0xc0de
@Timmy6767
@Sbui503
@atom77777
@Fishtiks
@smartdigitalnetworks
@EmetTheGolum
@smilyai-large-team
@MUK-IS-GOAT
@Bc-AI
@Banaxi-Tech
@vovaRL
@Datdanboi25
- 9 replies
reacted to KlondikeDev's post with 🔥 2 days ago
Post
3418
A Preview of Boris-2!
Hello! Tomorrow, OpenCerebral will be releasing Boris-1.7-D60M-n30M — an experimental architecture. It will be testing a new data mixture, a new tokenizer, and testing Qwen4-like n-gram embeddings.
Following this will be Boris-1.8-D60M-n30M, which will test both the n-gram embeddings AND a new architecture.
Then, Boris-2 will begin training!
Edit: the model is OUT NOW! opencerebral/Boris-1.7-D60M-n30M
Hello! Tomorrow, OpenCerebral will be releasing Boris-1.7-D60M-n30M — an experimental architecture. It will be testing a new data mixture, a new tokenizer, and testing Qwen4-like n-gram embeddings.
Following this will be Boris-1.8-D60M-n30M, which will test both the n-gram embeddings AND a new architecture.
Then, Boris-2 will begin training!
Edit: the model is OUT NOW! opencerebral/Boris-1.7-D60M-n30M
- 70 replies
replied to KlondikeDev's post 3 days ago
wow... my eyes..
posted an update 3 days ago
Post
2756
SPECK 2 IS ALREADY OUT: specklabs/Speck2-140M
Pretrained on 4x more tokens than the previous releases (20b vs 5b).
Instruct tuned versions are coming soon.
Very interesting models are coming soon too (hint: super long context).
Thanks for everyone supporting!
Pretrained on 4x more tokens than the previous releases (20b vs 5b).
Instruct tuned versions are coming soon.
Very interesting models are coming soon too (hint: super long context).
Thanks for everyone supporting!
- 2 replies
liked a
dataset 3 days ago
updated a
collection 3 days ago
updated a
model 3 days ago
published a
model 3 days ago
updated a
Space 3 days ago
updated a
model 3 days ago