New leaderboard coming to the small language model community!
The leaderboard measures cognitive skills, which is more challenging and beyond language modeling and instruction-following. This is a first step towards more everyday useful and general small models.
BananaMind 3 is going to be an comeback. Sorry for the BGA things ( i genuinely didnt know about nsa existing and yes I used aiiii) Were going to use our BananaMind 2.1 Unified architecture with some changes + NSA and some other stuff.
You know, I can't believe we are actually doing it, literally advancing the frontier at the edge! We've come a long way since the first models on open slm leaderboard, and, as many things that change, performance is one of the main things that has exploded.
7 years ago, the best we had was GPT-2. Today, we got 90m models beating smollm2! I can't barely see what a future with increasingly powerful small models will look like.
All I can say is that the best is yet to come. And will be agentic.