We're excited to release BananaMind 2 SLMoE, an experimental sequence-level mixture-of-experts model. It uses only 8M parameters per message but has 25M total parameters, 13 experts (out of 64) are selected based on the message prefix and reused for the entire response. We're testing with this sequence-level architecture to find out how big the capability loss actually is and how much of it can be fixed. The long-term idea is that this could make very large sparse models usable on machines that can't fit them in RAM by putting the entire model (which is big) on disk and only loading the active parts into VRAM. This architecture is still in research and shouldn't be used for production models.
We trained it on 60B tokens (of FineWeb-HQ, FineWeb-Edu, DCLM ,Cosmopedia v2, FineMath and NPSet-2) on 8 RTX Pro 6000s.
new day, new models! Introducing the Auto series, a series of classifiers for determining if agentic tool calls are safe to run or not to prevent any harmful actions from happening. They have high performance compared to other LLMs commonly used for this task with incredible speed and small memory footprints. ProCreations/auto-1b (recommended generally, much higher accuracy) ProCreations/auto-0.4b (faster but worse) Comes with datasets as well (open source ftw)! A GitHub repo with pi extensions etc will come soon with this model.
We're building a dataset to study what humans actually consider AI slop.
SlopFinder shows you a random piece of AI-generated text and gives you one simple control: **how slop is it?** No categories. No complicated forms. Just vote and move on.
Every vote helps build the dataset. 🧩
How does it work? Samples are pulled from existing datasets, shown anonymously, and collected into our annotation pool. After enough votes, they're exported to Hugging Face for everyone to use.
This is an early MVP, so the dataset is small and the system is still evolving.