Bc-AI/home
0 Bytes
🏗️ Building on HF
Boning Cui
Bc-AI
AI & ML interests
He/Him. I like LLM's and VLM's. I work with my other friends to make stuff. We are in year 7 and we are enthusiastic about AI. We are based in Australia 🇦🇺
Recent Activity
new activity about 5 hours ago
BananaMind/BananaMind-2.1-Pico-Preview:Looks like GPT-6 is starting to roll out. new activity about 5 hours ago
juiceb0xc0de/bella-bartender-gemma-e4b:nice! reacted to juiceb0xc0de's post with 🔥 about 5 hours ago
Dude, Where's My Update? I'll tell you where! ~97.6% of my BF16 parameter coordinates didn't move at all, and the ones that did overshot by ~1.33x.
It's nice to do research that doesn't end in disproving yourself once again and moving on to the next subject once in awhile.
Back to the topic, if you've ever wondered why most of your weights are basically ghosting you nearly every step when you store your weights at bf16, Dude, I Measured It.
https://huggingface.co/blog/juiceb0xc0de/intended-and-realized-updates-in-bf16-fine-tuning#dude-wheres-my-updateOrganizations
