view article Article Making Knowledge Distillation Cheap Enough to Run at Scale MultiverseComputingCAI • 13 days ago • 35
Running Featured 93 Distilling 100B+ Models 40x Faster with TRL 📝 93 TRL distillation for 100B+ teachers, 40x faster