openMaMMUT/openCLIP models and scaling laws Collection openMaMMUT/openCLIP models trained on DataComp-1.4B, DFN-1.4B and Re-LAION-2B. Pre-trained models on various scales, incl. intermediate checkpoints • 11 items • Updated Mar 17 • 2
MaMMUT2 OpenCLIP Validation Collection Modelling validation of new MaMMUT2 (fixed pooling) + NaFlex / ModernText architecture changes in OpenCLIP. All runs across 32 epochs of CC12M • 9 items • Updated 4 days ago
rwightman/mammut2-moderntext_ViT-B-32.cc12m-qk-lr3e3 Zero-Shot Image Classification • Updated 4 days ago • 33
rwightman/mammut2-moderntext_ViT-B-32.cc12m-qk-lr2e3 Zero-Shot Image Classification • Updated 4 days ago • 25
rwightman/mammut2-moderntext_ViT-B-32.cc12m-noqk-lr1e3 Zero-Shot Image Classification • Updated 4 days ago • 24
rwightman/mammut2-moderntext_ViT-B-32.cc12m-qk-lr2e3-b4096 Zero-Shot Image Classification • Updated 4 days ago • 22
rwightman/mammut2-moderntext_ViT-B-32.cc12m-qk-lr2e3-b4096 Zero-Shot Image Classification • Updated 4 days ago • 22
MaMMUT2 OpenCLIP Validation Collection Modelling validation of new MaMMUT2 (fixed pooling) + NaFlex / ModernText architecture changes in OpenCLIP. All runs across 32 epochs of CC12M • 9 items • Updated 4 days ago