Attention weight distributions across transformer architectures.
-
angerami/pythia-70m-deduped_weight_evolution
Viewer • Updated • 22.2k • 5 -
angerami/pythia-160m-deduped_weight_evolution
Viewer • Updated • 66.5k • 4 -
angerami/pythia-410m-deduped_weight_evolution
Viewer • Updated • 177k • 5 -
angerami/pythia-1b-deduped_weight_evolution
Viewer • Updated • 59.1k • 5