Data Attribution

EleutherAI 's Collections

Data Attribution

Evals

Deep Ignorance

Pythia Scaling Suite

PolyPythias

Quirky Models and Datasets

Pile-T5

Quirky Math (archive)

Pile-T5 T5x Checkpoints

Sparse Autoencoders

updated about 23 hours ago

Leave-1%-out retrain banks and datasets for training-data attribution: measured per-query loss changes, the ground truth for LDS.

Upvote

EleutherAI/LDS-retrain-bank-adamw-N4k-bs256

Viewer • Updated 20 days ago • 2k • 643
EleutherAI/LDS-retrain-bank-adamw-N8k-bs256

Viewer • Updated 20 days ago • 4.64k • 174
EleutherAI/LDS-retrain-bank-muon-N8k-bs256

Viewer • Updated 20 days ago • 2k • 225
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256

Viewer • Updated 20 days ago • 3.2k • 510
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.25

Viewer • Updated 20 days ago • 2.9k • 471
EleutherAI/LDS-retrain-bank-muon-N4k-bs256

Viewer • Updated 20 days ago • 2k • 209
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-ep4

Viewer • Updated 19 days ago • 4k • 359
EleutherAI/LDS-retrain-bank-adamw-N32k-bs256

Viewer • Updated 19 days ago • 4k • 324
EleutherAI/LDS-retrain-bank-muon-N16k-bs16

Viewer • Updated 19 days ago • 4k • 418
EleutherAI/LDS-retrain-bank-muon-N32k-bs256

Viewer • Updated 19 days ago • 4k • 311
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-gpt2-medium

Viewer • Updated 19 days ago • 4k • 337
EleutherAI/bergson-smollm2-lds-chunks

Viewer • Updated Jul 17 • 60.1k • 69
EleutherAI/bergson-smollm2-scaling

Viewer • Updated 25 days ago • 512k • 121
EleutherAI/LDS-retrain-bank-adamw-N16k-bs128

Viewer • Updated 21 days ago • 2k • 19
EleutherAI/LDS-retrain-bank-adamw-N16k-bs16

Viewer • Updated 21 days ago • 2k • 57
EleutherAI/LDS-retrain-bank-adamw-N16k-bs32

Viewer • Updated 22 days ago • 2k • 15
EleutherAI/LDS-retrain-bank-adamw-N16k-bs512

Viewer • Updated 21 days ago • 2k • 13
EleutherAI/LDS-retrain-bank-adamw-N16k-bs64

Viewer • Updated 23 days ago • 2k • 213
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-clip1.0

Viewer • Updated 21 days ago • 2.9k • 15
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.5

Viewer • Updated 21 days ago • 2.9k • 7
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.0

Viewer • Updated 21 days ago • 2.9k • 37
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.1

Viewer • Updated 21 days ago • 2.9k • 37
EleutherAI/LDS-retrain-bank-muon-N16k-bs128

Viewer • Updated 22 days ago • 2k • 559
EleutherAI/LDS-retrain-bank-muon-N16k-bs32

Viewer • Updated 22 days ago • 4k • 31
EleutherAI/LDS-retrain-bank-muon-N16k-bs64

Viewer • Updated 21 days ago • 2k • 12
EleutherAI/LDS-retrain-bank-muon-N16k-bs256

Viewer • Updated 21 days ago • 5.64k • 384
EleutherAI/LDS-retrain-bank-adamw-N64k-bs256

Viewer • Updated 16 days ago • 4.18k • 167
EleutherAI/bergson-wikitext-2-gpt2

Updated 15 days ago • 14
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1004

Viewer • Updated 15 days ago • 89.9k • 663
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1005

Viewer • Updated 15 days ago • 96.2k • 232
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1006

Viewer • Updated 15 days ago • 96.2k • 627
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1008

Viewer • Updated 15 days ago • 96.2k • 651
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1007

Viewer • Updated 15 days ago • 96.2k • 511
EleutherAI/LDS-retrain-bank-london16k-bs256-muon

Viewer • Updated 12 days ago • 2k • 89
EleutherAI/PARTIAL_LDS-retrain-bank-muon-N64k-bs256

Updated 12 days ago • 311
EleutherAI/PARTIAL_LDS-retrain-bank-gpt2medium-16k-bs32

Viewer • Updated 12 days ago • 1.3k • 310
EleutherAI/pile-heldout-queries-2048

Updated 1 day ago • 19
EleutherAI/fineweb-heldout-queries-2048

Updated about 23 hours ago

Upvote