gpjt/1xrtx3090-stacked-interventions
Text Generation • 0.2B • Updated • 300
Giles Thomas
gpjt
AI & ML interests
Doing my best to speedrun 20 years of AI research. YMMV
Recent Activity
updated a collection 2 days ago
LLM from scratch updated a model 2 days ago
gpjt/1xrtx3090-stacked-interventions published a model 2 days ago
gpjt/1xrtx3090-stacked-interventionsOrganizations
None yet
gpjt/1xrtx3090-baseline
Text Generation • 0.2B • Updated • 204
gpjt/8xa100m40-stacked-interventions-3
Text Generation • 0.2B • Updated • 195
gpjt/8xa100m40-stacked-interventions-2
Text Generation • 0.2B • Updated • 253
gpjt/8xa100m40-stacked-interventions-1
Text Generation • 0.2B • Updated • 242
gpjt/8xa100m40-baseline-8
Text Generation • 0.2B • Updated • 512
gpjt/8xa100m40-baseline-7
Text Generation • 0.2B • Updated • 511
gpjt/8xa100m40-baseline-6
Text Generation • 0.2B • Updated • 501
gpjt/8xa100m40-baseline-4
Text Generation • 0.2B • Updated • 313
gpjt/8xa100m40-baseline-5
Text Generation • 0.2B • Updated • 496
gpjt/8xa100m40-baseline-3
Text Generation • 0.2B • Updated • 563
gpjt/8xa100m40-baseline-2
Text Generation • 0.2B • Updated • 521
gpjt/8xa100m80-no-amp
Text Generation • 0.2B • Updated • 252
gpjt/8xa100m40-weight-decay-cerebras
Text Generation • 0.2B • Updated • 354
gpjt/8xa100m40-weight-decay-gpt2
Text Generation • 0.2B • Updated • 340
gpjt/8xa100m40-qkv-bias
Text Generation • 0.2B • Updated • 86
gpjt/8xa100m40-schedule-learning-rate
Text Generation • 0.2B • Updated • 85
gpjt/8xa100m40-remove-dropout
Text Generation • 0.2B • Updated • 90
gpjt/8xa100m40-baseline
Text Generation • 0.2B • Updated • 85
gpjt/1xrtx3090m24-fineweb-edu-2x
Text Generation • 0.2B • Updated • 79
gpjt/1xrtx3090m24-fineweb-edu
Text Generation • 0.2B • Updated • 81
gpjt/1xrtx3090m24-fineweb
Text Generation • 0.2B • Updated • 87
gpjt/8xh100m80-latest
Text Generation • 0.2B • Updated • 79
gpjt/8xh100m80-best
Text Generation • 0.2B • Updated • 83
gpjt/8xb200m160
Text Generation • 0.2B • Updated • 89
gpjt/8xa100m80
Text Generation • 0.2B • Updated • 86
gpjt/8xa100m40
Text Generation • 0.2B • Updated • 121
gpjt/8xa100m40-gradient-clipping
Text Generation • 0.2B • Updated • 81
gpjt/test5
Text Generation • 0.2B • Updated • 7
gpjt/test4
Text Generation • 0.2B • Updated • 3