AbstractPhil
/

tiny-gpt-tests

tinygpt-minimal

Model card Files Files and versions

TinyGPT (Minimal) — Colab A100 Run

Tokens: TinyStories 10%
Context: 512
Dim: 512
Layers: 6
Heads: 8
Files: model.safetensors, pytorch_model.bin, tokenizer.json, config.json

A cute little experiment for testing. Lets teach our little robot some fun pentachoron behavior.

Downloads last month: 15

Safetensors

Model size

27.6M params

Tensor type

F32

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including AbstractPhil/tiny-gpt-tests

Black Sheep

The ones that didn't quite work, but are still very interesting and have their use cases nonetheless. • 4 items • Updated Mar 14