Instructions to use prdev/gpt2-differential-linear-attention with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use prdev/gpt2-differential-linear-attention with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("prdev/gpt2-differential-linear-attention", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Model Card for Model ID
A version of GPT-2 trained with a differential linear transformer. See https://prdev.substack.com/p/differential-linear-attention?r=2hyugh for details.
- Downloads last month
- 9
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support