google
/

umt5-base

text2text-generation

Model card Files Files and versions

Add a Better Transformer api ?

#3

by 1TuanPham - opened Sep 13, 2023

I think the model deserve this, since without it, the model is really hard to train with limited hardware.

I think that makes sense! cc @ybelkada @fxmarty

Hi @1TuanPham
We are going to migrate Better Transformer API to transformers core soon.
Please have a look at :https://github.com/huggingface/transformers/pull/26572

Meanwhile I suggest you to train the model using adapters for more memory efficient training: https://huggingface.co/docs/transformers/peft

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment