samarthSonawane/marathi_news_articles
Viewer • Updated • 510k • 7 • 1
How to use NotShrirang/marathi-tokenizer with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("NotShrirang/marathi-tokenizer", dtype="auto")