instabase
/

llama2_tokenizer

Model card Files Files and versions

llama2_tokenizer

503 kB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

rpowalski's picture

copied from hf-internal-testing/llama-tokenizer

bca45fa over 2 years ago

.gitattributes

1.52 kB
initial commit over 2 years ago
special_tokens_map.json

330 Bytes
copied from hf-internal-testing/llama-tokenizer over 2 years ago
tokenizer.model

500 kB
xet

copied from hf-internal-testing/llama-tokenizer over 2 years ago
tokenizer_config.json

1.16 kB
copied from hf-internal-testing/llama-tokenizer over 2 years ago