Tokenizers & Vocabulary Files
Find tokenizer releases and vocabulary files for language models. Review model compatibility, tokenization formats, special tokens and usage instructions.
0 published releases
No published releases in this category yet.
Compatibility and release files
Tokenizer releases can include tokenizer.json, SentencePiece .model or Tiktoken files, vocabularies and configuration. Describe compatible model revisions, special tokens and chat templates; bundle related files together.
Share a model, dataset or asset →