transhumanist-already-exists
/

tereshchenkoblue-tokenizer

gemma-3-tokenizer

corpus-linguistics

Model card Files Files and versions

tereshchenkoblue-tokenizer / tokenizer.json

transhumanist-already-exists's picture

transhumanist-already-exists

Replace main tokenizer files on new one

bd49b44 verified over 1 year ago

History Blame Contribute Delete

38 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: f1a9c820d5223db48484d203b4ea07273c14072ff39c63f1da53684bc1a73718
Size of remote file:: 38 MB
SHA256:: 6198c45b15ec6ac2becd122687e2b45436525b69833aaa6218ad0be65abea286

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.