susnato
/

clvp_dev

Feature Extraction

Model card Files Files and versions

clvp_dev / special_tokens_map.json

susnato's picture

Uploaded new saved tokenizer

75a9688 almost 3 years ago

Raw History Blame Contribute Delete

109 Bytes

	{
	"bos_token": "<\|endoftext\|>",
	"eos_token": "[STOP]",
	"pad_token": "[STOP]",
	"unk_token": "[UNK]"
	}