jwieting
/

paraphrastic_test

Sentence Similarity

sentence-transformers

feature-extraction

text-embeddings-inference

Model card Files Files and versions

paraphrastic_test / tokenizer_config.json

jwieting's picture

Upload tokenizer_config.json

9a5704e over 3 years ago

history blame contribute delete

200 Bytes

	{
	"additional_special_tokens": [],
	"do_lower_case": true,
	"eos_token": "</s>",
	"pad_token": "</s>",
	"sp_model_kwargs": {},
	"tokenizer_class": "ReformerTokenizer",
	"unk_token": "<unk>"
	}