Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
flexitok
's Collections
llama_and_16k
16k_v2
8k_v2
32000-vocab-v2
16000-vocab-v2
8000-vocab-v2
1000-vocab-v2
4000-vocab-v2
fineweb2-hq-tokenizers-v2
4000-vocab
16000-vocab
fineweb2-hq-tokenizers-feat2
flexitok-mod-tokenizers-zero-padded
flexitok/mod-tokenizers
flexitok/fineweb2-hq-superset-tokenizers
Fineweb2-HQ-Tokenizers
merging-toksuite
baselines
flexitok-mod-tokenizers-zero-padded
updated
Mar 3
Upvote
-
flexitok/supertokenizer-mod_tokenizers_zero_padded
Updated
Mar 3
flexitok/mod-tokenizers-zero-padded-individual
Updated
Mar 3
flexitok/mod-tokenizers-zero-padded-ltr_3digit
3.97M
•
Updated
Mar 4
•
1
flexitok/mod-tokenizers-zero-padded-ltr_2digit
3.46M
•
Updated
Mar 4
flexitok/mod-tokenizers-zero-padded-ltr_4digit
9.05M
•
Updated
Mar 4
•
1
flexitok/mod-tokenizers-zero-padded-ltr_5digit
59.7M
•
Updated
Mar 4
•
1
flexitok/mod-tokenizers-zero-padded-rtl_2digit
3.46M
•
Updated
Mar 4
•
5
flexitok/mod-tokenizers-zero-padded-rtl_3digit
3.97M
•
Updated
Mar 4
flexitok/mod-tokenizers-zero-padded-rtl_4digit
9.05M
•
Updated
Mar 4
•
1
flexitok/mod-tokenizers-zero-padded-rtl_5digit
59.7M
•
Updated
Mar 4
•
6
Upvote
-
Share collection
View history
Collection guide
Browse collections