omarmomen
/

babylm_bpe_tokenizer_16k

Model card Files Files and versions

Model Card for omarmomen/babylm_bpe_tokenizer_16k

This model is part of the experiments in my master's thesis titled "Linguistic Structure Induction from Language Models" (https://arxiv.org/abs/2403.09714).

"omarmomen/babylm_bpe_tokenizer_16k" is a RobertaTokenizer pretrained on the BabyLM 10 Training dataset (cased) with 16K tokens.

https://arxiv.org/abs/2403.09714

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train omarmomen/babylm_bpe_tokenizer_16k

Space using omarmomen/babylm_bpe_tokenizer_16k 1

Paper for omarmomen/babylm_bpe_tokenizer_16k

Linguistic Structure Induction from Language Models

Paper • 2403.09714 • Published Mar 11, 2024