Clue-instruct dataset and different models fine-tuned on it.
Andrea Zugarini
azugarini
·
AI & ML interests
Natural Language Processing, Language Models, Language Model Compression
Recent Activity
published a model about 1 month ago
VillanovaAI/Villanova-2B-2512-Preview-Apnea-FT updated a model about 1 month ago
VillanovaAI/Villanova-2B-2512-Preview-Apnea-FT liked a model 3 months ago
VillanovaAI/Villanova-2B-VL-2512-PreviewOrganizations
Collection of research on tokenizers' adaptation to specific domains and/or languages. Special focus on sequence compression directions
-
Fast Vocabulary Transfer for Language Model Compression
Paper • 2402.09977 • Published • 2 -
Multi-Word Tokenization for Sequence Compression
Paper • 2402.09949 • Published -
Zero-Shot Tokenizer Transfer
Paper • 2405.07883 • Published • 5 -
Language Model Tokenizers Introduce Unfairness Between Languages
Paper • 2305.15425 • Published • 1
Clue-instruct dataset and different models fine-tuned on it.
Collection of research on tokenizers' adaptation to specific domains and/or languages. Special focus on sequence compression directions
-
Fast Vocabulary Transfer for Language Model Compression
Paper • 2402.09977 • Published • 2 -
Multi-Word Tokenization for Sequence Compression
Paper • 2402.09949 • Published -
Zero-Shot Tokenizer Transfer
Paper • 2405.07883 • Published • 5 -
Language Model Tokenizers Introduce Unfairness Between Languages
Paper • 2305.15425 • Published • 1
