Article
Improving Hugging Face Training Efficiency Through Packing with Flash Attention 2
- +4
•
42
Mayank Mishra
mayank-mishra
AI & ML interests
Large Language Models, Distributed Training and Inference
Organizations
published an
article over 1 year ago
published an
article over 1 year ago
Article
Saving Memory Using Padding-Free Transformer Layers during Finetuning
•
21
published an
article almost 2 years ago
Article
Aurora-M: The First Open Source Biden-Harris Executive Order Red teamed Multilingual Language Model
•
7