Training Transformers Together

AI & ML interests

Training DALL-E with volunteers from all over the Internet using hivemind and dalle-pytorch (NeurIPS 2021 demo)

Recent Activity

mryab  submitted a paper 23 days ago

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking

julien-c  submitted a paper about 2 months ago

Shaping capabilities with token-level data filtering

thomwolf  authored a paper 5 months ago

Robot Learning: A Tutorial

View all activity

Team members 118