Scrinium (Scrinium)

posted an update over 1 year ago

Post

5956

Native tensor parallel has landed in transformers!!! https://github.com/huggingface/transformers/pull/34184 thanks a lot to the torch team for their support!

Contributions are welcome to support more models! 🔥

ArthurZ

authored a paper almost 2 years ago

RecurrentGemma: Moving Past Transformers for Efficient Open Language Models

Paper • 2404.07839 • Published Apr 11, 2024 • 48

ArthurZ

posted an update about 2 years ago

Post

mamba is now available in transformers. Thanks to @tridao and @albertgu for this brilliant model! 🚀 and the amazing mamba-ssm kernels powering this!
Checkout the collection here:
state-spaces/transformers-compatible-mamba-65e7b40ab87e5297e45ae406

5 replies

·

ArthurZ

authored a paper about 2 years ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29, 2024 • 155

ArthurZ

posted an update about 2 years ago

Post

Just when I was about to go to bed....... Here we go again

AI & ML interests

Team members 2

Scrinium's activity