The Ultra-Scale Playbook
🌌
3.9k
The ultimate guide to training LLM on large GPU Clusters
Hyogon Ryu
ugonfor
AI & ML interests
None yet
Recent Activity
liked a Space 5 minutes ago
nanotron/ultrascale-playbook liked a model 2 days ago
KRAFTON/Raon-VisionEncoder updated a model 2 months ago
ugonfor/gemma-4-E2B-it-enOrganizations
None yet
liked a
Space 5 minutes ago
liked a
model 2 days ago
updated a
model 2 months ago
published a
model 2 months ago
updated a
model 3 months ago
published a
model 3 months ago
updated a
model 3 months ago
published a
model 3 months ago
upvoted an article 8 months ago
Article
SmolLM3: smol, multilingual, long-context reasoner
- +21
eliebak, cmpatino, anton-l, edbeeching, m-ric, nouamanetazi, akseljoonas, guipenedo, hynky, clefourrier, SaylorTwift, kashif, qgallouedec, hlarcher, glutamatt, Xenova, reach-vb, ngxson, craffel, lewtun, loubnabnl, lvwerra, thomwolf
• • 780 upvoted 2
papers 8 months ago
upvoted an article 11 months ago
Article
Fine-tuning LLMs to 1.58bit: extreme quantization made easy
- +4
medmekk, marcsun13, lvwerra, pcuenq, osanseviero, thomwolf
• • 281 updated 5
models over 1 year ago
ugonfor/mistral-7b-qlora-arc-mixlora
Text Generation • 7B • Updated • 10
ugonfor/mistral-7b-loftQ-arc
Text Generation • 7B • Updated • 6
ugonfor/mistral-7b-qlora-arc-cot
Text Generation • 7B • Updated • 7
ugonfor/mistral-7b-qlora-arc
Text Generation • 7B • Updated • 5
ugonfor/mistral-7b-4bits
Text Generation • 7B • Updated • 7
published 3
models over 1 year ago