Mixture-of-Depths Attention
Paper • 2603.15619 • Published • 79
Wael Antar
Wael-Antar
AI & ML interests
None yet
Recent Activity
upvoted a paper 13 days ago
Mixture-of-Depths Attention upvoted a paper about 1 month ago
On Surprising Effectiveness of Masking Updates in Adaptive Optimizers upvoted a paper about 1 month ago
GLM-5: from Vibe Coding to Agentic EngineeringOrganizations
None yet
upvoted a paper 13 days ago
upvoted 4
papers about 1 month ago
On Surprising Effectiveness of Masking Updates in Adaptive Optimizers
Paper • 2602.15322 • Published • 10
GLM-5: from Vibe Coding to Agentic Engineering
Paper • 2602.15763 • Published • 119
Nanbeige4.1-3B: A Small General Model that Reasons, Aligns, and Acts
Paper • 2602.13367 • Published • 33
MiniCPM-SALA: Hybridizing Sparse and Linear Attention for Efficient Long-Context Modeling
Paper • 2602.11761 • Published • 7
updated a
model 3 months ago
published a
model 3 months ago
updated a
model 3 months ago
published a
model 3 months ago