Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention
Paper • 2606.20945 • Published • 74
AK Singh
aksinghyaani
AI & ML interests
None yet
Recent Activity
upvoted a paper 4 days ago
Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention liked a model 27 days ago
FrontiersMind/Nandi-Mini-V1.1-600M-Intermediate-Checkpoint-400GT updated a model about 1 month ago
FrontiersMind/Nandi-Mini-V1.1-600M-Early-Checkpoint-250GTOrganizations
upvoted a paper 4 days ago
liked a
model 27 days ago
updated a
model about 1 month ago
liked a
model about 1 month ago
Layer sharing?
3
#4 opened about 1 month ago
by 
Datdanboi25
liked a
model about 1 month ago
updated a
model about 1 month ago
liked a
model about 1 month ago
Interesting Architectural design
2
#3 opened about 2 months ago
by 
Aditya02
Why Choose a 150M Model Over Larger LLMs
➕ 4
2
#1 opened 2 months ago
by 
maya203
Fully Open-Sourced, or just Open-Weight?
2
#2 opened 2 months ago
by 
Smoffyy
liked a
model 2 months ago
updated a
model 2 months ago
liked a
model 2 months ago
updated a
model 3 months ago
liked a
model 3 months ago
updated a
model 3 months ago