Gryphe/Gemma-4-31B-StyleTune
Text Generation • 33B • Updated • 2.57k • • 81
Alpine Milk Chocolate
Schogetten
·
AI & ML interests
QA
Recent Activity
liked a model 4 days ago
Gryphe/Gemma-4-31B-StyleTune liked a model 4 days ago
Gryphe/Gemma-4-26B-A4B-StyleTune liked a model 4 days ago
Gryphe/Gemma-4-26B-A4B-StyleTune-V2Organizations
None yet
liked 3
models 4 days ago
liked a
model 5 days ago
liked a
Space 5 days ago
reacted to ucr-max's post with 🔥 5 days ago
Post
2963
We have released the first version of CompactLMIndex UniversalComputingResearch/clmi, a curated benchmark for smaller language models.
The index evaluates models across six benchmarks covering commonsense, science and world knowledge, and grammatical competence. Scores are normalized for random chance, so results are easier to compare across tasks with different baselines.
The composite gives 50% weight to commonsense, 25% to science and world knowledge, and 25% to grammatical competence. BLiMP is macro-averaged across its 12 linguistic categories. Every result includes 95% bootstrap intervals, and rank ranges reflect paired comparisons on matched evaluation items.
The goal is to compare compact models under one fixed, zero-shot evaluation protocol and make differences in architecture, training, and inference visible without treating parameter count as a substitute for quality.
If you have results for a model that fits the benchmark scope, please open a discussion on the Space.
The index evaluates models across six benchmarks covering commonsense, science and world knowledge, and grammatical competence. Scores are normalized for random chance, so results are easier to compare across tasks with different baselines.
The composite gives 50% weight to commonsense, 25% to science and world knowledge, and 25% to grammatical competence. BLiMP is macro-averaged across its 12 linguistic categories. Every result includes 95% bootstrap intervals, and rank ranges reflect paired comparisons on matched evaluation items.
The goal is to compare compact models under one fixed, zero-shot evaluation protocol and make differences in architecture, training, and inference visible without treating parameter count as a substitute for quality.
If you have results for a model that fits the benchmark scope, please open a discussion on the Space.
- 6 replies
Eval Request: Ternary Bonsai 27B
#686 opened 9 days ago
by Schogetten
liked 2
models 11 days ago
liked a
model 18 days ago
liked 2
models about 1 month ago
liked 8
models about 2 months ago
prism-ml/Ternary-Bonsai-8B-gguf
Text Generation • 8B • Updated • 88k • 126
google/gemma-4-26B-A4B-it-qat-q4_0-unquantized-assistant
Image-Text-to-Text • 0.4B • Updated • 12.1k • 16
Simplepotat/gemma-4-31b-it-qat-q4_0-assistant-gguf
Image-Text-to-Text • 0.5B • Updated • 566 • 9
unsloth/gemma-4-26B-A4B-it-qat-GGUF
Image-Text-to-Text • 25B • Updated • 496k • 332
google/gemma-4-26B-A4B-it-qat-q4_0-unquantized
Image-Text-to-Text • 27B • Updated • 48.3k • • 44
google/gemma-4-26B-A4B-it-qat-q4_0-gguf
Image-Text-to-Text • 25B • Updated • 98.3k • 121
google/gemma-4-31B-it-qat-q4_0-unquantized
Image-Text-to-Text • 33B • Updated • 12.5k • • 38
unsloth/gemma-4-31B-it-qat-GGUF
Image-Text-to-Text • 31B • Updated • 292k • 166