Beyond LLM-as-a-Judge: Deterministic Metrics for Multilingual Generative Text Evaluation
Paper • 2604.05083 • Published
AI & ML interests
Contributors who are invited to beta-test our next big feature! Contact us if you want to join this team :-)
Recent Activity
View all activity
gagan3012
authored a
paper 7 days ago
Post
4813
Want to share my enthusiasm for zai-org/GLM-5.1 here too 🔥
I think we have it: our open source Claude Code = GLM-5.1 + Pi (https://pi.dev/) - Built a Three.js racing game to eval and it's extremely impressive. Thoughts:
- One-shot car physics with real drift mechanics (this is hard)
- My fav part: Awesome at self iterating (with no vision!) created 20+ Bun.WebView debugging tools to drive the car programmatically and read game state. Proved a winding bug with vector math without ever seeing the screen
- 531-line racing AI in a single write: 4 personalities, curvature map, racing lines, tactical drifting. Built telemetry tools to compare player vs AI speed curves and data-tuned parameters
- All assets from scratch: 3D models, procedural textures, sky shader, engine sounds, spatial AI audio!
- Can do hard math: proved road normals pointed DOWN via vector cross products, computed track curvature normalized by arc length to tune AI cornering speed
You are going to hear about this model a lot in the next months - open source let's go - and thanks z-ai🚀🚀
I think we have it: our open source Claude Code = GLM-5.1 + Pi (https://pi.dev/) - Built a Three.js racing game to eval and it's extremely impressive. Thoughts:
- One-shot car physics with real drift mechanics (this is hard)
- My fav part: Awesome at self iterating (with no vision!) created 20+ Bun.WebView debugging tools to drive the car programmatically and read game state. Proved a winding bug with vector math without ever seeing the screen
- 531-line racing AI in a single write: 4 personalities, curvature map, racing lines, tactical drifting. Built telemetry tools to compare player vs AI speed curves and data-tuned parameters
- All assets from scratch: 3D models, procedural textures, sky shader, engine sounds, spatial AI audio!
- Can do hard math: proved road normals pointed DOWN via vector cross products, computed track curvature normalized by arc length to tune AI cornering speed
You are going to hear about this model a lot in the next months - open source let's go - and thanks z-ai🚀🚀
- 4 replies
gagan3012
authored 2
papers about 1 month ago
gagan3012
submitted 2
papers to Daily Papers about 1 month ago
victor
submitted a
paper to Daily Papers about 2 months ago
alceballosa
authored a
paper 3 months ago
Post
2731
Interesting article: use Claude Code to help open models write CUDA kernels (for eg) by turning CC traces into Skills. They made a library out of it 👀
https://huggingface.co/blog/upskill
https://huggingface.co/blog/upskill
Post
238
Together with @mferraretto and @efederici we released #Nesso-4B, a new model specialized for agentic workflows.
mii-llm/nesso-4B
#Nesso-4B is a fine-tuned version of Qwen-4B, trained on a highly curated and balanced dataset designed specifically for multilingual agentic workflows and conversational use cases.
As shown in the video below we simulate, the new “cowork” from #Antrophic, without any data sharing all running on a consumer device. The model can be used to build agentic behavior in #privateAI environments.
Not every problem requires super intelligence: in many cases, intelligence at the edge is more than enough.
#Nesso4B #AgenticAI #PrivateAI #EdgeAI #OnDeviceAI
mii-llm/nesso-4B
#Nesso-4B is a fine-tuned version of Qwen-4B, trained on a highly curated and balanced dataset designed specifically for multilingual agentic workflows and conversational use cases.
As shown in the video below we simulate, the new “cowork” from #Antrophic, without any data sharing all running on a consumer device. The model can be used to build agentic behavior in #privateAI environments.
Not every problem requires super intelligence: in many cases, intelligence at the edge is more than enough.
#Nesso4B #AgenticAI #PrivateAI #EdgeAI #OnDeviceAI
- 2 replies
gagan3012
authored 2
papers 3 months ago
craffel
authored a
paper 4 months ago
Post
3496
Nvidia is on a roll lately. Nemotron 3 Nano is my new fav local model, but here's the real flex: they published the entire evaluation setup. Configs, prompts, logs, all of it. This is how you do open models 🔥
https://huggingface.co/blog/nvidia/nemotron-3-nano-evaluation-recipe
https://huggingface.co/blog/nvidia/nemotron-3-nano-evaluation-recipe
gagan3012
authored a
paper 7 months ago
Wataru
authored 3
papers 7 months ago
UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022
Paper • 2204.02152 • Published
The T05 System for The VoiceMOS Challenge 2024: Transfer Learning from Deep Image Classifier to Naturalness MOS Prediction of High-Quality Synthetic Speech
Paper • 2409.09305 • Published
Sidon: Fast and Robust Open-Source Multilingual Speech Restoration for Large-scale Dataset Cleansing
Paper • 2509.17052 • Published • 4
craffel
authored a
paper 10 months ago
sadrasabouri
authored a
paper 10 months ago