BananaMindBench Leaderboard
๐
14
Explore BananaMind Bench model rankings and efficiency
AI & ML interests
Pretraining, QAT, SLM, Overtraining, AI Interpretability.
Recent Activity
View all activity
Submitting cagliostro-v1 (157M)
3
#8 opened about 19 hours ago
by 
TobiasLogic
Add cagliostro-v1 (157.4M, Elo 1046)
#9 opened about 19 hours ago
by TobiasLogic
submitting two models
9
#7 opened 4 days ago
by 
FlameF0X
Banaxi-Techย
updated a
Space about 20 hours ago
Post
2259
I made an AI agent for end-to-end ML research. It is based on Claude Agents Python SDK (you can use it with your existing Claude subscription). Also needs Voyage AI (optional, but highly recommended for quality paper analysis). The workflow is: you give the agent a research question (or topic/direction), it pulls papers from papers-with-code and arxiv, reranks them and picks top-15 (with Voyage), then it makes a research plan, writes pipelines (with tests, preflight checks, smoke-runs). Then it uses Kaggle, HF Jobs, or SSH to a GPU to execute the pipeline. Finally, it gets the results, makes visualizations, writes the paper (with citing from papers ingested after step-1) and makes a jupyter notebook. Also there is an auto-generated wiki (like DeepWiki) to quickly understand the generated code. The code is fully open-source under permssive MIT license (it is a personal project). Here is the github link: https://github.com/view321/Grad and a workspace screenshot is attached to the message.
look at posts lol
3
#3 opened 1 day ago
by 
RexTRO111
Banaxi-Techย
posted an update 1 day ago
Post
122
New Architecture.
Training started. Few days and you'll see what it is exactly.
Its 2 models connected into 1 unified model.
Training started. Few days and you'll see what it is exactly.
Its 2 models connected into 1 unified model.
Banaxi-Techย
updated a
model 2 days ago
Great run btw
โค๏ธ 1
8
#1 opened 15 days ago
by RexTRO111
Banaxi-Techย
posted an update 3 days ago
Post
6219
We're excited to open source BananaMind OS, our OS for running BananaMind models.
It allows you to run local AI on hardware such as a 486 or 386 (untested)
Check it out at: https://github.com/BananaMind/BananaMindOS
How to use it, either build it yourself (see instructions on repo) or check out our prebuilt ISOs:
https://github.com/BananaMind/BananaMindOS/releases/download/v0.0.2/bananamind-os.iso is for 6MB+ RAM using Grub
https://github.com/BananaMind/BananaMindOS/releases/download/v0.0.2/bananamind-ultra.iso is for under 6MB RAM using our custom bootloader to bypass the grub memory requirement.
The ISOs are about 70MB because they include all of the models in our custom format, see repo if you want to build a ISO for only one model.
x64 and x86 supported. 16 bit maybe soon.
And a TTS on 486 soon.
It allows you to run local AI on hardware such as a 486 or 386 (untested)
Check it out at: https://github.com/BananaMind/BananaMindOS
How to use it, either build it yourself (see instructions on repo) or check out our prebuilt ISOs:
https://github.com/BananaMind/BananaMindOS/releases/download/v0.0.2/bananamind-os.iso is for 6MB+ RAM using Grub
https://github.com/BananaMind/BananaMindOS/releases/download/v0.0.2/bananamind-ultra.iso is for under 6MB RAM using our custom bootloader to bypass the grub memory requirement.
The ISOs are about 70MB because they include all of the models in our custom format, see repo if you want to build a ISO for only one model.
x64 and x86 supported. 16 bit maybe soon.
And a TTS on 486 soon.
- 9 replies
Banaxi-Techย
posted an update 5 days ago
Post
2891
We're excited to release BananaMind 2 Pro, our final version of the Pro model.
Trained on 100B tokens it performs extremely good for its token and size class.
The training took 22 days on one RTX 5070 Ti.
Check it out at
BananaMind/BananaMind-2-Pro
We did not release a Chat version yet because it regressed. Release Later.
Follow us to know when BananaMind 2 Ultra releases and support us at
BananaMind
@Banaxi-Tech
@vovaRL
@DedeProGames
Trained on 100B tokens it performs extremely good for its token and size class.
The training took 22 days on one RTX 5070 Ti.
Check it out at
BananaMind/BananaMind-2-Pro
We did not release a Chat version yet because it regressed. Release Later.
Follow us to know when BananaMind 2 Ultra releases and support us at
@Banaxi-Tech
@vovaRL
@DedeProGames
- 19 replies
Banaxi-Techย
posted an update 6 days ago
Post
2738
Today we wanted to release BananaMind 2 Pico, our smallest model yet at ~0.9M parameters. Instead, we accidentally ran a very expensive experiment on what happens when you push a tiny model way past its useful token budget.
Short version: we trained on 200B tokens (~222K:1 tokens-per-parameter). The model peaked at 20B tokens with an INT Index of 4.55, then degraded monotonically over the next 160B to 3.31 โ a 27% regression. Three of four Open SLM benchmarks were worse at the end of training than they were at 10% through.
The useful compute-optimal range for Pico-tier models looks like ~22Kโ30K tokens per parameter. Ratios like 7K:1, 15K:1, and 22K:1 all work fine โ TinyStories and most sub-3M community models sit in this range. Push much further and benchmarks start rotting.
Follow us for more:
BananaMind
@vovaRL
@Banaxi-Tech
Full writeup with all checkpoints, the Chinchilla-ratio control run, and the schedule-vs-overtraining analysis: https://huggingface.co/blog/Banaxi-Tech/ovdadadadd
And if anyone, i dont know the reason why you would, wants the 20B token checkpoint reply and ill upload it as BananaMind 2.1 Pico EXP
Short version: we trained on 200B tokens (~222K:1 tokens-per-parameter). The model peaked at 20B tokens with an INT Index of 4.55, then degraded monotonically over the next 160B to 3.31 โ a 27% regression. Three of four Open SLM benchmarks were worse at the end of training than they were at 10% through.
The useful compute-optimal range for Pico-tier models looks like ~22Kโ30K tokens per parameter. Ratios like 7K:1, 15K:1, and 22K:1 all work fine โ TinyStories and most sub-3M community models sit in this range. Push much further and benchmarks start rotting.
Follow us for more:
@vovaRL
@Banaxi-Tech
Full writeup with all checkpoints, the Chinchilla-ratio control run, and the schedule-vs-overtraining analysis: https://huggingface.co/blog/Banaxi-Tech/ovdadadadd
And if anyone, i dont know the reason why you would, wants the 20B token checkpoint reply and ill upload it as BananaMind 2.1 Pico EXP
- 3 replies
Banaxi-Techย
posted an update 7 days ago
Post
1880
We're excited to release BananaMind 2 SLMoE, an experimental sequence-level mixture-of-experts model.
It uses only 8M parameters per message but has 25M total parameters, 13 experts (out of 64) are selected based on the message prefix and reused for the entire response.
We're testing with this sequence-level architecture to find out how big the capability loss actually is and how much of it can be fixed.
The long-term idea is that this could make very large sparse models usable on machines that can't fit them in RAM by putting the entire model (which is big) on disk and only loading the active parts into VRAM.
This architecture is still in research and shouldn't be used for production models.
We trained it on 60B tokens (of FineWeb-HQ, FineWeb-Edu, DCLM ,Cosmopedia v2, FineMath and NPSet-2) on 8 RTX Pro 6000s.
Check it out at BananaMind/BananaMind-2-SLMoE
Follow us for future models:
BananaMind
@vovaRL
@Banaxi-Tech
@DedeProGames
BananaMind 2 Pro in a few days. You've been waiting 22 days for it.
It uses only 8M parameters per message but has 25M total parameters, 13 experts (out of 64) are selected based on the message prefix and reused for the entire response.
We're testing with this sequence-level architecture to find out how big the capability loss actually is and how much of it can be fixed.
The long-term idea is that this could make very large sparse models usable on machines that can't fit them in RAM by putting the entire model (which is big) on disk and only loading the active parts into VRAM.
This architecture is still in research and shouldn't be used for production models.
We trained it on 60B tokens (of FineWeb-HQ, FineWeb-Edu, DCLM ,Cosmopedia v2, FineMath and NPSet-2) on 8 RTX Pro 6000s.
Check it out at BananaMind/BananaMind-2-SLMoE
Follow us for future models:
@vovaRL
@Banaxi-Tech
@DedeProGames
BananaMind 2 Pro in a few days. You've been waiting 22 days for it.
- 3 replies
Banaxi-Techย
posted an update 8 days ago
Post
2805
We're excited to release BananaMind 2 Micro, our smallest model yet.
It fits a compact architecture in only 2.9M parameters achieving the highest parameter efficiency on BananaMind Base Bench against comparable models.
It achieves comparable performance to GPT S2 5M and GPT S 5M at almost half the size while beating CMA 1M Mini.
BananaMind 2 Micro achieved the #1 spot on the Open SLM Leaderboard for the sub 3M category (not added yet but it achieves #1)
For the training we used Muon + the XSA Refresh Gate with a 5e-2 lr for Muon and 4e-3 for the 1D weights.
Its score on our efficiency measure is 0.326 getting the first place with Syn 2.6M on the second place scoring 0.291 and GPT S 5M at 0.235*
Check it out at BananaMind/BananaMind-2-Micro and follow us at:
@vovaRL
@DedeProGames
@Banaxi-Tech
BananaMind
Our new releases aren't stopping ๐ August 13-14 BananaMind 2 Pro
It fits a compact architecture in only 2.9M parameters achieving the highest parameter efficiency on BananaMind Base Bench against comparable models.
It achieves comparable performance to GPT S2 5M and GPT S 5M at almost half the size while beating CMA 1M Mini.
BananaMind 2 Micro achieved the #1 spot on the Open SLM Leaderboard for the sub 3M category (not added yet but it achieves #1)
For the training we used Muon + the XSA Refresh Gate with a 5e-2 lr for Muon and 4e-3 for the 1D weights.
Its score on our efficiency measure is 0.326 getting the first place with Syn 2.6M on the second place scoring 0.291 and GPT S 5M at 0.235*
Check it out at BananaMind/BananaMind-2-Micro and follow us at:
@vovaRL
@DedeProGames
@Banaxi-Tech
Our new releases aren't stopping ๐ August 13-14 BananaMind 2 Pro
- 9 replies
Banaxi-Techย
posted an update 10 days ago
Post
2693
Today.
- 9 replies
Banaxi-Techย
posted an update 11 days ago
Post
1967
We're exited to announce BananaMind OS, our OS specically for running BananaMind models!
Its able to run BananaMind 2 Nano at 4 bit on only 7-8MB of ram, the 2 bit on 6MB of ram and the 8 bit version on 14MB of RAM!
It runs on a 486 or newer!
Check out this video and image running BananaMind 2 Nano 4 Bit on 9
MB of RAM and a emulated 486 in QEMU at ~1TPS!
We asked it: "What is the first letter of the alphabet?"
The response is:
"The first letter of the alphabet is:
- A.
"
And if you're asking because of the video, yes I am a arch btw.
Comment and like this post for a GitHub link and comment for adding other models!
Its able to run BananaMind 2 Nano at 4 bit on only 7-8MB of ram, the 2 bit on 6MB of ram and the 8 bit version on 14MB of RAM!
It runs on a 486 or newer!
Check out this video and image running BananaMind 2 Nano 4 Bit on 9
MB of RAM and a emulated 486 in QEMU at ~1TPS!
We asked it: "What is the first letter of the alphabet?"
The response is:
"The first letter of the alphabet is:
- A.
"
And if you're asking because of the video, yes I am a arch btw.
Comment and like this post for a GitHub link and comment for adding other models!
- 46 replies
Banaxi-Techย
posted an update 12 days ago
Post
1228
BananaMind 2 Pro got better!
Release on August 13-14
Follow our team for BananaMind 2 Ultra:
@vovaRL for training code
@Banaxi-Tech
@DedeProGames for providing compute
BananaMind
Want to become a previewer?
๐
BananaMind-Model-Previewers
Release on August 13-14
Follow our team for BananaMind 2 Ultra:
@vovaRL for training code
@Banaxi-Tech
@DedeProGames for providing compute
Want to become a previewer?
๐
- 3 replies
Banaxi-Techย
posted an update 13 days ago
Post
168
u guys want bananamind 2 ultra?
reply for bananamind 2 ultra want
reply for bananamind 2 ultra want
- 1 reply
Banaxi-Techย
posted an update 15 days ago
Post
3244
We did an experiment, we wanted to see if AI is good enough to train models.
We used GPT 5.6 Sol Max for this because its one of the most powerful ones right now.
Our instructions were, it should write the training code, and start the training process and monitor it by itself.
We also gave it a link to BananaMind 2 Mini to get our architecture right.
The result: It worked, it made the working BananaMind 2 Nano, and even beat our previous MiniBananaMind v4 9M.
Its getting way easier to develop your own models now!
We used GPT 5.6 Sol Max for this because its one of the most powerful ones right now.
Our instructions were, it should write the training code, and start the training process and monitor it by itself.
We also gave it a link to BananaMind 2 Mini to get our architecture right.
The result: It worked, it made the working BananaMind 2 Nano, and even beat our previous MiniBananaMind v4 9M.
Its getting way easier to develop your own models now!
- 8 replies
Banaxi-Techย
posted an update 16 days ago
Post
2325
We're excited to release BananaMind 2 Pro Preview, our best model yet.
Trained on ~52B tokens it performs extremely good for its token and size class.
We trained it on a single 5070 Ti in about 11 days.
Check it out at BananaMind/BananaMind-2-Pro-Preview.
Sadly we need to delay BananaMind 2 Micro until the launch of the final BananaMind 2 Pro.
We will release the final checkpoint with 100B tokens in ~11 days.
Go and fine-tune it!
We've also released BananaMind 2 Pro Preview Chat which is the instruct version of it!
BananaMind/BananaMind-2-Pro-Preview-Chat
Follow us to know when the final releases and support us at
BananaMind
@Banaxi-Tech
Trained on ~52B tokens it performs extremely good for its token and size class.
We trained it on a single 5070 Ti in about 11 days.
Check it out at BananaMind/BananaMind-2-Pro-Preview.
Sadly we need to delay BananaMind 2 Micro until the launch of the final BananaMind 2 Pro.
We will release the final checkpoint with 100B tokens in ~11 days.
Go and fine-tune it!
We've also released BananaMind 2 Pro Preview Chat which is the instruct version of it!
BananaMind/BananaMind-2-Pro-Preview-Chat
Follow us to know when the final releases and support us at
@Banaxi-Tech
- 5 replies