What just i read in model card.
Is it some kind of frekenstine merge of totally different base model
There are two options: either this is a breakthrough that deserves a peer-reviewed paper, or it's total bullshit. For now, I'm sticking with the second one.
I know for sure that transferring knowledge between different architectures by merging their blocks without retraining is complete nonsense. Unless I misunderstood the process.
Yes this is a cross-architecture project. That's not really unheard of, there was a reddit post about doing it with Wan and LTX. You couldn't do this with LLM's, at least I don't think so. But if anything credit and more attention needs to go to the Minimax H3 design and architecture for supporting it as a real possibility and this is just proof of concept. If future models were similar there might be more cross-architecture functionality. Or this is a quirk that unbiased deterministic models excel at being poked and prodded.
A model like LTX is much worse for it. I did the reverse and sent H3 back into the LTX the same way; it definitely helped slightly in ways that it could with a little bit of a cleaner prompting output and response, but it was slight since expanding the scope breaks LTX very quickly.
There are two options: either this is a breakthrough that deserves a peer-reviewed paper, or it's total bullshit. For now, I'm sticking with the second one.
I know for sure that transferring knowledge between different architectures by merging their blocks without retraining is complete nonsense. Unless I misunderstood the process.
Couldn't agree more. This is clearly a joke. It's wild that so many people actually believe this garbage. And seeing veteran YouTubers hype it up? Absolutely ridiculous.