Un pruned version 3

#9
by anitman - opened

Pruned version 3 seems not compatible with the newest larryvrh/MiniMax-H3-Turbo-Lora v4 4step lora.
ERROR] ERROR lora diffusion_model.blocks.0.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.1.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.2.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.3.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.4.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.5.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.6.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.7.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.8.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.9.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.10.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.11.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.12.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.13.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.14.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.15.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.16.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.17.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.18.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.19.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.20.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.21.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.22.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.23.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.24.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.25.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.26.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.27.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.28.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.29.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.30.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.31.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.32.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.33.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.34.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.35.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.36.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.37.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.38.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.39.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.40.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.41.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.42.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.43.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.44.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.45.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.46.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.47.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.48.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.blocks.49.adaln_proj.linear.weight shape '[96768, 8]' is invalid for input of size 260112384
[ERROR] ERROR lora diffusion_model.final_layer.adaln_proj.linear.weight shape '[10752, 8]' is invalid for input of size 28901376

I wouldn't expect any of these to be fully compatible with any loras actually. However, that readout seems like it's layer targets that are pruned from the full model, should give that flag on any pruned model. I made no changes to those blocks and no changes to any adaln elements.

Hi, TenStrip. Do you have any plans to release 10Eros Minimax H3 model Unpruned model in future, not pruned? Thanks for answer

Sign up or log in to comment