MotionInsight-8B

This is the released multidim-all/checkpoint-5500 for MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videos.

The model consumes sampled RGB frames, target-object motion features from SAM3 and CoTracker3, and camera motion from VIPE. It predicts diagnostic reasoning and three motion-quality scores.

Use this checkpoint with the code and custom Qwen3-VL implementation from:

https://github.com/JohnZhan2023/MotionInsight

hf download JohnZhan/MotionInsight-8B \
  --local-dir checkpoints/MotionInsight-8B
python scripts/patch_transformers.py
python inference.py --help

The VidMotion dataset, videos, and annotations are not distributed.

Downloads last month
16
Safetensors
Model size
832k params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support