Instructions to use SuhaanCoding/Wan2.2-S2V-14B-Diffusers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SuhaanCoding/Wan2.2-S2V-14B-Diffusers with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SuhaanCoding/Wan2.2-S2V-14B-Diffusers", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
Wan2.2-S2V-14B (Diffusers layout)
This is Wan-AI/Wan2.2-S2V-14B โ a model that animates a picture of a person in sync with a voice recording โ repacked into the folder layout that FastVideo loads.
No weights were changed. The video model tensors are byte-identical copies of the official release. The text encoder, VAE, tokenizer and scheduler come from Wan-AI's own Diffusers release of Wan2.1 (the same weights S2V uses), and the wav2vec2 speech encoder is the one bundled inside the official S2V repo.
Made with
scripts/checkpoint_conversion/wan_s2v_to_diffusers.py
from FastVideo PR #1683.
Verification status
- Checked: all 1260 video-model tensors load into FastVideo's model with the correct names and shapes (the conversion script verifies this automatically and refuses to produce output otherwise).
- Not yet checked: end-to-end video generation on a GPU. If you run it and find problems, please comment on the PR above.
Usage (with FastVideo, once PR #1683 is merged)
from fastvideo import VideoGenerator
gen = VideoGenerator.from_pretrained("SuhaanCoding/Wan2.2-S2V-14B-Diffusers")
gen.generate_video(
prompt="...",
image_path="face.jpg",
audio_path="speech.wav",
output_path="out.mp4",
save_video=True,
)
- Downloads last month
- 5
Model tree for SuhaanCoding/Wan2.2-S2V-14B-Diffusers
Base model
Wan-AI/Wan2.2-S2V-14B