SandBase is live — $1 in free credits on signupStart free ›

Alibaba modelsvideo generation api

alibaba/wan/2.2/speech-to-video

Wan 2.2 Speech To Video by Alibaba - advanced AI model for audio-to-video. Delivers high-quality results with fast inference, suitable for both creative and production workflows.

Input
The text prompt used for video generation.

PNG, JPEG, WebP, or GIF · 20 MiB maximum

URL of the input image. If the input image does not match the chosen aspect ratio, it is resized and center cropped.
The URL of the audio file.
Resolution of the generated video (480p, 580p, or 720p). Allowed values: 480p, 720p.
Random seed for reproducibility. If None, a random seed is chosen.
Idle

Example output — click Run to generate your own

API README

Wan 2.2 Speech to Video

Wan 2.2 Speech to Video is a Wan-family route for speech-driven video synthesis. Wan’s video-focused generative architecture models appearance and time together, so supplied references, structural conditions, masks, speech, or written scene direction can influence a coherent sequence rather than a collection of unrelated frames. This exact route concentrates that architecture on its named production task.

Use the route when the available source material and final brief specifically require speech-driven video synthesis. Identify every subject or condition, explain the intended action or transformation, and describe camera behavior, pacing, environment, lighting, atmosphere, and preservation constraints. This separates creative intent from the local duration, resolution, and delivery fields documented below.

Highlights

  • Speech-synchronized performance. Uses spoken audio to guide visible timing and performance.
  • Audio-aware motion. Coordinates facial or subject movement with the supplied soundtrack.
  • Reference-led identity. Uses the available subject input to preserve recognizable appearance.
  • Complete audiovisual shot. Combines voice timing, visual action, scene treatment, and prompt direction in one sequence.

Pricing

ConfigurationModePrice
480pPer generated second$0.10
720pPer generated second$0.20

When to Use

✅ Good fit❌ Consider alternatives
The project needs this exact named workflowThe intended task belongs to another media route
All required reference or control media is availableNecessary assets or rights are unavailable
The brief can state transformation and preservation goalsOutput must be deterministic at pixel or frame level
Supported duration, resolution, and format fit deliveryFinal placement requires unsupported specifications
An asynchronous generated result fits productionA live frame-synchronous response is mandatory

Prompt Guide

Identify the primary subject and every source or condition, state the intended transformation or action, then describe composition, camera or viewpoint, lighting, materials, pacing, atmosphere, and exact preservation requirements. Refer to multiple inputs in their schema order.

{
  "prompt": "A precisely directed composition with explicit subject, transformation, camera or viewpoint, lighting, material, and preservation requirements",
  "image": "https://example.com/reference.png",
  "seed": 1,
  "audio": "https://example.com/reference.mp3",
  "resolution": "480p"
}

Technical Specs

SpecValue
Model IDalibaba/wan/2.2/speech-to-video
Input fieldsseed (integer)<br>audio (string)<br>image (string)<br>prompt (string)<br>resolution (string; 480p, 720p)
Required inputprompt, image
Output fieldsurl, content_type
ExecutionAsynchronous job

Related Models

  • alibaba/wan/2.1/text-to-video
  • alibaba/wan/2.1/image-to-video
  • alibaba/wan/2.1/vace

Related Models