lightricks/ltx-2.3-pro/audio-to-video

Name: LTX 2.3 Pro Audio to Video
Author: Lightricks

Ltx 2.3 Pro Audio To Video by Lightricks - advanced AI model for audio-to-video. Delivers high-quality results with fast inference, suitable for both creative and production workflows.

Input

Prompt(string)

Text description of how the video should be generated. Required if image_url is not provided. When image_url is provided, this describes how the image should be animated.

Image URL or upload(string)

Upload

PNG, JPEG, WebP, or GIF · 20 MiB maximum

URL of an image to use as the first frame of the video. If not provided, prompt is required.

This field is required.

Audio URL(string)

URL of the audio file to generate a video from. Duration must be between 2 and 20 seconds. Must be publicly accessible or base64 data URI.

Aspect Ratio(string)

The aspect ratio of the generated image. Allowed values: 21:9, 16:9, 3:2, 4:3, 5:4, 1:1, 4:5, 3:4, 2:3, 9:16.

Idle

Example output — click Run to generate your own

Production endpoint

Send your first request

OpenAI-compatible endpoint with unified authentication and usage tracking.

POSThttps://api.sandbase.ai/v1/run

Model IDlightricks/ltx-2.3-pro/audio-to-video

Input Schema

4 parameters · 2 required · 2 optional

Parameter	Type	Required	Description
`image`	string	Required	URL of an image to use as the first frame of the video. If not provided, prompt is required.
`prompt`	string	Required	Text description of how the video should be generated. Required if image_url is not provided. When image_url is provided, this describes how the image should be animated. · Min length: 1 · Max length: 5000
`audio`	string	Optional	URL of the audio file to generate a video from. Duration must be between 2 and 20 seconds. Must be publicly accessible or base64 data URI.
`aspect_ratio`	string	Optional	The aspect ratio of the generated image. · Options: 21:9, 16:9, 3:2, 4:3, 5:4, 1:1, 4:5, 3:4, 2:3, 9:16 21:916:93:24:35:41:14:53:42:39:16

Output Schema

Field	Type	Description
`id`	string	Unique identifier for the generation task
`status`	string	Task status: pending, running, completed, failed, timeout
`model`	string	Model used for the generation
`outputs`	array	Array of output items
`outputs[].url`	string	URL of the generated artifact
`outputs[].content_type`	string	MIME type (e.g. image/png, video/mp4)
`error`	object \| null	Error details if failed, null on success
`error.type`	string	Machine-readable error type code
`error.message`	string	Human-readable error description

Async Workflow

This model uses asynchronous execution. Submit a request and poll for the result.

Submit — POST to /v1/run, receive an id
Poll — GET /v1/run/{id} until status is completed, failed, or timeout
Retrieve — Read outputs from the completed response

Code Examples

Ready-to-run snippets

# Step 1: Submit
curl -X POST https://api.sandbase.ai/v1/run \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -d '{
  "model": "lightricks/ltx-2.3-pro/audio-to-video",
  "audio": "https://static.sandbase.ai/examples/lightricks/ltx-2.3-pro/audio-to-video/output_url_1.mp3",
  "image": "https://static.sandbase.ai/examples/lightricks/ltx-2.3-pro/audio-to-video/input_image_0.png",
  "prompt": "A woman whispering to the microphone"
}'

# Step 2: Poll result (replace <id>)
curl https://api.sandbase.ai/v1/run/<id> \
  -H "Authorization: Bearer YOUR_API_KEY"

← Back to LTX 2.3 Pro Audio to Video

API README

LTX 2.3 Pro Audio to Video

LTX 2.3 Pro Audio to Video is a audio-guided video creation endpoint in the LTX 2.3 family. It is built for creators who need to turn a concrete creative brief into a controlled visual sequence: the request establishes the source material, the intended subject behavior, the camera language, and the atmosphere of the finished shot. The production route keeps that workflow explicit instead of hiding its input assumptions behind a generic video-generation label.

In practice, this route accepts image, audio as creative context and exposes aspect ratio for delivery planning. That makes it suitable for shot-based pipelines where teams must preserve a source, direct a transformation, or control the final format without losing sight of the model's central task. Write prompts as a compact shot plan—subject, action, setting, camera, light, and timing—then use the structured fields for constraints that should remain deterministic across iterations.

Highlights

Audio-led timing. Uses the supplied soundtrack as a temporal signal while the prompt and opening image establish the visible scene.
Synchronized audio path. Audio conditioning or generation is available in the same request, helping sound and picture share one creative plan.
Format-aware framing. Selectable canvases cover cinematic, landscape, square, and portrait delivery formats.
Temporal coherence. The LTX 2.3 generation path is designed around continuous motion across a shot, not a collection of unrelated frames.

Pricing

The request price is calculated with params.duration * 0.10.

Configuration	Price
Formula-priced request	`params.duration * 0.10`

The model card records a base price of $0.100000; the formula above determines usage-priced requests.

When to Use

Scenario	Recommendation
Choose this route	Use it when the deliverable specifically calls for audio-guided video creation, rather than a neighboring generation mode.
Prepare the source	Provide image, audio in the format described by the request schema.
Direct the shot	Describe the subject, action, environment, camera movement, lighting, and temporal progression in that order.
Control continuity	Use endpoint frames, reference media, strength, or audio controls when those fields are available instead of burying hard constraints in prose.
Plan delivery	Set duration, frame count, resolution, and aspect ratio explicitly when the schema exposes them, then compare iterations with a stable seed where supported.

Prompt Guide

For audio-guided video creation, describe one coherent shot rather than a list of visual keywords. Put the main subject and action first, follow with location and staging, then add camera movement, lens or framing, lighting, mood, and any timed change. Keep URLs and hard delivery choices in their dedicated fields.

{
  "prompt": "A woman whispering to the microphone",
  "image": "https://static.sandbase.ai/examples/lightricks/ltx-2.3-pro/audio-to-video/input_image_0.png",
  "aspect_ratio": "21:9",
  "audio": "https://static.sandbase.ai/examples/lightricks/ltx-2.3-pro/audio-to-video/output_url_1.mp3"
}

Technical Specs

Specification	Value
Model ID	`lightricks/ltx-2.3-pro/audio-to-video`
Required inputs	`prompt`, `image`
Execution	Asynchronous generation job
Request controls	4 documented fields
Output	`url`, `content_type`

Request fields

Field	Type and constraints
`audio`	string; Optional
`image`	string; Required
`prompt`	string; Required
`aspect_ratio`	string; Optional; Options: 21:9, 16:9, 3:2, 4:3, 5:4, 1:1, 4:5, 3:4, 2:3, 9:16