Appearance

LTX-2.3 22B

POST/v1/run

Ltx 2.3 22b Audio To Video Lora by Lightricks - advanced AI model for audio-to-video. Delivers high-quality results with fast inference, suitable for both creative and production workflows.

Request body

Submit an async generation request. The model field selects the model; other fields are model-specific input parameters.

stringmodelrequired

Model identifier. Set to lightricks/ltx-2.3-22b/audio-to-video/lora.

Default: lightricks/ltx-2.3-22b/audio-to-video/lora

stringpromptrequired

The prompt to generate the video from.

stringimagerequired

Optional URL of an image to use as the first frame of the video.

Optional<string>end_image

The URL of the image to use as the end of the video.

Optional<string>audio

The URL of the audio to generate the video from.

Optional<integer>num_inference_steps

The number of inference steps to use.

Range: 8 to 50

Default: 40

Optional<boolean>match_audio_length

When enabled, the number of frames will be calculated based on the audio duration and FPS. When disabled, use the specified num_frames.

Default: true

Optional<number>image_strength

The strength of the image to use for the video generation.

Range: 0 to 1

Default: 1

Optional<number>fps

The frames per second of the generated video.

Range: 1 to 60

Default: 24

Optional<string>video_quality

The quality of the generated video.

Allowed values: low, medium, high, maximum

Default: high

Optional<number>video_rescaling_scale

The rescaling scale for the video. Controls the ratio between classifier-free guidance and spatiotemporal guidance.

Range: 0 to 1

Default: 0.7

Optional<string>camera_lora

The camera LoRA to use. This allows you to control the camera movement of the generated video more accurately than just prompting the model to move the camera.

Allowed values: dolly_in, dolly_out, dolly_left, dolly_right, jib_up, jib_down, static, none

Default: none

Optional<string>scheduler

The scheduler to use.

Allowed values: ltx2, linear_quadratic, beta

Default: ltx2

Optional<number>audio_modality_scale

The modality scale for the audio. Controls the ratio between video and audio modalities.

Range: 0 to 10

Default: 3

Optional<number>distill_lora_first_pass_scale

The scale of the distill LoRA to use for the first pass. Set to 0 to disable.

Range: 0 to 1

Default: 0.2

Optional<string>video_write_mode

The write mode of the generated video.

Allowed values: fast, balanced, small

Default: balanced

Optional<number>gradient_estimation_gamma

The gamma of gradient estimation during denoising. Set to 0 to disable.

Range: 0 to 10

Default: 2

Optional<number>video_modality_scale

The modality scale for the video. Controls the ratio between video and audio modalities.

Range: 0 to 10

Default: 3

Optional<number>audio_strength

Audio conditioning strength. Values below 1.0 will allow the model to change the audio, while a value of exactly 1.0 will use the input audio without modification.

Range: 0 to 1

Default: 1

Optional<array<object>>loras

The LoRAs to use for the generation.

Optional<string>video_output_type

The output type of the generated video.

Allowed values: X264 (.mp4), VP9 (.webm), PRORES4444 (.mov), GIF (.gif)

Default: X264 (.mp4)

Optional<number>video_cfg_scale

The Classifier-Free Guidance (CFG) scale for the video. Higher values result in more consistent and focused video content.

Range: 1 to 20

Default: 3

Optional<number>audio_rescaling_scale

The rescaling scale for the audio. Controls the ratio between classifier-free guidance and spatiotemporal guidance.

Range: 0 to 1

Default: 0.7

Optional<boolean>use_multiscale

Whether to use multi-scale generation. If True, the model will generate the video at a smaller scale first, then use the smaller video to guide the generation of a video at or above your requested size. This results in better coherence and details.

Default: true

Optional<number>audio_cfg_scale

The Classifier-Free Guidance (CFG) scale for the audio. Higher values result in more consistent and focused audio content.

Range: 1 to 20

Default: 7

Optional<number>audio_stg_scale

The Spatiotemporal Guidance (STG) scale for the audio. Higher values result in more consistent and focused audio content.

Range: 0 to 20

Default: 0

Optional<boolean>use_restart_sampling

Whether to use restart sampling. This will inject a small amount of noise during each denoising step, which can help improve the quality of the generated video.

Default: false

Optional<integer>num_frames

The number of frames to generate.

Range: 9 to 481

Default: 121

Optional<boolean>preprocess_audio

Whether to preprocess the audio before using it as conditioning.

Default: true

Optional<number>distill_lora_second_pass_scale

The scale of the distill LoRA to use for the second and subsequent passes.

Range: 0 to 1

Default: 0.5

Optional<string>video_size

The size of the generated video. Use 'auto' to match the input image dimensions if provided.

Allowed values: auto, square_hd, square, portrait_4_3, portrait_16_9, landscape_4_3, landscape_16_9

Default: landscape_16_9

Optional<number>video_stg_scale

The Spatiotemporal Guidance (STG) scale for the video. Higher values result in more consistent and focused video content.

Range: 0 to 20

Default: 0

Optional<number>end_image_strength

The strength of the end image to use for the video generation.

Range: 0 to 1

Default: 1

Optional<number>camera_lora_scale

The scale of the camera LoRA to use. This allows you to control the camera movement of the generated video more accurately than just prompting the model to move the camera.

Range: 0 to 1

Default: 1

Optional<integer>seed

The seed for the random number generator.

Response Schema

The submit endpoint returns an accepted generation task. Poll the result endpoint with the returned id for terminal outputs or errors.

Optional<string>error

Error message if the task failed. Empty on success.

stringidrequired

Unique identifier for the generation task.

Optional<string>model

Model ID used for the prediction.

Optional<array>outputs

Array of generated content. Empty when status is not completed.

stringstatusrequired

Status of the task: pending, running, completed, failed, or timeout.

Allowed values: pending, running, completed, failed, timeout

Model capabilities

array<string>capability_tagsrequired

Capabilities declared by the model registry.

Default: audio-to-video

stringexecution_moderequired

Execution mode declared by the model registry.

Default: async