alibaba/happy-horse/reference-to-video
Alibaba's #1-ranked Happy Horse 1.0 generates stunning 1080p videos with synchronized native audio and multilingual lip-sync, transforming text prompts or images into cinematic, true-to-life motion content for next-gener...
PNG, JPEG, WebP, or GIF · 20 MiB maximum each
Example output — click Run to generate your own
Send your first request
OpenAI-compatible endpoint with unified authentication and usage tracking.
https://api.sandbase.ai/v1/runalibaba/happy-horse/reference-to-videoInput Schema
6 parameters · 2 required · 4 optional
| Parameter | Type | Required | Description |
|---|---|---|---|
images | string[] | Required | The URLs of the images to use for image-to-image generation or image editing. |
prompt | string | Required | The text prompt to generate a video from, guided by the reference image. · Min length: 3 · Max length: 50000 · Default: "In the early morning, just as the sun begins to rise, a small pumpkin sits in the pumpkin patch with dewdrops glistening on its surface. Suddenly, with a crisp crack, a fissure appears on the little pumpkin, and golden light shines through the crack. The pumpkin splits open along with the golden glow, releasing a puff of white mist, and a little rabbit appears in the center of the cracked pumpkin." |
seed | integer | Optional | Random seed for reproducible results. Set to -1 for random seed. |
duration | integer | Optional | The duration of the generated video in seconds. · Options: 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15 · Default: 5 3456789101112131415 |
resolution | string | Optional | The resolution of the video to generate. · Options: 720p, 1080p · Default: "720p" 720p1080p |
aspect_ratio | string | Optional | The aspect ratio of the generated video. · Options: 16:9, 9:16, 1:1, 4:3, 3:4 · Default: "16:9" 16:99:161:14:33:4 |
Output Schema
| Field | Type | Description |
|---|---|---|
id | string | Unique identifier for the generation task |
status | string | Task status: pending, running, completed, failed, timeout |
model | string | Model used for the generation |
outputs | array | Array of output items |
outputs[].url | string | URL of the generated artifact |
outputs[].content_type | string | MIME type (e.g. image/png, video/mp4) |
error | object | null | Error details if failed, null on success |
error.type | string | Machine-readable error type code |
error.message | string | Human-readable error description |
Async Workflow
This model uses asynchronous execution. Submit a request and poll for the result.
- Submit — POST to /v1/run, receive an
id - Poll — GET /v1/run/{id} until status is
completed,failed, ortimeout - Retrieve — Read
outputsfrom the completed response
Code Examples
Ready-to-run snippets
# Step 1: Submit
curl -X POST https://api.sandbase.ai/v1/run \
-H "Content-Type: application/json" \
-H "Authorization: Bearer YOUR_API_KEY" \
-d '{
"model": "alibaba/happy-horse/reference-to-video",
"images": [
"https://help-static-aliyun-doc.aliyuncs.com/assets/img/zh-CN/9000146771/p1067182.webp",
"https://help-static-aliyun-doc.aliyuncs.com/assets/img/zh-CN/9000146771/p1067183.webp"
],
"prompt": "In the early morning, just as the sun begins to rise, a small pumpkin sits in the pumpkin patch with dewdrops glistening on its surface. Suddenly, with a crisp crack, a fissure appears on the little pumpkin, and golden light shines through the crack. The pumpkin splits open along with the golden glow, releasing a puff of white mist, and a little rabbit appears in the center of the cracked pumpkin.",
"duration": 5,
"resolution": "720p",
"aspect_ratio": "16:9"
}'
# Step 2: Poll result (replace <id>)
curl https://api.sandbase.ai/v1/run/<id> \
-H "Authorization: Bearer YOUR_API_KEY"API README
Happy Horse Reference to Video
Happy Horse Reference to Video uses supplied images and a written prompt to create a new motion sequence around established visual references. Alibaba describes the Happy Horse family with cinematic, true-to-life motion, synchronized native audio, and multilingual lip-sync.
Clips can run from three to fifteen seconds across five aspect ratios, with either 720p or 1080p delivery. A seed supplies a repeatable starting point for comparing prompt, timing, and framing variations.
Highlights
Reference-led continuity. Multiple source images can establish the people, objects, or visual language that the generated video should follow.
Prompted action and staging. A required written direction describes what should happen around those visual references.
Native audiovisual output. The family description includes synchronized sound and multilingual lip-sync together with 1080p video capability.
Flexible placement choices. Thirteen durations, five frame shapes, and two resolution tiers cover a broad range of short-form deliveries.
Pricing
| Duration | 720p | 1080p |
|---|---|---|
| 3 seconds | $0.420 | $0.840 |
| 4 seconds | $0.560 | $1.120 |
| 5 seconds | $0.700 | $1.400 |
| 6 seconds | $0.840 | $1.680 |
| 7 seconds | $0.980 | $1.960 |
| 8 seconds | $1.120 | $2.240 |
| 9 seconds | $1.260 | $2.520 |
| 10 seconds | $1.400 | $2.800 |
| 11 seconds | $1.540 | $3.080 |
| 12 seconds | $1.680 | $3.360 |
| 13 seconds | $1.820 | $3.640 |
| 14 seconds | $1.960 | $3.920 |
| 15 seconds | $2.100 | $4.200 |
When to Use
| ✅ Good fit | ❌ Consider alternatives |
|---|---|
| The model's named workflow matches the source material and intended output | A different input modality or model route is required |
| A managed asynchronous result is suitable for the production pipeline | A synchronous, interactive editor is essential |
| The documented controls cover the required duration, framing, or format | The project needs controls outside this endpoint's schema |
| Creative iteration benefits from a repeatable request structure | Exact deterministic pixels, frames, geometry, or samples are mandatory |
| A finished downloadable media asset is the desired deliverable | Editable source layers or a native project file are required |
Prompt Guide
For generation, state the intended result first, then add the subject or source treatment, progression, style, and delivery constraints. Keep one creative variable per phrase, use the documented field names for controls, and change one setting at a time when comparing results.
{
"aspect_ratio": "16:9",
"duration": 5,
"images": [
"https://help-static-aliyun-doc.aliyuncs.com/assets/img/zh-CN/9000146771/p1067182.webp"
],
"prompt": "In the early morning, just as the sun begins to rise, a small pumpkin sits in the pumpkin patch with dewdrops glistening on its surface. Suddenly, with a crisp crack, a fissure appears on the little pumpkin, and golden light shines through the crack. The pumpkin splits open along with the golden glow, releasing a puff of white mist, and a little rabbit appears in the center of the cracked pumpkin.",
"resolution": "720p"
}
Technical Specs
| Spec | Value |
|---|---|
| Model ID | alibaba/happy-horse/reference-to-video |
| Inputs | aspect_ratio, duration, images, prompt, resolution, seed |
| Required inputs | images, prompt |
| Output fields | content_type, url |
| Execution | Async (submit, then poll for result) |
| Duration | 3 / 4 / 5 / 6 / 7 / 8 / 9 / 10 / 11 / 12 / 13 / 14 / 15 |
| Resolution | 720p / 1080p |
| Aspect Ratio | 16:9 / 9:16 / 1:1 / 4:3 / 3:4 |
Related Models
alibaba/happy-horse/1.1/image-to-video— Compare a nearby route in the same local model family.alibaba/happy-horse/1.1/reference-to-video— Compare a nearby route in the same local model family.alibaba/happy-horse/1.1/text-to-video— Compare a nearby route in the same local model family.