luma

$npx mdskill add vm0-ai/vm0-skills/luma

Generate AI videos and images from text or existing media.

  • Creates cinematic clips and visuals from text or image inputs.
  • Integrates with Luma AI Dream Machine API for generation.
  • Executes requests via JSON payloads and connector configuration.
  • Delivers results through video files and image assets.

SKILL.md

.github/skills/lumaView on GitHub ↗
---
name: luma
description: Luma AI Dream Machine API for AI video and image generation. Use when
  user mentions "Luma", "Dream Machine", "luma video", "luma image", or "lumalabs".
---

# Luma AI Dream Machine

Generate AI videos and images using Luma AI's Dream Machine API. Supports text-to-video, image-to-video, video extension, and image generation.

> Official docs: `https://docs.lumalabs.ai/docs/api`

---

## When to Use

Use this skill when you need to:

- Generate AI videos from text prompts (text-to-video)
- Generate AI videos from images (image-to-video)
- Extend existing videos forward or backward
- Generate AI images from text prompts
- Poll for and retrieve completed generation results
- List or delete past generations

---

## Prerequisites

Connect the **Luma** connector at [app.vm0.ai/connectors](https://app.vm0.ai/connectors).

> **Troubleshooting:** If requests fail, run `zero doctor check-connector --env-name LUMA_TOKEN` or `zero doctor check-connector --url https://api.lumalabs.ai/dream-machine/v1/generations --method GET`

---

## How to Use

### 1. Generate a Video from Text

Submit a text-to-video generation request. Write to `/tmp/luma_video_request.json`:

```json
{
  "prompt": "A serene mountain lake at sunrise, mist rising from the water, cinematic slow pan",
  "model": "ray-2",
  "aspect_ratio": "16:9",
  "resolution": "720p",
  "duration": "5s",
  "loop": false
}
```

```bash
curl -s -X POST "https://api.lumalabs.ai/dream-machine/v1/generations/video" --header "Authorization: Bearer $LUMA_TOKEN" --header "Content-Type: application/json" -d @/tmp/luma_video_request.json | jq '{id, state, created_at}'
```

Save the returned `id` for polling.

### 2. Generate a Video from an Image (Image-to-Video)

Use a keyframe to anchor the starting image. Write to `/tmp/luma_video_request.json`:

```json
{
  "prompt": "The scene slowly comes alive, gentle waves, birds taking flight",
  "model": "ray-2",
  "aspect_ratio": "16:9",
  "duration": "5s",
  "keyframes": {
    "frame0": {
      "type": "image",
      "url": "<your-image-url>"
    }
  }
}
```

```bash
curl -s -X POST "https://api.lumalabs.ai/dream-machine/v1/generations/video" --header "Authorization: Bearer $LUMA_TOKEN" --header "Content-Type: application/json" -d @/tmp/luma_video_request.json | jq '{id, state}'
```

### 3. Poll Generation Status

Poll until `state` is `completed` or `failed`. Replace `<generation-id>` with the ID from the create response:

```bash
curl -s -X GET "https://api.lumalabs.ai/dream-machine/v1/generations/<generation-id>" --header "Authorization: Bearer $LUMA_TOKEN" | jq '{id, state, failure_reason, assets}'
```

State values:
- `dreaming`: Generation is in progress
- `completed`: Generation is finished — `assets.video` contains the download URL
- `failed`: Generation failed — `failure_reason` contains the error

### 4. Download the Completed Video

Once state is `completed`, the `assets.video` field contains a direct download URL:

```bash
curl -s -X GET "https://api.lumalabs.ai/dream-machine/v1/generations/<generation-id>" --header "Authorization: Bearer $LUMA_TOKEN" | jq -r '.assets.video'
```

Then download:

```bash
curl -L "<video-url>" -o /tmp/luma_output.mp4
```

### 5. Generate an Image from Text

Write to `/tmp/luma_image_request.json`:

```json
{
  "prompt": "A photorealistic portrait of a red fox in a forest at golden hour",
  "model": "photon-1",
  "aspect_ratio": "1:1"
}
```

```bash
curl -s -X POST "https://api.lumalabs.ai/dream-machine/v1/generations/image" --header "Authorization: Bearer $LUMA_TOKEN" --header "Content-Type: application/json" -d @/tmp/luma_image_request.json | jq '{id, state, created_at}'
```

### 6. Poll Image Generation Status

```bash
curl -s -X GET "https://api.lumalabs.ai/dream-machine/v1/generations/<generation-id>" --header "Authorization: Bearer $LUMA_TOKEN" | jq '{id, state, failure_reason, assets}'
```

Once `state` is `completed`, `assets.image` contains the image URL.

### 7. Extend an Existing Video

Extend a completed video by referencing its ID in keyframes. Write to `/tmp/luma_extend_request.json`:

```json
{
  "prompt": "Continue the scene with the camera pulling back to reveal the full landscape",
  "model": "ray-2",
  "aspect_ratio": "16:9",
  "duration": "5s",
  "keyframes": {
    "frame0": {
      "type": "generation",
      "id": "<source-generation-id>"
    }
  }
}
```

```bash
curl -s -X POST "https://api.lumalabs.ai/dream-machine/v1/generations/video" --header "Authorization: Bearer $LUMA_TOKEN" --header "Content-Type: application/json" -d @/tmp/luma_extend_request.json | jq '{id, state}'
```

### 8. List Recent Generations

```bash
curl -s -X GET "https://api.lumalabs.ai/dream-machine/v1/generations?limit=10&offset=0" --header "Authorization: Bearer $LUMA_TOKEN" | jq '.generations[] | {id, state, created_at}'
```

### 9. Delete a Generation

```bash
curl -s -X DELETE "https://api.lumalabs.ai/dream-machine/v1/generations/<generation-id>" --header "Authorization: Bearer $LUMA_TOKEN"
```

### 10. List Available Camera Motions

```bash
curl -s -X GET "https://api.lumalabs.ai/dream-machine/v1/generations/camera_motion/list" --header "Authorization: Bearer $LUMA_TOKEN" | jq '.[]'
```

### 11. List Available Creative Concepts

```bash
curl -s -X GET "https://api.lumalabs.ai/dream-machine/v1/generations/concepts/list" --header "Authorization: Bearer $LUMA_TOKEN" | jq '.[]'
```

---

## Guidelines

1. **Poll until terminal state**: Generation is async — after submitting, poll `GET /generations/<id>` until `state` is `completed` or `failed`. Typical generation takes 30–120 seconds.
2. **Video models**: Use `ray-2` for highest quality, `ray-flash-2` for faster/cheaper generation.
3. **Image models**: Use `photon-1` for highest quality, `photon-flash-1` for faster generation.
4. **Aspect ratios**: Supported values are `1:1`, `3:4`, `4:3`, `9:16`, `16:9` (default), `9:21`, `21:9`.
5. **Duration**: Video duration is `5s` or `9s`.
6. **Resolution**: Supported values are `540p`, `720p`, `1080p`, `4k`.
7. **Extend via keyframes**: To extend a video, reference the source generation `id` in `keyframes.frame0` with `type: "generation"`. To anchor end frame use `frame1`.
8. **Use JSON files for request bodies**: Always write request bodies to `/tmp/luma_*.json` to avoid shell quoting issues.

More from vm0-ai/vm0-skills

SkillDescription
account-reconciliationPerform account reconciliations comparing general ledger balances against subledgers, bank statements, or external records. Use for bank reconciliation, GL-to-subledger reconciliation, intercompany reconciliation, balance sheet reconciliation, reconciling item analysis, outstanding item aging, or clearing open items.
agentphoneBuild AI phone agents with AgentPhone API. Use when the user wants to make phone calls, send/receive SMS, manage phone numbers, create voice agents, set up webhooks, or check usage — anything related to telephony, phone numbers, or voice AI.
ahrefsAhrefs SEO API for backlink and keyword analysis. Use when user mentions
amplitudeAmplitude product analytics API. Use when user mentions "Amplitude",
analysis-qaQuality-check a data analysis before sharing — verify joins, aggregations, denominators, time ranges, and metric definitions. Detect pitfalls like survivorship bias, average-of-averages, join explosion, timezone mismatches, incomplete periods, and selection bias. Includes documentation templates for reproducible analyses.
anthropic-managed-agentsAnthropic Managed Agents API for programmatically creating, running, and streaming AI agents on Anthropic's cloud infrastructure. Use when the user mentions "Managed Agents", "Anthropic agent sessions", or needs to create/run/stream an Anthropic agent with tool use (bash, git, web), attach GitHub repositories, or inject secrets via Vault. Do NOT use for standard Claude Messages API — use the Claude API skill instead.
apifyApify web scraping platform. Use when user mentions "scrape website",
asanaAsana API for tasks and projects. Use when user mentions "Asana", "asana.com",
atlassianAtlassian API for Confluence and Jira. Use when user mentions "Confluence
attioAttio REST API for AI-native CRM operations — manage companies, people, deals, and custom objects, plus notes, tasks, lists, and comments. Use when the user mentions "Attio", "CRM record", "create company", "add person", "list entry", "CRM note", or "CRM task".