Cross-platform

Copy Motion From a Reference Video: Which AI Platform for What

By Marco Cavazzana · Updated · 5 min read
ShareEmail
Short answer

To copy a performance onto a character, Runway Act-Two and Kling Motion Control are the most direct: give a character image and a driving video and the character moves like the performer. Luma's Ray3 Modify maps an actor onto a new character while keeping timing and eye line. To combine motion with other references, Hailuo H3 Omni Reference, Seedance 2.5 and Wan 3.0 accept video references alongside images and audio. Use clean, continuous reference clips with one subject.

Describing motion in words is hard. "She dances" can mean anything; a ten second clip of the actual dance means one thing. Motion transfer lets you act out a movement, or borrow it from footage you have rights to, and apply it to a generated character. In 2026 this split into two families: dedicated performance tools that drive one character from one video, and reference models that take motion as one input among many. This guide covers both, as of November 2026.

Motion transfer at a glance

ToolInputsTransfersReach for it when
Runway Act-TwoDriving performance video plus a character image or videoFace, body and, with a character image, hand gesturesActing and dialogue
Kling Motion Control (VIDEO 3.0)Character image plus a 3 to 30 second motion video, or a clip from its motion libraryBody movement and expressions; optionally camera movementDance, full-body action
Luma Ray3 ModifyYour footage plus a character imageMotion, timing, eye line and deliveryAn actor's take, new character
Hailuo H3 Omni ReferenceUp to 9 images, 3 video and 3 audio clips (12 files)Character, motion, camera and voice from referencesMotion plus voice in one generation
Seedance 2.5Up to 50 references, including video and white-model blockingMotion from reference clipsComplex scenes with many references
Wan 3.0Reference-based inputs through the APIVisual replication and character drivingBuilding it into your own pipeline

Performance tools

Runway Act-Two

Act-Two takes a driving performance video, someone acting the scene, and a character image or video, and moves the character to match. With a character image, you can let the performer's hands and body drive the character's gestures; turn gestures off and Act-Two focuses on facial and environmental motion. Runway's tips: keep the performer's hands in frame at the start, begin in a pose close to the character's, and favour natural movement over abrupt changes. It needs a Standard plan or higher.

Kling Motion Control

Kling Motion Control drives one character in an image with movement from a video you upload, or from its motion library. The latest version is built on Kling VIDEO 3.0, with better facial consistency than 2.6. Motion videos must be 3 to 30 seconds and the output matches their length. Two orientation settings matter: matches video copies movement, expressions, camera movement and facing from the reference, while matches image keeps the character's facing from your image and lets you prompt the camera. You can also bind a face reference (an element) to keep the face consistent. Kling advises one continuous shot with one character, full body and head visible, and no cuts.

Luma Ray3 Modify

Luma's Ray3 Modify (December 2025) is a video-to-video model for actors: it keeps the original motion, timing, eye line and emotional delivery of your footage and maps the performer onto a character from an image you provide. Start and end frames let you direct transitions. It runs inside Luma's Dream Machine app.

Reference models

Hailuo H3

MiniMax's H3 Omni Reference mode accepts up to 9 images, up to 3 video clips and up to 3 audio clips, 12 files in total, with video and audio clips of 2 to 15 seconds each and 15 seconds combined. That lets you give a character image, a motion clip and a voice sample in one generation, with native stereo sound. MiniMax open-sourced H3 in August 2026, so it also runs outside its own apps.

Seedance 2.5

Seedance 2.5 takes up to 50 references, including motion clips, and supports white-model references: rough 3D blocking of where things move, which the model dresses into a finished scene. Useful when you want to block motion yourself rather than film it. See our Dreamina guide for the app it lives in.

Wan 3.0

Alibaba describes Wan 3.0 (August 2026) as an all-in-one reference model covering generation, editing, visual replication and character driving, with clips up to 30 seconds. It is API-first, through Alibaba Cloud and partner platforms.

Getting good results

  • Match the framing. A full-body dance onto a head-and-shoulders portrait fails. Use a character image framed like the reference.
  • One subject, one continuous shot. Cuts and extra people confuse every tool.
  • Plain background, steady camera in the reference, unless you want the camera copied too.
  • Moderate speed. Very fast moves come out blurred or shortened; Kling notes complex motion can produce a shorter output.
  • Use footage you have the right to use, such as your own performance or licensed material.

To keep the character itself consistent across several of these shots, see consistent characters: which platform for what.

Try it

Film yourself for ten seconds on a phone against a plain wall: walk two steps forward, wave, and say one line. Use it as the driving video with one character still in two tools, adding this prompt where the tool takes one.

A friendly cartoon fox shopkeeper behind a wooden counter in a cosy village shop, warm afternoon light, shelves of jars behind him. He steps forward, waves and says "Morning! What can I get you?" Keep the camera static at counter height.

Compare the timing of the wave, whether the line lands on the lips, and whether the fox stays the same fox throughout.

Motion work produces a pile of takes, each tied to a different reference clip. Dreamdrive, a free Chrome extension, saves every result as you make it with its prompt, model and settings in one library, so you can find the take that worked and see how it was made.

Frequently asked questions

How do I copy motion from a video onto an AI character?
Use a performance tool such as Runway Act-Two or Kling Motion Control: upload a character image and a driving video, and the character moves like the performer. Hailuo H3, Seedance 2.5 and Wan 3.0 also accept video references alongside images and audio.
What is Kling Motion Control?
A Kling feature that drives a character in an image with movement from a 3 to 30 second video you upload, or from its motion library. The output matches the length of the motion video, and you can choose whether the character follows the video's orientation and camera or the image's.
What does Runway Act-Two do?
Act-Two animates a character image or video from a driving performance video, transferring facial expressions and body movement, and hand gestures when you use a character image. It needs a Standard plan or higher.
What makes a good reference video for motion transfer?
One subject, one continuous shot with no cuts, a plain background, a steady camera and moderate speed. Frame the character image the same way as the reference, for example full body for full body.

Nothing you makeis lost.

Free · No card · Read-only · 2-minute setup

DreamdriveFree plan · Chrome
Add to Chrome — it’s free