How to Use Vidu: Reference-Driven Generation

Vidu’s distinguishing emphasis is reference-based generation — keeping a subject recognisable across shots by conditioning on images you supply. That makes it worth evaluating for consistency-driven work.

What Vidu is

Vidu is a video generation model with a particular emphasis on reference-based generation: you supply images of a subject, and the model uses them to keep that subject recognisable across generated shots.

  • Text to video and image to video.
  • Reference-to-video, using supplied images to condition the subject.
  • An emphasis on multi-shot consistency, which is the hardest problem in AI video.

What it does well

UseFitNote
Multi-shot character workWorth evaluatingTest properly before relying on it
Keeping a product recognisableWorth evaluatingAccuracy still requires a gate
Short narrative sequencesModerate to strongDepends heavily on reference quality
Single atmospheric shotsFine, but not distinctiveOther tools are comparable

Test the claim, do not assume it: reference conditioning is the capability most likely to matter to you and the one most likely to be overstated. Run a five-shot consistency test before committing.

Preparing reference images

  1. Front-facing, neutral pose or orientation, even lighting.
  2. Plain background — background detail leaks into generated scenes.
  3. Sharp and high resolution; reference quality caps output quality.
  4. One canonical image per subject, used everywhere.
  5. Consistent colour and no heavy stylisation, which would propagate into output.

A consistency-driven workflow

  1. Lock one canonical reference per subject

    This is the single highest-leverage step.

  2. Write the subject description once and paste it identically

    Paraphrasing between shots reintroduces drift.

  3. Generate beat by beat

    Four to six seconds per beat.

  4. Chain approved frames

    Use the best frame from each beat as input for the next.

  5. Reject and regenerate locally

    When a beat fails, redo that beat rather than the whole sequence.

Prompt approach

  • With reference supplied, describe motion and camera, not the whole subject.
  • Keep one action and one camera move per shot.
  • State duration explicitly.
  • Keep lighting consistent across shots in the same scene.

Practical limits

  • Consistency improves but does not become perfect — expect some drift.
  • Complex scenes with multiple subjects remain difficult.
  • Fast motion and extreme angles still degrade the subject.
  • Text and fine detail remain unreliable, as with all current models.

Frequently asked questions

What makes Vidu different?

Its emphasis on reference-based generation — conditioning on images you supply to keep a subject recognisable across shots.

Does it really keep characters consistent?

It reduces drift rather than eliminating it. Run a five-shot test on your own subject before relying on it; results vary substantially.

How should I prepare references?

Front-facing, neutral, even lighting, plain background, sharp, and exactly one canonical image per subject used everywhere.

Should I describe the whole subject in the prompt?

No. With a reference supplied, describe motion and camera. Restating the subject invites variation.

What still fails?

Multi-subject scenes, fast motion, extreme angles, and text or fine detail — the same failure modes as other current models.

Is it good for single shots?

Comparable to other tools. Its distinguishing value is in sequences, so evaluate it there.

How do I improve consistency further?

Chain approved frames between beats, keep lighting consistent within scenes, and paste identical subject wording every time.

Stop searching. Start creating.

Generate your first AI video free — text to video or image to video, no credit card.