Sadtalker/Sadtalker Open source

Portrait animation guide

How to Use Sadtalker for a Talking Portrait

This guide explains how to use sadtalker: prepare a face image and speech audio, generate a talking-portrait video, then inspect the result. Sadtalker is an open-source project; the steps below describe its general workflow, not the controls of every site that offers it.

Check the available tools and terms
Sadtalker site illustration of a portrait animation workflow

prerequisites

Gather the two inputs before opening a Sadtalker implementation: a still face image and the speech you want that face to deliver. Keep a copy of each original so you can compare revisions.

  • A portrait cannot supply the speech

    Sadtalker uses an audio input to drive a talking face. A photo by itself does not tell the model what to say, how long to speak, or where the pauses belong.

    WorkaroundRecord or prepare the spoken audio first. Listen through it for clipped words, long silences, and background noise before pairing it with an image.

  • It cannot reveal a hidden face

    A face turned far away from the camera, covered by hair, or cropped through the mouth gives the model too little visible facial information. Motion may look unstable even when the audio is clear.

    WorkaroundChoose a well-lit, mostly forward-facing portrait with visible eyes, nose, jaw, and mouth. Leave some room around the head.

  • It does not verify permission

    A convincing talking portrait does not prove that the pictured person agreed to be animated or that the voice is authorized for use. That matters especially when sharing a result publicly.

    WorkaroundUse an image and recording you own or have permission to use, and disclose that the finished clip is synthetic when viewers might mistake it for a real recording.

  • This page cannot guarantee a particular interface

    The open-source Sadtalker project and third-party services may present different upload fields, settings, file requirements, or access conditions. This guide is not a promise that a linked service runs the same workflow.

    WorkaroundRead the instructions and supported-input details on the implementation you choose before uploading personal media.

numbered steps

Start with the simplest possible test: one clear face, one short piece of speech, and default settings. Change one variable at a time after reviewing the first result.

  1. 1

    Prepare and check the inputs

    Select a portrait with one unobstructed face and a reasonably neutral camera angle. Play the speech file from beginning to end, checking that the first and last words are present and that music or other voices do not compete with the speaker. Keep filenames distinct so you can identify the pair you used.

  2. 2

    Provide the portrait and speech

    In the Sadtalker implementation you are using, supply the image as the source portrait and the recording as the driving audio. Check any displayed preview to confirm that the correct face and voice are paired. Leave optional motion controls at their defaults for this first pass; their names and availability vary between implementations.

  3. 3

    Generate a short test and review it

    Run the animation and watch the entire output rather than judging it from a single frame. Look for mouth movement that follows syllables, stable facial features, and a complete ending. Compare the clip with the source audio; note the exact moment of any mismatch before changing an input.

  4. 4

    Revise only what failed

    If the face distorts, try a clearer or less angled portrait. If speech appears late, check the audio for leading silence. If motion looks exaggerated, reduce optional motion settings where available. Keep the original test so you can tell whether the revision actually improved the result.

Troubleshooting begins with the input that matches the symptom: inspect the portrait for facial distortion, the recording for timing problems, and the chosen implementation for rejected files. These related guides cover each question in more detail.

advanced tips

Once a basic clip works, compare the source portrait with a representative talking-portrait image. The images below illustrate the input-to-output idea; they are not proof that these exact assets form a generated pair.

  • Still portrait input
  • Illustrative video result

For a meaningful before-and-after check in your own Sadtalker project, hold the portrait and audio constant while testing one setting. View the finished clip at normal speed, then replay any awkward syllable or head movement. A polished still frame alone cannot demonstrate convincing speech timing.

Example still portrait illustrating the kind of image used as a talking-face input
Illustrative presenter image showing the intended appearance of a talking-portrait result

Practice scenarios

The same preparation and review loop applies to different projects, but the right success check depends on what the audience needs to understand.

Explainer creator

You have a short narration and a portrait for an introduction. Start with a test sentence that includes clear consonants, then check whether viewers can follow the speech without distracting facial motion.

Keep the clip only if the full spoken line is intact and the animated face remains recognizable.

what is sadtalker used for

Character animator

You are testing whether a drawn face can deliver dialogue. Use artwork with legible facial features and compare several short lines before committing to a longer scene.

Decide whether the movement suits the character's design rather than assuming every illustration will animate equally well.

sadtalker for animation

First-time experimenter

You want to learn the sequence without mixing up input problems and interface problems. Prepare a single portrait-audio pair, read the implementation's instructions, and save your first output for comparison.

You can identify which input or setting to revisit instead of repeatedly generating an unchanged test.

sadtalker ai

Workflow evaluator

You need to decide whether this approach fits a larger production. Test a representative line with permitted media, then assess timing, facial stability, and the effort needed for corrections.

Make a decision based on your actual sample rather than a showcase image or a single favorable frame.

sadtalker alternative

Put the workflow to work

Start with a small, reviewable test

Bring a clear portrait and a clean spoken recording, then look for a tool that accepts the inputs your project needs. Check its current capabilities and terms before uploading. Whatever implementation you choose, preserve the source files and review the full generated clip before sharing it.

Explore portrait tools
  • Check the portrait and recording first
  • Review the entire clip, not one frame
  • Use media you have permission to animate

tutorial FAQ

Prepare a still image with a clearly visible face and a recording of the speech you want it to deliver. A short, clean recording and a mostly forward-facing portrait make the first test easier to inspect. Check the requirements of your chosen implementation for accepted files.

Provide the portrait as the source image and speech as the driving audio in an implementation of Sadtalker, then generate a short test. Watch the complete result and compare its mouth movement with the recording. If it looks wrong, revise the portrait or audio separately so you can see what changed.

First listen for silence at the beginning, clipped speech, background voices, or other recording problems. Then inspect whether the mouth is clearly visible in the source portrait. If both inputs are sound, review any timing or motion options exposed by the particular implementation.

You can test an illustration as the source image, but the result depends on how clearly its facial features can be interpreted. Start with a character whose eyes, nose, and mouth are distinct, and test a short line before building a scene around the output. Do not assume a style that looks good as a still image will stay consistent in motion.

The preparation, generation, and review steps apply whether you use the open-source project or another interface that implements it. Installation and interface instructions are specific to the option you choose. Verify its documentation and data-handling terms before providing an image or voice recording.

Explore tools
Explore tools