How to Set Lip-sync

Updated: 07/11/2023

It is now possible to set mouth movements to be reflected in response to voice rather than camera.
Lip-sync is a feature that allows Live2D models to move in response to audio input from a microphone.
It is mainly used for mouth movements in Live2D models.
Even when the camera cannot pick up mouth movements well, the lip-sync function can be used to achieve more precise movements.

How to Use (Easy)

Turn on “Lip Sync Support”.

The parameters tied to “13. Mouthquake” and “14. Mouth width” in “Movement Settings” can be moved by voice.

2. Under “Input device,” select the microphone to be used.

3. While speaking, check the volume meter for the input threshold, and if it is low, adjust it with “Input boost.”

4. From the “Sensitivity adjustment” auto-setup button, make settings according to the display.

*If you want to cut off noise such as environmental noise, adjust the “Input Threshold”. Any audio volume below the threshold will be ignored.
*Turn on “Composite camera tracking to lip-sync parameters” if you want the parameters tied to lip-sync to move the mouth with facial expressions when no audio is present, such as yawns or reactions without voice.

How to Use (Application)

If you want to make advanced settings, such as moving mouths of A, I, U, E, O created with Blend Shape to match vowels or controlling parameters by volume, you can manually adjust parameter links.
Here is an example of animating mouths of A, I, U, E, and O created with Blend Shape.

1. In the “Setting Motions” tab, unassociate the parameter you want to move for lip-sync from the tracking item currently associated with it by clicking the × button.

Example: Use the × button to unassociate the “A,” “I,” “U,” “E,” and “O” parameters associated with “13. Mouth open/close motion” and “14. Mouth spread.”

2. In the same “Setting Motions” tab, select the lip-sync item you wish to use, and then select the parameter you wish to link from the + button.

Example: Select the parameter “A” from the + button of “18. Lip-sync (A)” and press the Add button. This links the “A” movement of the Live2D model with the “18. Lip-sync (A)” movement. Set “19. Lip-sync (I)” and thereafter in the same manner.

Configure the settings in the same way as in the procedure from step 2 of [How to Use (Easy)].