How to Set Lip-sync

Updated: 07/11/2023

It is now possible to set mouth movements to be reflected in response to voice rather than camera.
Lip-sync is a feature that allows Live2D models to move in response to audio input from a microphone.
It is mainly used for mouth movements in Live2D models.
Even when the camera cannot pick up mouth movements well, the lip-sync function can be used to achieve more precise movements.

How to Use (Easy)

1. Turn on “Support “Mouth open/close motion” and “Mouth spread” with lip-sync.”

When the lip-sync function is enabled for the first time, it is automatically turned on.
This will allow the parameters that are linked with “13. Mouth open/close motion” and “14. Mouth spread” in “Setting Motions” to be moved by “16. Lip-sync (Vertical)” and “17. Lip-sync (Horizontal)” without any settings on the user side.

2. Under “Input device,” select the microphone to be used.

3. While speaking, check the volume meter for the input threshold, and if it is low, adjust it with “Input boost.”

4. From the “Sensitivity adjustment” auto-setup button, make settings according to the display.

Note: If you want to cut noise such as environmental noise, adjust “Input threshold.” Audio volume less than or equal to the threshold will be ignored.
Note: Turn on “Use camera when input is less than or equal to the threshold” if you want to move the mouth with expressions when no audio is present, such as yawning and reaction without voice.

How to Use (Application)

If you want to make advanced settings, such as moving mouths of A, I, U, E, O created with Blend Shape to match vowels or controlling parameters by volume, you can manually adjust parameter links.
Here is an example of animating mouths of A, I, U, E, and O created with Blend Shape.

1. In the “Setting Motions” tab, unassociate the parameter you want to move for lip-sync from the tracking item currently associated with it by clicking the × button.

Example: Use the × button to unassociate the “A,” “I,” “U,” “E,” and “O” parameters associated with “13. Mouth open/close motion” and “14. Mouth spread.”

2. In the same “Setting Motions” tab, select the lip-sync item you wish to use, and then select the parameter you wish to link from the + button.

Example: Select the parameter “A” from the + button of “18. Lip-sync (A)” and press the Add button. This links the “A” movement of the Live2D model with the “18. Lip-sync (A)” movement. Set “19. Lip-sync (I)” and thereafter in the same manner.

Configure the settings in the same way as in the procedure from step 2 of [How to Use (Easy)].