Skip to main content
m
5mo ago

Lip sync

Hi,

I would like to ask if Rive supports automatic lip-syncing with text input. Specifically, I'm interested in integrating an animation into a web app where the animation automatically syncs with provided text input to achieve lip synchronization. If this is possible, could you please point me to any tutorials or examples that demonstrate how to implement this?

Thanks in advance for your help!

2 replies
m
5mo ago

Hi , no, Rive does not support auto lip-sync with text inputs, not right now. Maybe in the future it is possible. To do something like this you would have to use code. For example, to do auto lip-sync, you would have to create a state machine with the visemes you need. These visemes will be triggered with a certain number. Then you would have to use code to convert the audio into these values, in order to trigger each viseme. An example of this can be found in this Duolingo document. https://blog.duolingo.com/world-character-visemes/

5mo ago
[deleted]
m
5mo ago

Thank you!