Omniverse A2F LiveLink

Mar 20, 2023
Code
©2023 SenseTime

Omniverse A2F LiveLink is an Omniverse plugin that can help you quickly build up a real-time Audio2Face pipeline in Unreal Engine, embedding Omniverse Audio2Face.

This plugin provides a “Send Blendshape Value” node in Omniverse Audio2Face and sends generated facial animation data to Unreal Engine via LiveLink protocol, which is widely used for facial capture data transfer to Unreal Engine.

With the help of Omniverse A2F LiveLink, it would be easy to drive your characters to speak, powered by the latest Omniverse Audio2Face Technology.

My contributions to this project are:

  • Plugin development and testing.
  • USD asset preparation (for Omniverse).
Omniveser AIGC Unreal Engine
Sihang Chen 陈思航
Sihang Chen 陈思航
Technical Artist

I am now pursuing my Master’s program at Victoria University of Wellington. I worked as a Technical Artist for three years at SenseTime. And I am proficient in Digital Avatars and AIGC implanting Techniques.