Search code examples
3dvirtual-realityoculusavatar

I am trying to represent an avatar with data from an Oculus headset, and I cannot find out how to properly represent it

TL;DR: For a youtube channel, I am going to try and control an avatar in a similar way to the gif below. Essentially recording my movements in VR and then using them in a video.enter image description here

At my disposal I have an Oculus Rift S and free time to try things out in unity and other programs.

What I have tried so far:

  1. Recording within other games which have built in recording features This does not provide me with the customizeability I need
  2. Recording within unity I have not had success implementing recording at all into unity.

There are clearly a variety of ways to solve this, and I have spent a few hours just trying to get a solution, but I cannot find one which works.

Solution

  • Pretty big project but

    Create rigged/animated avatar in Unity ->

    Setup Animation state machine ->

    Setup logic to switch to different states based on input (different states for hand/mouth animations) ->

    Have logic to fire different animation state triggers, perhaps also play an audio clip from an audio source

    Optional:

    Take microphone input ->

    Have AI speech recognition or just sample microphone volume for general sound input ->