This article will familiarize the user with the basics of using Faceware Studio to animate digital human characters created with Epic's MetaHuman Creator using the Live Client for Unreal plugin developed by Glassbox (https://glassboxtech.com/products/live-client)
For more information about Epic's MetaHumans, visit https://www.unrealengine.com/en-US/digital-humans
Faceware Studio:
Download: https://facewaretech.odoo.com/downloads
Faceware/Glassbox MetaHuman blueprint/motion logic sample: https://drive.google.com/file/d/1mS2UF9Bkcqes2kkuUyGAx-W6g2Weo627/view?usp=sharing
Live Client Plugin from Glassbox:
https://glassboxtech.com/products/live-client
Epic’s MetaHuman sample scene if you haven't already created your own MetaHuman (for Unreal Engine): https://www.unrealengine.com/marketplace/en-US/learn/metahumans
Sample Facial Performance Video (Optional): You can use your own footage, but we've provided a sample of a facial performance captured with our unparalleled Mark IV headcams (https://facewaretech.com/cameras/markiv/) that you can download and load into Faceware Studio: https://drive.google.com/file/d/1i1HiXf0FIingfU-QQX4WmiqM0oBh9FZS/view?usp=sharing
NOTE: Installing the package is non-destructive, but we recommend you work with a clean project just in case!
Once you've downloaded the assets above, you're ready to start animating your MetaHuman!
Unzip the contents of the Faceware Metahuman Motion Logic sample (FW_Metahuman_MotionLogic_Sample.zip) to a directory where you can find it.
After creating a new MetaHuman project, open your Metahuman project directory so that you can see the Content folder:
Select and drag the Content folder from the directory where you unzipped the Metahuman Motion Logic sample, and drop it in the Metahumans project folder:
Unzip the “Live Client” folder from the Glassbox plugin zip file into your project/Plugins folder:
Open the MetaHuman project!
The Faceware MetaHuman package utilizes the LiveClient plugin from Glassbox, and you will be prompted to insert your activation key when the project opens. Insert your production or Trial key.
Once activated, click ‘Start Using Live Client for Unreal'
In your project, find your MetaHuman blueprint in the Content/MetaHumans/Name folder:
Right-click the MetaHuman blueprint and select “Create Child Blueprint Class” and name it appropriately:
Drag your new child blueprint into the scene:
Double-click the child blueprint and in the details panel, use the “Add Component” button and find “Faceware Live” in the list of components and add it:
Select the Face component and change the Anim Class to ABP_FW_Metahuman_Face_C
Select the Body component and change Animation Mode to Use Animation Blueprint, and set the Anim Class to ABP_FW_Metahuman_Body_C:
The plugin is configured to look for Faceware Studio on the same local machine as the MetaHuman project. By default, when ‘Play’ is activated the LiveClient plugin will attempt to connect with Faceware Studio on the localhost address 127.0.0.1 on port 802.
To change the default settings of the plugin, select the MetaHuman in your scene, and find the FacewareLive component in the details panel:
Scroll down in the details panel to find and expand the Configuration section where you can change the default IP address and Port for Faceware Studio:
On the Studio side, make sure that you have a video source playing. This can be a Live camera source, or you can use a pre-recorded video, including the Mark IV sample footage linked above. Make sure it is calibrated on a neutral frame, then open the Streaming Panel and make sure to set the Control Schema to "Standard" and then turn on 'Stream to Client".
Back in Unreal, push the Play button and you should see your MetaHuman animating!
Make sure to explore working with the Animation Tuning and Motion Effects panels to dial in your animation, as well as have a look at the animation blueprints included in the Motion Logic folder. Over time we will add more examples and tutorials, so check back often. Have fun with Faceware Studio, LiveClient Plugin from Glassbox, and Epic’s MetaHumans!
Discuss with active users on our Discord: https://discord.gg/6QedTT5H96
