With FACEMOTION3D, you can capture facial expressions with an iOS app and communicate in real time with 3DCG software on your PC. You can also FBX export the recorded animation data.You can also import VRM format files into the iOS app.
Detailed usage is available at the following URL:
https://www.facemotion3d.net/
This app can create facial animations by communicating in real time with DAZ Studio, Maya, Unity ,UnrealEngine and Blender. In addition, you can bake recorded animations within the iOS app via streaming.
To use it, first start this app, then download and connect the plug-in script add-on used for data examination on the PC side.
Very accurate facial motion capture is very easy to do.
This app is only available on iPhone / iPad with Face ID or iPhone / iPad with A12 Bonic or higher CPU.
This app has the following iOS supported devices with Face ID:
・ IPhone
iPhone 11 Pro Max
iPhone 11 Pro
iPhone 11
iPhone XS Max
iPhone XS
iPhone XR
iPhone X
・ IPad
iPad Pro 12.9 inch (4th generation)
iPad Pro 12.9 inch (3rd generation)
iPad Pro 11 inch (2nd generation)
iPad Pro 11 inch
* Face ID is not used in the new iPhone SE 2nd generation released in 2020, but you can use FACE MOTION 3D by updating to iOS 14 or later. FACEMOTION3D can be used not only for the 2nd generation of iPhone SE but also when it is equipped with an A12 or later chip and has been updated to iOS14.
The camera image and resulting depth data are only used to send the motion capture data to the user's PC. That data is not saved on the iPhone. You need access to the camera to get depth data from Apple's API.
This application is only used to communicate with PCs in the same network and does not send any information to third parties.