Unreal Engine 4.24, 4.25 or 4.26: https://www.unrealengine.com/en-US/
Unreal Hand Engine Plugin: Download the most up to date Plugins for Unreal Engine from the Downloads Section of your StretchSense Account at www.stretchsense.com/my-account
Operating System: Windows 10
Setting up your Unreal Project
- Download and Install the StretchSense Hand Engine and UnrealNOTE: for this example we are using version UE4.24.3
- Launch Hand Engine and setup handSee Hand Engine User Guide (DOC-5010) for glove calibration instructions
- Once the hand is trained, in the Device Pane on the left of the screen, enter your TCP Port number and set Streaming to On. Check that the Streaming Status light in the device title bar (the right traffic light indicator) has turned green.NOTE: If you have already created a LiveLink connection to a hand model in UE (as described in the following steps), and you toggle Streaming to Off, you will need to create a new instance of LiveLink in UE after you toggle Streaming to On again.
- Next we need to add the plugin to the Unreal Engine. To do this, first navigate to the Plugins folder you have downloaded from your StretchSense account page (see image below), and find the plugin directory corresponding to the version of UE4 you are running.
- Open the folder corresponding to your version of Unreal, then copy the folder labelled MocapProLiveLink to the directory:<Unreal Installation Directory>\UE_4.2X\Engine\Plugins\Animation
- Next we will create a new UE4 project. In New Project Categories select Games > Blank > Default Settings. then click Create Project.
- Once the project is loaded we need to enable the LiveLink plugins in your new project. From the Edit menu, select Plugins.
- In the Plugins menu search “Live Link” and enable Live Link and Mocap Pro LiveLink, then restart your project when prompted.
- Next open the LiveLink Menu from Window > Live Link
- From the Source dropdown in the Live Link menu select Mocap Pro Glove, then set the IP Address and TCP Port settings as specified in Hand EngineNOTE: The default value for Address is 127.0.0.1 (= localhost), i.e., you are running Hand Engine on the same PC that you are running Unreal. If you have bound Hand Engine to a different IP address (e.g. if you are running Hand Engine and Unreal on different computers on the same LAN), use this IP address instead for Host.NOTE: This step must be repeated if you have toggled Streaming to Off and then back to On in Hand Engine.
- The Source Status will appear as Receiving and the Subject Name will show a hand (left or right) along with the Actor Name from Hand Engine.NOTE: If you are streaming pre-recorded data, you will need to make sure to press play in Hand Engine for the subject name and role to show up in Unreal.
From the Content Browser select Import and load the Hands.fbx asset. The Hands.fbx asset can be found in the Assets folder in the installation directory of Hand Engine.
In the Content Browser, right click the newly imported Skeletal Mesh and select Create > Anim Blueprint.
- Open the Anim Blueprint that was created, right click on the empty space and select Live Link Pose.Connect a LiveLink Pose to the Output Pose. Select the source hand from the Live Link Subject Name dropdown, then compile the object.
- Drag the Anim Blueprint into the scene and start the scene in Play mode, the hand in the scene will now be driven from the Hand Engine data stream.