Neo Kinect – Unreal Engine

With the Neo Kinect plugin you can use the Kinect v2 sensor advanced capabilities within Unreal Engine, with easy to use Blueprint nodes, all nicely commented, or directly through the C++ methods. And starting with Unreal Engine 5, the plugin is fully compatible with DX12 and all its perks, like ray tracing and Lumen.

Body tracking:

Tracking of up to 6 simultaneous users’s skeletons, with 25 joints each

Users leaning angle, tracking confidence, Body edge clipping, hands states

Per Body found/lost events

Face tracking:

Location and orientation of up to 6 simultaneous users’s faces

Face points (left and right eyes, nose and left and right mouth corners) in 3D and 2D (Color and Infrared space)

Faces bounding boxes in Color and Infrared frames space

Expressions reading (Engaged, Happy, Looking Away, Mouth Moved, Mouth Open and Left and Right Eyes Open/Closed) and if users are Wearing glasses or not

Per Face found/lost events

Sensor control:

Global bodies/faces tracking events (found/lost)

Init/Uninit sensor

Get sensor tilt, ground plane normal and sensor height

Remapping:

3D camera location to Color texture (optionally with depth) and to Depth texture

Find depth of a Color texture location

Depth point to Color point and to 3D location

Frames (textures):

Get each frame FOV and dimensions

Toggle frames usage individually

Sample a pixel value from the Depth frame and find the depth of a Color pixel

Supported Unreal Engine Versions
4.18 – 4.27 and 5.0 – 5.7
(Visited 62 times, 1 visits today)