The Nex Motion Development Kit or "MDK" is the first neural network architecture and toolkit that's integrated with Unity and tailored for building motion-powered sports, fitness, and gaming experiences.
The Nex Motion Development Kit enables development of immersive, console-level motion experiences across devices—from mobile, to PCs, to TVs. It's also the engine that we use internally to build our award-winning motion games and apps.
With the selfie camera of a smartphone, tablet, PC or Smart TV, computer vision can analyze human body movements in real-time to gamify consumer experiences and provide rich data input for new applications.
Our high performance use cases go way beyond basic human “pose estimation”. We’ve tuned the Nex MDK for speed, complex movements, and a wide range of body motions that other engines just weren't trained to handle.
Hand-crafted logic to reduce noisy backgrounds that are common in both indoor or outdoor settings.
So friends and families can spectate without breaking the action of the primary player.
Real-time multiplayer tracking up to 4 players within one scene. Detect each user individually and segment performance.
Special logic for detecting physical objects and equipment. For example the Nex MDK has patented tracking on a wide variety of basketball and soccer ball motions.
Automatically tracks fitness movements like pushups, lunges, squats, and sit-ups. Mix and match movements in a single session. The Nex MDK also supports pose comparison for instructor-led experiences like dance, coaching or physical therapy.
The Nex MDK has a proprietary method for estimating calorie burn through computer vision alone.
The Nex MDK contains a rich set of human motion event recognizers based on domain-specific training data. These motion event recognizers are critical for capturing specific movements used in full-motion games and experiences.
Interested in building or enabling motion entertainment experiences? We collaborate closely with operators, TV manufacturers, brands and IP holders to bring motion entertainment to life.
