New research has developed a revolutionary smartphone app called “MobilePoser” that can replace the expensive and bulky equipment typically needed for motion capture. This app utilizes sensors already present in consumer devices like smartphones, earbuds, and smartwatches, combined with artificial intelligence (AI), to track a person’s full body pose and position accurately.
Motion capture is commonly used in the film and gaming industries to translate actors’ movements into computer-generated characters. Traditional motion capture setups can cost over $100,000 to run, making them inaccessible for many. Alternatives like the Microsoft Kinect are cheaper but limited by the camera’s field of view.
The MobilePoser app offers a cost-effective and practical solution for motion capture, providing high accuracy through machine learning and physics-based optimization. By utilizing inertial measurement units (IMUs) already present in smartphones, the app can measure body position, orientation, and motion. The researchers trained the AI with a dataset of synthesized IMU measurements to achieve a tracking error of just 3 to 4 inches.
One of the key features of MobilePoser is its adaptability. Even if a person is not wearing multiple devices, the app can still accurately track their full-body pose using just a smartphone. This technology has vast applications in entertainment, gaming, fitness, and potentially even in health.
The team behind MobilePoser has made the AI models and data available for other researchers to build upon. This opens up possibilities for more immersive gaming experiences, advanced fitness tracking, and innovative applications in various industries.
Overall, the MobilePoser app represents a significant advancement in motion capture technology, making it more accessible, affordable, and adaptable for a wide range of users and industries. By harnessing the power of smartphones and AI, this app has the potential to revolutionize how body movements are translated into digital formats, paving the way for new and exciting experiences in gaming, fitness, and beyond.