At GDC 2019 this week, HTC Vive America’s Vice President of Product and Operations, Vinay Narayan, announced that the company is currently developing a Lip Tracking Module development kit for the HTC Vive Pro. However, he did not reveal too many details about the new module.
Potential Features and Applications
Although specific details are scarce, rumors suggest that the Lip Tracking Module will consist of a camera mounted underneath the Vive Pro visor, pointing directly at the wearer’s mouth. This setup is expected to be capable of triggering commands or even in-game or application movements that mimic the wearer’s mouth movements. This technology could accurately gather data about how the user’s mouth is moving, which could be invaluable for research and experimentation in various fields.
For instance, in gaming, this module could enable more immersive experiences by allowing characters to replicate the player’s facial expressions in real-time. In professional applications, such as virtual meetings or training simulations, the lip tracking could enhance communication by providing more nuanced and accurate facial expressions. This could be particularly beneficial in fields like psychology, where understanding subtle facial cues is crucial.
Integration with Vive Facial Tracking SDK
It’s thought that the module will tie in with the Vive facial tracking SDK, which is also currently under development. This SDK is expected to be rolled out soon to virtual reality developers worldwide. The integration of lip tracking with facial tracking could open up new possibilities for developers, allowing them to create more sophisticated and interactive VR experiences.
For example, combining lip tracking with eye tracking and other facial recognition technologies could lead to highly realistic avatars in social VR platforms. This could make virtual interactions feel more natural and engaging, bridging the gap between physical and virtual presence.
HTC also didn’t reveal whether the Lip Tracking Module will be available to consumers or just a business product and development kit. This leaves open the question of whether everyday users will get to experience this cutting-edge technology or if it will be reserved for specialized applications and industries.
Unfortunately, no information on pricing or worldwide availability has been released yet by HTC for the Lip Tracking Module. However, as soon as information comes to light, we will keep you updated as always.
The potential applications of this technology are vast. Beyond gaming and professional use, lip tracking could be used in healthcare for speech therapy, helping patients improve their speech by providing real-time feedback. It could also be used in accessibility technologies, enabling people with disabilities to control devices using their mouth movements.
Moreover, the data gathered from lip tracking could contribute to advancements in artificial intelligence and machine learning. By analyzing how people move their mouths when speaking, researchers could develop more sophisticated speech recognition systems and improve the naturalness of AI-generated speech.
In summary, while the HTC Vive Pro Lip Tracking Module is still in development and many details remain unknown, its potential impact on various industries is significant. From enhancing virtual reality experiences to contributing to advancements in healthcare and AI, this technology promises to be a game-changer.
Source: R2VR
Latest Geeky Gadgets Deals
Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, Geeky Gadgets may earn an affiliate commission. Learn about our Disclosure Policy.
