Apple introduced its high-end VR headset, the Apple Vision Pro, in February this year. A standout feature of Apple's VR headset is EyeSight, which uses a display to simulate the wearer's eyes, making user interaction with the real world seem more authentic. According to Apple, "EyeSight reveals your eyes on the front of your Apple Vision Pro, and lets those nearby know when you’re using apps or are fully immersed in an experience.”
Meta's Patent for a Similar Feature
In recent news, Meta has filed a patent for a technology similar to Apple's EyeSight feature. The patent illustration is available below. Reports suggest that Meta aims to create its version of the EyeSight feature, which itself is not without flaws.
Meta’s patent abstract describes a method for updating a subject avatar with real-time facial expressions. The process involves receiving signals from a sensor on the headset's facial interface, which detects facial muscle movements from the user. Using a machine learning algorithm, the system determines the user’s facial expression based on these signals.
The headset then adjusts the user's avatar according to the identified facial expression and provides this avatar to an immersive reality application hosted on a remote server.
Advanced Sensors in Meta’s Headset
The headset is expected to feature various sensors, including ECG, EEG, and PPG sensors, to monitor the user’s cardiovascular conditions.
A common issue with VR headsets like the Meta Quest 3 or Apple Vision Pro is that they somewhat disconnect the wearer from the real world. Apple claims they developed EyeSight to help maintain the wearer's connection to their surroundings.
While it's not unusual for companies to draw inspiration from each other's innovations, what's surprising about this development is that it comes just a few months after Zuckerberg claimed that the Quest headset excelled over the Vision Pro in various aspects.
