Apple's Mixed Reality headset could feature advanced hand tracking and may work as a second display for Mac

• Apple’s mixed reality headset could feature full-body FaceTime avatars.
• Apple’s headset ‘Reality Pro’ may launch this spring.
• The Reality Pro will cost roughly $3000, double the Quest Pro price.

Apple’s much anticipated and long-rumored AR/ VR headset could be packed with ambitious technologies, including an advanced hand and eye tracking system, the ability to see your Mac’s display, and even full-body FaceTime avatars, according to a new report from Bloomberg’s Mark Gurman.

Gurman says that the headset is likely to be called the ‘Reality Pro’ as the company has already filed trademarks. The Reality Pro will cost roughly $3000, which would double the price of the Quest Pro. The headset is expected to launch this spring.

With Reality Pro, Apple aims to bring something new to the table, and it will be a new product category from the company after the AirTag. The eye and hand-tracking capabilities could be major selling points for the products. Other than this, the core feature will include advanced FaceTime-based video conferencing. Apple’s headset will also be able to show immersive video content and serve as an external display for a connected Mac. It may also replicate many functions from iPads and iPhones.

Here’s how it will work

The headset will have multiple external cameras that can analyze the user’s hands and sensors that will read the eyes. Sensors and cameras will allow the user to control the device by looking at the screen items, such as app icons or buttons. Users will then pinch their index finger and thumb to activate the task without pressing any buttons. This approach differs from other headsets, which typically rely on a hand controller.

Similar to Meta’s headset, Apple will also use both augmented (AR) and virtual reality (VR). To make AR and VR work, the headset will have a Digital Crown, similar to an Apple watch. This Digital Crown will let the user switch between VR and AR. Apple expects this to be one of the main highlights of the product.

Reportedly, the headset will have two ultra-high resolution displays developed by Sony.

According to Mark Gurman, FaceTime calls between two people, each wearing headset, will render a user’s face and full body in virtual reality. The technology differs from virtual meeting rooms on Meta’s headset, which created a more cartoon-like avatar of the users.

Immersive video-watching will also be a core feature of the ‘Reality Pro.’ Apple is developing VR content for the headset with dozen of media partners, including Walt Disney and Dolby Laboratories. According to Apple, video-watching features on the headset can make viewers feel like they see a movie on a giant screen in another environment, such as outer space or a desert.

The device will also have some productivity features, such as the ability to be an external monitor for a Mac. With the help of this feature, users will be able to see their Mac’s display in virtual reality but still can control the Mac with their trackpad and keyboard.

Apple welcomes third-party content, and custom lens

Headsets will include apps such as Safari, Photos, Mail, Apple TV+, Messages, Apple Music, Calendar, Podcasts, and more. It will also have a dedicated App Store for third-party content.

Apple will provide custom lenses for those who wear glasses that can sit within the enclosure.

According to Mark Gurman, the company is developing a cheaper headset that could cost more than $1,500.

SEE ALSO:
Volkswagen and Microsoft come together to bring augmented reality to cars using HoloLens 2
Scientists may have found a crappy way to reverse the effects of ageing