Key Takeaway

Apple unveiled its Vision Pro headset, blending VR, AR, and mixed reality. The headset uses 12 cameras and EyeSight to detect and display people in the real world, allowing users to adjust their immersion level. The Vision Pro is expected to revolutionize head-mounted devices and bring immersive technologies to mainstream use. Apple’s Vision Pro headset uses cameras, microphones, LiDAR scanner, and displays for real-world awareness, offering a wearable ecosystem for interoperable devices. Apple’s Vision Pro headset, combining iPhone, Apple Watch, and programming tools, could create new uses for augmented reality and tap into existing developers.


Apple recently unveiled its Vision Pro headset at the Worldwide Developers Conference in California. With it, Apple is venturing into a market of head-mounted devices (HMDs) – which are usually just displays, but in this case is more of a complete computer attached to your head – as well as the worlds of virtual reality (VR), augmented reality (AR) and mixed reality (MR). 

The new Apple product will fuel the hopes of many working on these technologies that they will some day be routinely used by the public, just as the iPhone, iPad and Apple Watch helped bring smartphones, tablets and wearable tech into mainstream use.

But what does the Vision Pro actually do, and how much mass appeal will it have?

VR immerses users in an entirely computer-generated world, isolating them to a large degree from their physical surroundings. AR superimposes computer-generated elements onto the real world while the latter remains visible, with the purpose of enhancing the context of our physical surroundings.

A term often used interchangeably with AR is mixed reality, referring to a set of immersive technologies including AR, that provide different “blends” of physical and virtual worlds. These three technologies are often collectively referred to as XR.

The blending of VR and AR seems to be a key part of Apple’s thinking, with the Vision Pro allowing users to adjust their level of immersion by deciding how much of the real world they can see. This transitioning between the two experiences will probably be a trend for future HMDs.

Tim Cook
Apple’s CEO Tim Cook was at the unveiling at the Apple Worldwide Developers Conference (WWDC) in California. JOHN G. MABANGLO / EPA IMAGES

The physical world is “seen” through an array of 12 cameras located behind a ski-goggle-like glass fascia, acting as a lens. When the Vision Pro is in VR mode, people approaching you in the real world are automatically detected and displayed as they get close. 

A feature called EyeSight also displays the wearer’s eyes through the glass lens when needed, to enable more natural interaction with people around them – a challenge for many HMDs.

In terms of technical specifications, the Vision Pro is impressive. It uses a combination of the M2 microchip and a new chip called the R1. M2 is running visionOS, which Apple calls its first spatial operating system, along with computer vision algorithms and computer graphics generation. 

R1 processes information from the cameras, an array of microphones and a LiDAR scanner – which uses a laser to measure distances to different objects – in order to make the headset aware of its surroundings.

More importantly, the Vision Pro boasts an impressive display system with “more pixels than a 4K TV to each eye”. Its ability to track where the wearer’s eyes are looking allows users to interact with graphical elements just by looking at them. The headset can receive gesture and voice commands and features a form of 360-degree sound called spatial audio. The quoted unplugged operating time is two hours.

Wearable ‘ecosystem’

Packed, in typical Apple fashion, in curved aluminum and glass, the headset has an eye-watering price of US$3,499 (£2,819) and represents a collection of many premium features. But Apple has a history of developing products with increasingly versatile capabilities to sense what’s going on in their real-world surroundings.

Tim Cook (L) and Apple Senior VP of Software Engineering Craig Federighi speak during the conference keynote address.
Tim Cook (L) and Apple Senior VP of Software Engineering Craig Federighi speak during the conference keynote address. JOE MABANGLO / EPA IMAGES

Apple also focuses on making its devices interoperable – meaning they work easily with other Apple devices – forming a wearable “ecosystem”. This is what really promises to be disruptive about the Vision Pro. It is also akin to what had been promised and hoped for by pioneers in the idea of wearable computing back in the 1990s.

Combining the headset with the iPhone, which still forms the backbone of Apple’s ecosystem, and the Apple Watch could help create new uses for augmented reality. Likewise, linking the headset to many programming tools demonstrates the company’s desire to tap into an existing community of developers of augmented reality applications.

Many questions remain, however. For example, will it be able to access mixed reality applications via a web browser? What will it be like to use from an ergonomic point of view?

It’s also unclear when the Vision Pro be available outside the US or whether there will be a non-Pro version – as the “Pro” part of the title implies a more “expert”, or developer market.

The Vision Pro is a gamble, as XR is often seen as something that promises but rarely delivers. Yet, companies such as Apple and those that are probably its primary competitors in the XR domain, Meta and Microsoft, have the clout to make XR popular for the general public.

More importantly, devices such as the Vision Pro and its ecosystem, as well as its competitors could provide the foundation for developing the metaverse. This is an immersive world, facilitated by headsets, that aims for social interaction that’s more natural than with previous products.

Sceptics will say that Vision Pro and EyeSight make you appear like a scuba diver in your living room. But this could finally be the time to dive into the deep waters of XR.

Contributor

Recently Published

Key Takeaway: The mystery of consciousness has been a subject of debate for centuries, with numerous theories vying for the title. In 2024, the Cogitate Consortium conducted an “adversarial collaboration” between Global Neuronal Workspace Theory (GNWT) and Integrated Information Theory (IIT). The study aimed to test the theories under neutral conditions, revealing that confirmation bias […]

Top Picks

Key Takeaway: President Donald Trump’s executive order titled “Restoring Freedom of Speech and Ending Federal Censorship” accused the previous administration of stifling free expression by working with social media companies to curb misinformation and label misleading content. However, recent research suggests that less regulation can actually make the internet a less free place for speech, […]
Key Takeaway: Recent research published in Science has revealed that the brain uses multiple learning mechanisms simultaneously, revealing the complexity behind brain wiring. Neurons communicate through electric signals called synapses, which form complex networks of connections that transmit information. The traditional theory of synaptic plasticity assumes uniformity between neurons, but the new study found that […]
Key Takeaway: A new study published in Nature Astronomy claims that the James Webb Space Telescope (JWST) has detected atmospheric signals on K2-18b, a distant world 124 light-years from Earth. The researchers found traces of molecules often associated with biological activity on Earth, including dimethyl sulphide (DMS). The scientists are 99.7% confident in the presence […]
Key Takeaway: Belief in the supernatural, including ghosts, spirits, astrology, and psychic powers, is more common than people might expect. These beliefs offer a sense of control, meaning, and comfort in the face of life’s unpredictability. They fall outside the boundaries of conventional science and include ideas like fate, spiritual forces, and life after death. […]
Key Takeaway: Brain-computer interface (BCI) technology is rapidly redefining human potential, with breakthroughs in artificial intelligence and machine learning enabling the translation of thoughts into action. The brain is a complex network of over 80 billion neurons, processing thoughts, memories, emotions, and sensory inputs. Advances in AI, miniaturized electronics, and neuroimaging have led to the […]

Trending

I highly recommend reading the McKinsey Global Institute’s new report, “Reskilling China: Transforming The World’s Largest Workforce Into Lifelong Learners”, which focuses on the country’s biggest employment challenge, re-training its workforce and the adoption of practices such as lifelong learning to address the growing digital transformation of its productive fabric. How to transform the country […]

Join our Newsletter

Get our monthly recap with the latest news, articles and resources.

Login

Welcome to Empirics

We are glad you have decided to join our mission of gathering the collective knowledge of Asia!
Join Empirics