Here's a thorough look into the technology powering Magic Leap's mysterious 'cinematic reality' headset

What is Magic Leap?

Advertisement

Other than "the company that Google co-funded to the tune of $500 million," no one really knows. Well, okay, at least one person outside of Magic Leap knows – the MIT Technology Review's Rachel Metz is the only journalist who's been allowed to try out the Florida-based company's mysterious headset. There have been no press tours, no "development kits," no big Kickstarter campaigns. The company's CEO Rony Abovitz describes Magic Leap as a "techno-biology" company.

For a company that's raised hundreds of millions of dollars from high profile investors, that has one of Google's most important employees sitting on its board (Sundar Pinchai, the man in charge of all Google consumer products), Magic Leap has been amazingly quiet. Here's the long and short: Magic Leap is a technology company creating some form of "augmented reality" headset. The headset uses what are essentially tiny projectors to mix artificially-created light with the world in front of you – it "augments" the reality you see with your eyes.

Magic Leap believes this technology will change computing. Magic Leap believes its headset will kill of screens in general, from your home TV to your mobile phone (and everything in between). That remains to be seen.

On July 23, the United States Patent and Trademark Office published the most thorough patent application that Magic Leap has produced, complete with ridiculous drawings of what Magic Leap's headset is potentially capable of doing. As a reminder, patent applications are not indicative of final products necessarily. That being said, let's dive into the 185-page application to see what Magic Leap is up to.

Advertisement

The Google Glass look.

Magic Leap
Magic Leap

The first drawing in the patent application is what you see here: some sort of glasses-mounted device with a wire hanging from it, enabling the user to see a computer-generated image in their left eye. Is this what Magic Leap is making? Almost certainly not, but it does offer a glimpse into the kind of experience the company wants to offer. 

Watch out for that giant robot!

Magic Leap
Magic Leap

The second drawing is all about representing how Magic Leap's headset will work. The person wearing the headset sees the giant robot and the floating bee character, but no one else does. The headset is "augmenting" the wearer's reality by adding a massive robot statue and a bizarrely human bee.

Advertisement

An example of what Magic Leap doesn't want to make.

Magic Leap
Magic Leap

In the third drawing, a headset is shown with two displays intended to trick the eyes. This is essentially how virtual reality headsets work. Magic Leap president Rony Abovitz has repeatedly stated his disinterest in this type of solution. That's evident in the drawing's description from the patent: "Such configurations have been found to be uncomfortable for many users due to a mismatch between vergence [how eyes turn] and accommodation which must be overcome to perceive the images in three dimensions."

All that to say this is most certainly not Magic Leap's solution.

Advertisement

The camera eyes approach.

Magic Leap
Magic Leap

Another solution shown in Magic Leap's patent application is this set of glasses with cameras mounted in front of where you'd normally look. The idea here is that the cameras capture the world in front of the user, add in some form of computer-generated images, and push out that augmented video to the user on the side of the lenses facing the user's eyes. As the patent application points out, "The position of the cameras and displays generally blocks the natural field of view of the user when the glasses are mounted on the user's head."

Again, this is not Magic Leap's solution to AR.

Advertisement

The hat/helmet model.

Magic Leap
Magic Leap

Perhaps you don't want to wear a pair of sunglasses. What you really want is a hat or helmet with an attached display, right? Who could blame you!

All joking aside, this is yet another representation of how augmented reality can be achieved, albeit one that Magic Leap likely isn't pursuing. This looks oddly like a device that already exists, actually – as SlashGear's Chris Davies pointed out to me on Twitter, the Vuzix M2000AR is strikingly similar.

The Robert Scoble in the shower model.

Magic Leap
Magic Leap

Apparently the folks in Magic Leap's patent application department have a sense of humor. While this image is meant to represent "a frame couple-able to a user's head in a manner similar to eyeglasses coupling so that a visualization module may be utilized to capture images and also present monocular augmented digital imagery to a user through a small display," it's really just a reference to a picture taken by Rackspace employee and former Microsoft evangelist Robert Scoble.

Advertisement

Here's that picture of Robert Scoble, which has him in a shower wearing Google Glass.

Robert Scoble
Robert Scoble
Advertisement

This is where we finally start getting more information on what Magic Leap's making.

Magic Leap
Magic Leap

Is the sunglasses setup going to be Magic Leap's first product? We're guessing probably not. But what is very likely to come with Magic Leap's first product is a "local processing & data module" – or, more clearly, some form of pocket computer that powers the headset. See that wire leading off the back of the glasses? That connects to the pocket computer. 

What, you thought all the processing would be done in the glasses? We're in the future, yes, but not quite that far into the future.

Advertisement

The helmet returns.

Magic Labs
Magic Labs

Sure, Magic Leap could use a helmet to house the processor required to run its headset, but that seems very unlikely. The interesting addition in this drawing is that the local processing (the pocket computer) seemingly communicates remotely with both a "data repository" (think: the cloud) and a "processing module." That means that Magic Leap's headset could both store data elsewhere (your photos, for instance) and could offload some of the processing to a remote computer. 

This illustration further spells out how Magic Leap's headset works.

Magic Leap
Magic Leap

To further elucidate the concept of both local and remote processing, this is how the headset may work with both local processing (the aforementioned pocket computer) and remote processing and data storage.

Advertisement

The belt clipped computer.

Magic Leap
Magic Leap

Not so into putting computers in your pocket? Sorry to tell you, but you've already got a smartphone in there and it's more computer than phone. But perhaps you've managed to get by without a smartphone and, if you need to keep one, you have a sweet belt clip? Magic Leap's potential solution for local processing is the sweet belt clip computer you see in the drawing here.

Advertisement

What Magic Leap is saying.

Magic Leap
A promotional image showing how Magic Leap could be used to collectively terrify a beach of people. Magic Leap

We asked Magic Leap for statements about what the company is working on and were rebuffed. The most we got from a company rep was this: "Our product will be mobile and will not require plugging into a computer."

That's an important distinction from the likes of Facebook's Oculus Rift virtual reality headset (which requires a wired connection to a powerful computer). It's more akin to something like Google's Glass headset (which is a type of AR), or Samsung and Oculus VR's "Gear VR" headset (which uses your phone and requires no wires or computers). 

The company's website says little more about Magic Leap's intentions. The jobs page lists lots of expected positions (optics, programming, etc.), but also has some interesting positions for an "Android developer" (which tells us that the headset is likely to be powered by a smartphone-esque computer) and a variety of positions for cloud developers (adding credence to our guesses about how the headset is handling data storage). There are also positions listed for "telephony" and a couple of jobs in the health care department. If nothing else, Magic Leap is taking a very broad approach to what it wants to deliver. 

Now all that's left is actually showing that product.

Advertisement

Magic Leap's promotional video, released in March 2015, was apparently months old when it was shown.

For now, there's a promotional video from Magic Leap that offers a demonstration of what the company's headset might do. Try to restrain your excitement until more than one person outside of Magic Leap has had a chance to use it.

 

Insider Inc.'s parent company, Axel Springer, is an investor in Magic Leap.

Gaming
Advertisement
Close icon Two crossed lines that form an 'X'. It indicates a way to close an interaction, or dismiss a notification.