Varjo Reveals Add-on for High Quality Pass-through AR, Launching in 2019

on

The first version of Varjo’s ‘bionic display’ enterprise VR headset is due out later this year (see our latest hands-on), and the company has announced plans to offer an add-on upgrade in 2019 which brings high-quality pass-through AR capabilities to the headset. Varjo showed off a tech demo of the headset’s add-on capabilities this week at AWE 2018.

Given Varjo’s positioning (exclusively for non-consumer sectors), the company is aiming for maximum quality visuals for their AR add-on. As shown in their current tech demo headset, it houses a pair of 4K cameras with lenses that match the headset’s own ~95 degree field of view, supporting stereoscopic pass-through video at 90Hz. Latency for the pass-through input is presently around 40ms, the company says, but they expect to be able to achieve single-digit latency before the add-on launches.
A look through their AR tech demo headset (which is identical to the current Varjo Beta headset, with the addition of the AR add-on) showed a fair bit of noise in the low lighting of the demo space; despite this, it was clear from a visual quality standpoint that Varjo has presented the best looking pass-through AR I’ve seen yet. Inside the headset I saw the view of the real room around me, while a full-sized model of a virtual motorcycle was projected into the space. Given the headset’s unique inset display, the center of my field of view revealed crisp details on the motorcycle that couldn’t be seen otherwise. Compared to optically transparent AR headsets, the field of view of both the real world and the virtual content was wide and immersive.
Photo by Road to VR
The brief demo I saw was purely visual for now, and lacked interaction. Varjo isn’t talking about advanced functions which one would hope to see with a pass-through AR system, like hand-tracking or SLAM; so while it’s clear that Varjo is aiming for high quality visuals in their AR add-on, it isn’t clear how much of the input/interaction pipeline they intend to own.
.IRPP_kangoo , .IRPP_kangoo .postImageUrl , .IRPP_kangoo .imgUrl , .IRPP_kangoo .centered-text-area { min-height: 100px; position: relative; } .IRPP_kangoo , .IRPP_kangoo:hover , .IRPP_kangoo:visited , .IRPP_kangoo:active { border:0!important; } .IRPP_kangoo { display: block; transition: background-color 250ms; webkit-transition: background-color 250ms; width: 100%; opacity: 1; transition: opacity 250ms; webkit-transition: opacity 250ms; background-color: #eaeaea; box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -moz-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -o-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -webkit-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); } .IRPP_kangoo:active , .IRPP_kangoo:hover { opacity: 1; transition: opacity 250ms; webkit-transition: opacity 250ms; background-color: #e6e6e6; } .IRPP_kangoo .postImageUrl , .IRPP_kangoo .imgUrl { background-position: center; background-size: cover; float: left; margin: 0; padding: 0; } .IRPP_kangoo .postImageUrl { width: 30%; } .IRPP_kangoo .imgUrl { width: 100%; } .IRPP_kangoo .centered-text-area { float: right; width: 70%; padding:0; margin:0; } .IRPP_kangoo .centered-text { display: table; height: 100px; left: 0; top: 0; padding:0; margin:0; } .IRPP_kangoo .IRPP_kangoo-content { display: table-cell; margin: 0; padding: 0 10px 0 10px; position: relative; vertical-align: middle; width: 100%; } .IRPP_kangoo .ctaText { border-bottom: 0 solid #fff; color: #1ABC9C; font-size: 13px; font-weight: bold; letter-spacing: .125em; margin: 0; padding: 0; text-decoration: underline; } .IRPP_kangoo .postTitle { color: #34495E; font-size: 16px; font-weight: 600; margin: 0; padding: 0; } .IRPP_kangoo .ctaButton { background-color: #e6e6e6; margin-left: 10px; position: absolute; right: 0; top: 0; } .IRPP_kangoo:hover .imgUrl { -webkit-transform: scale(1.2); -moz-transform: scale(1.2); -o-transform: scale(1.2); -ms-transform: scale(1.2); transform: scale(1.2); } .IRPP_kangoo .imgUrl { -webkit-transition: -webkit-transform 0.4s ease-in-out; -moz-transition: -moz-transform 0.4s ease-in-out; -o-transition: -o-transform 0.4s ease-in-out; -ms-transition: -ms-transform 0.4s ease-in-out; transition: transform 0.4s ease-in-out; } .IRPP_kangoo:after { content: “”; display: block; clear: both; } SEE ALSOHands-on: Varjo’s Latest ‘Beta’ Prototype is a Promising Shortcut to Retina Resolution
Varjo released a video showcasing the upcoming AR pass-through add-on, though there’s an important caveat to note before viewing it: the company says that it was “shot entirely through Varjo’s [AR] prototype in real-time,” but this is somewhat misleading, as the video was not recorded through the headset’s lenses. Instead, it appears they recorded the input from the headset, and used a cropped portion of the frame that represents the part of the input footage that would be shown on the headset’s central focus display. More simply put: it’s a direct video feed instead of being shot through the lens of the headset, and the part you’re seeing only represents the small, high resolution view at the center of the headset’s field of view.

Caveats aside, what they’re showing here is rendered in real-time, and the company says that their software is interpreting the scene’s real world lighting to allow the virtual components to cast convincing shadows onto the real ground, and for elements of the real scene to be cast in reflections on virtual objects (in the last shot you can see that the puddle reflections on the ground are actually virtual.
A render of what Varjo expects their AR add-on will look like at launch. | Photo by Road to VR
There’s pros and cons to doing pass-through AR instead of transparent AR. For one, the augmented parts of the world can look quite a bit more real because the pixels are drawn directly on top of the image of the real world, eliminating that semi-transparent ‘hologram’ look that you’ll find on transparent AR displays (caused by the fact that it’s extremely difficult to create pixels that can occlude 100% of the light from the outside world when dealing with a transparent display). It’s also much easier today to achieve an immersive, wide field of view by using pass-through AR rather than transparent AR.
.IRPP_kangoo , .IRPP_kangoo .postImageUrl , .IRPP_kangoo .imgUrl , .IRPP_kangoo .centered-text-area { min-height: 100px; position: relative; } .IRPP_kangoo , .IRPP_kangoo:hover , .IRPP_kangoo:visited , .IRPP_kangoo:active { border:0!important; } .IRPP_kangoo { display: block; transition: background-color 250ms; webkit-transition: background-color 250ms; width: 100%; opacity: 1; transition: opacity 250ms; webkit-transition: opacity 250ms; background-color: #eaeaea; box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -moz-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -o-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -webkit-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); } .IRPP_kangoo:active , .IRPP_kangoo:hover { opacity: 1; transition: opacity 250ms; webkit-transition: opacity 250ms; background-color: #e6e6e6; } .IRPP_kangoo .postImageUrl , .IRPP_kangoo .imgUrl { background-position: center; background-size: cover; float: left; margin: 0; padding: 0; } .IRPP_kangoo .postImageUrl { width: 30%; } .IRPP_kangoo .imgUrl { width: 100%; } .IRPP_kangoo .centered-text-area { float: right; width: 70%; padding:0; margin:0; } .IRPP_kangoo .centered-text { display: table; height: 100px; left: 0; top: 0; padding:0; margin:0; } .IRPP_kangoo .IRPP_kangoo-content { display: table-cell; margin: 0; padding: 0 10px 0 10px; position: relative; vertical-align: middle; width: 100%; } .IRPP_kangoo .ctaText { border-bottom: 0 solid #fff; color: #1ABC9C; font-size: 13px; font-weight: bold; letter-spacing: .125em; margin: 0; padding: 0; text-decoration: underline; } .IRPP_kangoo .postTitle { color: #34495E; font-size: 16px; font-weight: 600; margin: 0; padding: 0; } .IRPP_kangoo .ctaButton { background-color: #e6e6e6; margin-left: 10px; position: absolute; right: 0; top: 0; } .IRPP_kangoo:hover .imgUrl { -webkit-transform: scale(1.2); -moz-transform: scale(1.2); -o-transform: scale(1.2); -ms-transform: scale(1.2); transform: scale(1.2); } .IRPP_kangoo .imgUrl { -webkit-transition: -webkit-transform 0.4s ease-in-out; -moz-transition: -moz-transform 0.4s ease-in-out; -o-transition: -o-transform 0.4s ease-in-out; -ms-transition: -ms-transform 0.4s ease-in-out; transition: transform 0.4s ease-in-out; } .IRPP_kangoo:after { content: “”; display: block; clear: both; } SEE ALSOUpdate: ZED Mini Turns Rift and Vive into an AR Headset From the Future
On the flip side, our eyes have excellent resolution and contrast ratio, which generally means we limit our dynamic range (the ability to see dark and light areas of a scene at the same time) and visual fidelity when using pass-through AR (not to mention the potential to introduce latency).
The post Varjo Reveals Add-on for High Quality Pass-through AR, Launching in 2019 appeared first on Road to VR.

Source: Varjo Reveals Add-on for High Quality Pass-through AR, Launching in 2019