Skip to main content
Wide field of view augmented reality display showing 3 real world objects (top) and 3 virtual aliens (bottom) at 3 different depths: 20 cm (stamp and blue alien), 50 cm (mug and yellow alien), 800 cm (poster and green alien). Virtual objects not at current focal depth are computationally blurred.

 

Augmented Reality overlays computer-generated visuals onto the real world in real time.  Focus is an important aspect of how we perceive the world and must be taken into account when developing augmented reality displays. Providing these accommodative depth cues in a wide field of view with high angular resolution presents a major hardware design challenge for near-eye displays. Optimizing a design for one of these features typically leads to a trade-off in the others. We tackle the problem of providing wide FOV and accommodative cues together by employing an all-in-one solution: deformable beamsplitters. Our primary contribution is a light weight and thin form factor near eye display for augmented reality applications, supporting a range of focus cues via deformable beamsplitter membranes. Our work promises to address Vergence-Accommodation Conflict caused by lack of accommodative cues.

 

 


Publications

 

  Required Accuracy of Gaze Tracking for Varifocal Displays
David Dunn
VisAug: Workshop on Eye Tracking and Vision Augmentation, IEEE VR Conference. Osaka, Japan. 2019.
Abstract: Varifocal displays are a practical method to solve vergence–accommodation conflict in near-eye displays for both virtual and augmented reality, but they are reliant on knowing the user’s focal state. One approach for detecting the focal state is to use the link between vergence and accommodation and employ binocular gaze tracking to determine the depth of the fixation point; consequently, the focal depth is also known. In order to ensure the virtual image is in focus, the display must be set to a depth which causes no negative perceptual or physiological effects to the viewer, which indicates error bounds for the calculation of fixation point. I analyze the required gaze tracker accuracy to ensure the display focus is set within the viewer’s depth of field, zone of comfort, and zone of clear single binocular vision. My findings indicate that for the median adult using an augmented reality varifocal display, gaze tracking accuracy must be better than 0.541°. In addition, I discuss eye tracking approaches presented in the literature to determine their ability to meet the specified requirements.
[Paper] [DOI] [BibTex] [Slides]



  Mitigating Vergence-Accommodation Conflict for Near-Eye Displays via Deformable Beamsplitters
David Dunn, Praneeth Chakravarthula, Qian Dong, and Henry Fuchs
Digital Optics for Immersive Displays Conference, Photonics Europe. Strasbourg, France. 2018.
Winner: First Prize – DOID Student Optical Design Challenge
Abstract: Deformable beamsplitters have been shown as a means of creating a wide field of view, varifocal, optical see- through, augmented reality display. Current systems suffer from degraded optical quality at far focus and are tethered to large air compressors or pneumatic devices which prevent small, self-contained systems. We present an analysis on the shape of the curved beamsplitter as it deforms to different focal depths. Our design also demonstrates a step forward in reducing the form factor of the overall system.
[Paper] [DOI] [BibTex] [Slides] [Video 1] [Video 2]



  Towards Varifocal Augmented Reality Displays using Deformable Beamsplitter Membranes
David Dunn, Praneeth Chakravarthula, Qian Dong, Kaan Akşit, and Henry Fuchs
SID Display Week. Los Angeles, CA. May 2018.
Abstract: Growing evidence in recent literature suggests gaze contingent varifocal Near Eye Displays (NEDs) are mitigating visual discomfort caused by the vergence‐accommodation conflict (VAC). Such displays promise improved task performance in Virtual Reality (VR) and Augmented Reality (AR) applications and demand less compute and power than light field and holographic display alternatives. In the context of this paper, we further extend the evaluation of our gaze contingent wide field of view varifocal AR NED layout by evaluating optical characteristics of resolution, brightness, and eye‐box. Our most recent prototype dramatically reduces form‐factor, while improving maximum depth switching time to under 200 ms.
[Paper] [DOI] [BibTex]



  Membrane AR: Varifocal, Wide Field Of View Augmented Reality Display from Deformable Membranes
David Dunn, Cary Tippets, Kent Torell, Petr Kellnhofer, Kaan Akşit, Piotr Didyk, Karol Myszkowski, David Luebke, and Henry Fuchs
SIGGRAPH Emerging Technologies, Los Angeles, CA. August 2017.
Winner: Digital Content Expo of Japan Special Prize
Abstract: Accommodative depth cues, a wide field of view, and ever-higher resolutions present major design challenges for near-eye displays. Optimizing a design to overcome one of them typically leads to a trade-off in the others. We tackle this problem by introducing an all-in-one solution – a novel display for augmented reality. The key components of our solution are two see-through, varifocal deformable membrane mirrors reflecting a display. They are controlled by airtight cavities and change the effective focal power to present a virtual image at a target depth plane. The benefits of the membranes include a wide field of view and fast depth switching.
[Paper] [DOI] [BibTex]



 overheaddynamicfocus Wide Field Of View Varifocal Near-Eye Display Using See-Through Deformable Membrane Mirrors
David Dunn, Cary Tippets, Kent Torell, Petr Kellnhofer, Kaan Akşit, Piotr Didyk, Karol Myszkowski, David Luebke, and Henry Fuchs
IEEE Transactions on Visualization and Computer Graphics, April 2017 (Selected Proceedings, IEEE Virtual Reality 2017, Los Angeles, CA).
Winner: Best Paper Award
Abstract: Accommodative depth cues, a wide field of view, and ever-higher resolutions all present major hardware design challenges for near-eye displays. Optimizing a design to overcome one of these challenges typically leads to a trade-off in the others. We tackle this problem by introducing an all-in-one solution – a new wide field of view gaze-tracked near-eye display for augmented reality applications. The key component of our solution is the use of a single see-through varifocal deformable membrane mirror for each eye reflecting a display. They are controlled by airtight cavities and change the effective focal power to present a virtual image at a target depth plane which is determined by the gaze tracker. The benefits of using the membranes include wide field of view (100° diagonal) and fast depth switching (from 20 cm to infinity within 300 ms). Our subjective experiment verifies the prototype and demonstrates its potential benefits for near-eye see-through displays.
[Paper] [DOI] [BibTex] [Slides] [Video]