The visually perceived real world is color and exhibits a high dynamic range of intensity, from bright sunlight to deep shadows. For generalized augmented reality to be feasible, the augmenting elements must be visible in this breadth of lighting situations and in rapidly changing lighting situations. We present a high dynamic range, optical see-through, augmented reality display that dynamically adjusts the brightness of the virtual imagery to match the current brightness of the real scene. Critical components include the spatial brightness sensor array and the positional brightness image intensity matcher. The color, scene-adaptive HDR display system is based on a high-rate (15 kHz) DMD projector using a high-speed RGB LED illuminator, each color with independent 16 bit intensity control for each binary DMD frame. The critical input to the intensity matching algorithm is the output of an array of high sensitivity light sensors. This paper discusses the implementation of the system and reports performance via still and video demonstrations under a variety of lighting conditions.
Paper (Internally Stored): http://telepresence.web.unc.edu/wp-content/uploads/sites/11620/2017/03/lincoln-2017i3d-lowlatencyhdr.pdf Paper (Externally Stored): Video (Externally Stored): http://www.cs.unc.edu/~plincoln/papers/lincoln-2017i3d-lowlatencyhdr.avi Video (Streaming): https://youtu.be/HZPQUSbVFLY BibTeX:@InProceedings{LincolnHDR2017,
Title = {Scene-Adaptive High Dynamic Range Display for Low Latency Augmented Reality},
Author = {Peter Lincoln and Alex Blate and Montek Singh and Andrei State and Mary Whitton and Turner Whitted and Henry Fuchs},
Booktitle = {Proceedings of the 21st ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games},
Year = {2017},
Address = {New York, NY, USA},
Month = {Februrary},
Publisher = {ACM},
Series = {I3D '17},
Abstract = {The visually perceived real world is color and exhibits a high dynamic range of intensity, from bright sunlight to deep shadows. For generalized augmented reality to be feasible, the augmenting elements must be visible in this breadth of lighting situations and in rapidly changing lighting situations. We present a high dynamic range, optical see-through, augmented reality display that dynamically adjusts the brightness of the virtual imagery to match the current brightness of the real scene. Critical components include the spatial brightness sensor array and the positional brightness image intensity matcher. The color, scene-adaptive HDR display system is based on a high-rate (\SI{15}{\kilo\hertz}) DMD projector using a high-speed RGB LED illuminator, each color with independent \SI{16}{\bit} intensity control for each binary DMD frame. The critical input to the intensity matching algorithm is the output of an array of high sensitivity light sensors. This paper discusses the implementation of the system and reports performance via still and video demonstrations under a variety of lighting conditions.},
Doi = {http://dx.doi.org/10.1145/3023368.3023379},
ISBN = {978-1-4503-4886-7/17/03},
Journal = {I3D '17: Proceedings of the 21st ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games},
Location = {San Francisco, CA, USA}
}