Gaze-Contingent Retinal Speckle Suppression for Perceptually-Matched Foveated Holographic Displays

Gaze-Contingent Retinal Speckle Suppression for Perceptually-Matched Foveated Holographic Displays

Praneeth Chakravarthula; Zhan Zhang; Okan Tarhan Tursun; Piotr Didyk; Qi Sun; Henry Fuchs
IEEE Transactions on Visualization and Computer Graphics (Proceedings of ISMAR) 2021

All Research


Computer-generated holographic (CGH) displays show great potential and are emerging as the next generation displays for augmented and virtual reality, and automotive heads-up displays. One of the critical problems harming the wide adoption of such displays is the presence of speckle noise inherent to holography, that compromises its quality by introducing perceptible artifacts. Although speckle noise suppression has been an active research area, the previous works did not consider the perceptual characteristics of the Human Visual System (HVS), which receives the final displayed imagery.
It is well studied that the sensitivity of the HVS is not uniform across the visual field, which has led to gaze-contingent rendering schemes for maximizing the perceptual quality in various computer-generated imagery.
Inspired by this, we present the first method that reduces the “perceived speckle noise” by integrating foveal and peripheral vision characteristics of the HVS, along with the retinal point spread function, into the phase hologram computation.
Specifically, we introduce the anatomical and statistical retinal receptor distribution into our computational hologram optimization, which places a higher priority on reducing the perceived foveal speckle noise while being adaptable to any individual’s optical aberration on the retina. Our method demonstrates superior perceptual quality on our emulated holographic display. Our evaluations with objective measurements and subjective studies demonstrate a significant reduction of the human perceived noise.


title={Gaze-Contingent Retinal Speckle Suppression for Perceptually-Matched Foveated Holographic Displays},
author={Chakravarthula, Praneeth and Zhang, Zhan and Tursun, Okan and Didyk, Piotr and Sun, Qi and Fuchs, Henry},
journal={IEEE Transactions on Visualization and Computer Graphics},

Related Projects:

  • Perceptually-Guided Foveation for Light Field Displays, Sun et al., ACM SIGGRAPH Asia 2017 [link]
  • Eccentricity Effects on Blur and Depth Perception, Sun et al., Optics Express 2020 [link]