siga17 pgf ui

Perceptually-Guided Foveation for Light Field Displays

Perceptually-Guided Foveation for Light Field Displays

Qi Sun, Fu-Chung Huang, Joohwan Kim, Li-Yi Wei, David Luebke, Arie Kaufman
SIGGRAPH Asia 2017
PDF Video

Abstract

A variety of applications such as virtual reality and immersive cinema require high image quality, low rendering latency, and consistent depth cues. 4D light field displays support focus accommodation, but are more costly to render than 2D images, resulting in higher latency. The human visual system can resolve higher spatial frequencies in the fovea than in the periphery. This property has been harnessed by recent 2D foveated rendering methods to reduce computation cost while maintaining perceptual quality. Inspired by this, we present foveated 4D light fields by investigating their effects on 3D depth perception. Based on our psychophysical experiments and theoretical analysis on visual and display bandwidths, we formulate a content-adaptive importance model in the 4D ray space. We verify our method by building a prototype light field display that can render only 16%-30% rays without compromising perceptual quality.

Bibtex

@article{Sun:2017:PGF,
author = {Sun, Qi and Huang, Fu-Chung and Kim, Joohwan and Wei, Li-Yi and Luebke, David and Kaufman, Arie},
title = {Perceptually-Guided Foveation for Light Field Displays},
year = {2017},
issue_date = {November 2017},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
volume = {36},
number = {6},
issn = {0730-0301},
url = {https://doi.org/10.1145/3130800.3130807},
doi = {10.1145/3130800.3130807},
journal = {ACM Trans. Graph.},
month = nov,
articleno = {192},
numpages = {13},
keywords = {sampling, foveation, computational display, light field}
}



Related Projects:

  • Instant Reality: Gaze-Contingent Perceptual Optimization For 3D Virtual Reality Streaming, IEEE TVCG 2022 [link]
  • Leveraging Human Visual Perception for an Optimized Virtual Reality Experience, IEEE CG&A 2021 [link]