PEA-PODs: Perceptual Evaluation of Algorithms for Power Optimization in XR Displays

PEA-PODs: Perceptual Evaluation of Algorithms for Power Optimization in XR Displays

Kenneth Chen, Thomas Wan, Nathan Matsuda, Ajit Ninan, Alexandre Chapiro*, Qi Sun*
[★ Best Paper Honorable Mention Award ★] ACM Transactions on Graphics (SIGGRAPH 2024)
PDF Video Code

Abstract

Display power consumption is an emerging concern for untethered devices. This goes double for augmented and virtual extended reality (XR) displays, which target high refresh rates and high resolutions while conforming to an ergonomically light form factor. A number of image mapping techniques have been proposed to extend battery usage. However, there is currently no comprehensive quantitative understanding of how the power savings provided by these methods compare to their impact on visual quality. We set out to answer this question. To this end, we present a perceptual evaluation of algorithms (PEA) for power optimization in XR displays (PODs). Consolidating a portfolio of six power-saving display mapping approaches, we begin by performing a large-scale perceptual study to understand the impact of each method on perceived quality in the wild. This results in a unified quality score for each technique, scaled in just-objectionable-difference (JOD) units. In parallel, each technique is analyzed using hardware-accurate power models. The resulting JOD-to-Milliwatt transfer function provides a first-of-its-kind look into tradeoffs offered by display mapping techniques, and can be directly employed to make architectural decisions for power budgets on XR displays. Finally, we leverage our study data and power models to address important display power applications like the choice of display primary, power implications of eye tracking, and more.

Bibtex

@article{chen2024pea,
title={PEA-PODs: Perceptual Evaluation of Algorithms for Power Optimization in XR Displays},
author={Chen, Kenneth and Wan, Thomas and Matsuda, Nathan and Ninan, Ajit and Chapiro, Alexandre and Sun, Qi},
journal={ACM Transactions on Graphics (TOG)},
volume={43},
number={4},
pages={1–17},
year={2024},
publisher={ACM New York, NY, USA}
}



Related Projects:

  • Color-Perception-Guided Display Power Reduction For Virtual Reality. Duinkharjav* & Chen* et al, ACM Trans. Graph. (SIGGRAPH Asia 2022)  [link]
  • Exploiting Human Color Discrimination For Memory- And Energy-Efficient Image Encoding In Virtual Reality, Ujjainkar et al., ACM ASPLOS 2024 [link]