PEA-PODs: Perceptual Evaluation of Algorithms for Power Optimization in XR Displays

Kenneth Chen, Thomas Wan, Nathan Matsuda, Ajit Ninan, Alexandre Chapiro*, Qi Sun*
ACM Transactions on Graphics (SIGGRAPH 2024)
PDF Code

Accelerating Saccadic Response through Spatial and Temporal Cross-Modal Misalignments

Daniel Jiménez Navarro, Xi Peng, Yunxiang Zhang, Karol Myszkowski, Hans-Peter Seidel, Qi Sun, Ana Serrano

Modeling the Impact of Head-Body Rotations on Audio-Visual Spatial Perception for Virtual Reality Applications

Edurne Bernal-Berdun, Mateo Vallejo, Qi Sun, Ana Serrano, Diego Gutierrez
[★ Best Paper Honorable Mention Award ★] IEEE Transactions on Visualization and Computer Graphics (IEEE VR) 2024

Exploiting Human Color Discrimination for Memory- and Energy-Efficient Image Encoding in Virtual Reality

Nisarg Ujjainkar, Ethan Shahan, Budmonde Duinkharjav, Kenneth Chen, Qi Sun, Yuhao Zhu

AutoColor: Learned Light Power Control for Multi-Color Holograms

Yicheng Zhan, Koray Kavakli, Hakan Ürey, Qi Sun, Kaan Akşit
PDF Code

The Shortest Route Is Not Always the Fastest: Probability-Modeled Stereoscopic Eye Movement Completion Time in VR

Budmonde Duinkharjav, Benjamin Liang, Anjul Patney, Rachel Brown, Qi Sun
ACM Transactions on Graphics (SIGGRAPH Asia 2023)
PDF Video Code

ARGUS: Visualization of AI-assisted Task Guidance in AR

S.C. Quispe, J. Rulff, E. McGowan, B. Steers, G. Wu, S. Chen, I. Roman, R. Lopez, E. Brewer, C. Zhao, J. Qian, K. Cho, H. He, Q. Sun, H. Vo, J.P. Bello, M. Krone, C. Silva
[★ Best Paper Honorable Mention Award ★] IEEE Transactions on Visualization and Computer Graphics (VIS 2023)

Imperceptible Color Modulation for Power Saving in VR/AR

Kenneth Chen, Budmonde Duinkharjav, Nisarg Ujjainkar, Ethan Shahan, Abhishek Tyagi, Jiayi He, Yuhao Zhu, Qi Sun
SIGGRAPH 2023 Emerging Technologies

Toward Optimized VR/AR Ergonomics: Modeling and Predicting User Neck Muscle Contraction

Yunxiang Zhang, Kenneth Chen, Qi Sun
PDF Video Code

Reconstructing Room Scales with a Single Sound for Augmented Reality Displays

Benjamin Liang, Andrew Liang, Iran Roman, Tomer Weiss, Budmonde Duinkharjav, Juan Pablo Bello, Qi Sun
Journal of Information Display 2023 (invited article)

FoV-NeRF: Foveated Neural Radiance Fields for Virtual Reality

Nianchen Deng, Zhenyi He, Jiannan Ye, Budmonde Duinkharjav, Praneeth Chakravarthula, Xubo Yang, Qi Sun
[★ Best Journal Paper Award ★] IEEE TVCG (presented at ISMAR 2022 & SIGGRAPH 2023)
PDF Video Code

Color-Perception-Guided Display Power Reduction for Virtual Reality

Budmonde Duinkharjav*, Kenneth Chen*, Abhishek Tyagi, Jiayi He, Yuhao Zhu*, Qi Sun*
ACM Transactions on Graphics (SIGGRAPH Asia 2022)
PDF Video Code

Force-Aware Interface via Electromyography for Natural VR/AR Interaction

Yunxiang Zhang, Benjamin Liang, Boyuan Chen, Paul Torrens, S. Farokh Atashzar, Dahua Lin, Qi Sun
ACM Transactions on Graphics (SIGGRAPH Asia 2022)
PDF Video Code

Image Features Influence Reaction Time: A Learned Probabilistic Perceptual Model for Saccade Latency

Budmonde Duinkharjav, Praneeth Chakravarthula, Rachel Brown, Anjul Patney, Qi Sun
[★ Best Paper Award ★] ACM Transactions on Graphics (SIGGRAPH 2022)
PDF Video Supp Materials NVIDIA Page Code

Joint Neural Phase Retrieval and Compression for Energy- and Computation-efficient Holography on the Edge

Yujie Wang, Praneeth Chakravarthula, Qi Sun, Baoquan Chen
[★ Best Paper Honorable Mention Award ★] ACM Transactions on Graphics (SIGGRAPH 2022)
PDF Code

Tailored Reality: Perception-Aware Scene Restructuring for Adaptive VR Navigation

Zhi-Chao Dong; Wenming Wu; Zenghao Xu; Qi Sun; Guanjie Yuan; Ligang Liu; Xiao-Ming Fu
ACM Transactions on Graphics 2021 (presented at SIGGRAPH 2022)
PDF Video

Larger visual changes compress time: The inverted effect of asemantic visual features on interval time perception

Sandra Malpica, Belen Masia, Laura Herman, Gordon Wetzstein, David Eagleman, Diego Gutierrez, Zoya Bylinskii, Qi Sun
PDF Video Data

Modeling and Optimizing Human-in-the-Loop Visual Perception Using Immersive Displays: A Review

Qi Sun, Budmonde Duinkharjav, Anjul Patney
SID Symposium Digest of Technical Papers 2022 (invited article)

Dually Noted: Layout-Aware Annotations with Smartphone Augmented Reality

Jing Qian, Qi Sun, Curtis Wigington, Han Han, Tong Sun, Jennifer Healey, James Tompkin, Jeff Huang
ACM Conference on Human Factors in Computing Systems (CHI) 2022
PDF Video

Instant Reality: Gaze-Contingent Perceptual Optimization for 3D Virtual Reality Streaming

Shaoyu Chen, Budmonde Duinkharjav, Xin Sun, Li-Yi Wei, Stefano Petrangeli, Jose Echevarria, Claudio Silva, Qi Sun
IEEE Transactions on Visualization and Computer Graphics (Proceedings of IEEE VR) 2022
PDF Video Code

Leveraging Human Visual Perception for an Optimized Virtual Reality Experience

Qi Sun
IEEE Computer Graphics & Applications (Invited Article) 2021

Gaze-Contingent Retinal Speckle Suppression for Perceptually-Matched Foveated Holographic Displays

Praneeth Chakravarthula; Zhan Zhang; Okan Tarhan Tursun; Piotr Didyk; Qi Sun; Henry Fuchs
IEEE Transactions on Visualization and Computer Graphics (Proceedings of ISMAR) 2021

Deep Multi Depth Panoramas for View Synthesis

Kai-En Lin, Zexiang Xu, Ben Mildenhall, Pratul P. Srinivasan, Yannick Hold-Geoffroy, Stephen DiVerdi, Qi Sun, Kalyan Sunkavalli, Ravi Ramamoorthi
ECCV 2020
PDF Video Code

Has Half the Time Passed? Investigating Time Perception at Long Scales

Sandra Malpica, Belen Masia, Laura Herman, Gordon Wetzstein, David Eagleman, Diego Gutierrez, Zoya Bylinskii, Qi Sun
Vision Science Society 2020

DiffTaichi: Differentiable Programming for Physical Simulation

Yuanming Hu, Luke Anderson, Tzu-Mao Li, Qi Sun, Nathan Carr, Jonathan Ragan-Kelley, Frédo Durand
ICLR 2020
PDF Video Two-Minute Papers Video Code

Real VR – Importing the Real World into Immersive VR and Optimizing the Perceptual Experience of Head-Mounted Displays

Editors: Marcus Magnor, Alexander Sorkine-Hornung
Springer Lecture Notes in Computer Science
Dagstuhl Report Amazon

Eccentricity Effects on Blur and Depth Perception

Qi Sun, Fu-Chung Huang, Li-Yi Wei, David Luebke, Arie Kaufman, Joohwan Kim
OSA Optics Express, Vol.28 No.5, 2020

Reducing Simulator Sickness with Perceptual Camera Control

Ping Hu, Qi Sun, Piotr Didyk, Li-Yi Wei, Arie Kaufman
SIGGRAPH Asia 2019
PDF Video

A Transparent Display with Per-Pixel Color and Opacity Control

TJ Rhodes, Gavin Miller, Qi Sun, Daichi Ito, Li-Yi Wei
SIGGRAPH 2019 Emerging Technologies
Paper Video

Learning to Reconstruct 3D Manhattan Wireframes from a Single Image

Yichao Zhou, Haozhi Qi, Simon Zhai, Qi Sun, Zhili Chen, Li-Yi Wei, Yi Ma
ICCV 2019 (Oral Presentation)
PDF Video Code PDF

Towards Virtual Reality Infinite Walking: Dynamic Saccadic Redirection

Qi Sun, Anjul Patney, Li-Yi Wei, Omer Shapira, Jingwan Lu, Paul Asente, Suwen Zhu, Morgan McGuire, David Luebke, Arie Kaufman
SIGGRAPH 2018 (Live Demo at GTC 2018)
PDF Video GTC 2018 Video Two-Minute Papers Video BBC Click

Computational Methods for Immersive Perception

Thesis Committee: Arie Kaufman, Hong Qin, Xiaojun Bi, David Luebke, Li-Yi Wei
IEEE VR 2019 Best Dissertation Award

Perceptually-Guided Foveation for Light Field Displays

Qi Sun, Fu-Chung Huang, Joohwan Kim, Li-Yi Wei, David Luebke, Arie Kaufman
SIGGRAPH Asia 2017
PDF Video

Mapping Virtual and Physical Reality

Qi Sun, Li-Yi Wei, Arie Kaufman
PDF Video Cardboard Clips Sample Scene and Mapping Data

Benefits of 3D Immersion for Virtual Colonoscopy

Koosha Mirhosseini, Qi Sun, Krishna Gurijala, Bireswar Laha, Arie Kaufman
IEEE 3DVis 2014