sig18 vri ui0

Towards Virtual Reality Infinite Walking: Dynamic Saccadic Redirection

Towards Virtual Reality Infinite Walking: Dynamic Saccadic Redirection

Qi Sun, Anjul Patney, Li-Yi Wei, Omer Shapira, Jingwan Lu, Paul Asente, Suwen Zhu, Morgan McGuire, David Luebke, Arie Kaufman
SIGGRAPH 2018 and Demoed at GPU Technology Conference (GTC) 2018
PDF Video GTC 2018 Video Two-Minute Papers Video BBC Click
All Research

Abstract

Redirected walking techniques can enhance the immersion and visual-vestibular comfort of virtual reality (VR) navigation, but are often limited by the size, shape, and content of the physical environments.

We propose a redirected walking technique that can apply to small physical environments with static or dynamic obstacles. Via a head- and eye-tracking VR headset, our method detects saccadic suppression and redirects the users during the resulting temporary blindness. Our dynamic path planning runs in real-time on a GPU, and thus can avoid static and dynamic obstacles, including walls, furniture, and other VR users sharing the same physical space. To further enhance saccadic redirection, we propose subtle gaze direction methods tailored for VR perception.

We demonstrate that saccades can significantly increase the rotation gains during redirection without introducing visual distortions or simulator sickness. This allows our method to apply to large open virtual spaces and small physical environments for room-scale VR. We evaluate our system via numerical simulations and real user studies.

Bibtex

@article{Sun:2018,
author = {Sun, Qi and Patney, Anjul and Wei, Li-Yi and Shapira, Omer and Lu, Jingwan and Asente, Paul and Zhu, Suwen and Mcguire, Morgan and Luebke, David and Kaufman, Arie},
title = {Towards Virtual Reality Infinite Walking: Dynamic Saccadic Redirection},
year = {2018},
issue_date = {August 2018},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
volume = {37},
number = {4},
issn = {0730-0301},
url = {https://doi.org/10.1145/3197517.3201294},
doi = {10.1145/3197517.3201294},
journal = {ACM Trans. Graph.},
month = jul,
articleno = {67},
numpages = {13},
keywords = {human perception, virtual reality, saccade, redirected walking}
}



gtc user

A GTC User

gtc hmd path cropped

GTC HMD Path

GTC 2018

GTC 2018

Walking is good for our health, and can improve perceptual comfort in virtual reality (VR) applications. Similar to car sickness, VR simulator sickness happens when what our eyes see differ from what our bodies feel. Redirected walking is a technique that guides users to walk in a physical environment while they perceive a virtual environment via head mounted displays (HMD). A key challenge for redirected walking is to keep users safe without bumping into other stationary or dynamic objects while bridging the size and shape differences of the virtual and physical environments. In particular, virtual environments are usually large and rich, and yet the physical rooms are often limited due to real-estate space and tracking equipment.

This project significantly expands the allowable size difference between the virtual and physical environments by exploiting temporal blindness in human visual systems. We look specifically at saccades, which are rapid eye movements during which the visual signals are temporarily blocked but not perceivable due to brain interpolation. Thus, during saccades, we can change the virtual cameras inside the HMD to nudge users walk in the desired directions (e.g. away from walls) without them noticing the camera changes.

As a collaboration between Adobe, NVIDIA, and Stony Brook University, this technology has been demonstrated as a live demo in GTC 2018 via a chess game. As shown in the left image, a user wearing a HMD is being guided by a researcher. She can perceive a virtual classroom inside her HMD, while being guided by our system to walk on a virtual chessboard, as shown in the right image. The overlaid image on the right shows the virtual path (in red) and real path (in green), which can be very different and yet non-perceivable by the user.

This technology makes room-scale redirected walking in VR more feasible, so that one day users can play a large virtual online game while walking around in their small physical rooms. We will talk about more details in an upcoming technical paper in SIGGRAPH 2018.