Visual Attention Analysis in Immersive Virtual Reality
Zhiming Hu, Sheng Li, and Meng Gai
Background Eye tracking technology is receiving increased attention in the field of virtual reality. Specifically, future gaze prediction is crucial in pre-computation for many applications such as gaze-contingent rendering, advertisement placement, and content-based design. To explore future gaze prediction, it is necessary to analyze the temporal continuity of visual attention in immersive virtual reality. Methods In this paper, the concept of temporal continuity of visual attention is presented. Subsequently, an autocorrelation function method is proposed to evaluate the temporal continuity. Thereafter, the temporal continuity is analyzed in both free-viewing and task-oriented conditions. Results Specifically, in free-viewing conditions, the analysis of a free-viewing gaze dataset indicates that the temporal continuity performs well only within a short time interval. A task-oriented game scene condition was created and conducted to collect users' gaze data. An analysis of the collected gaze data finds the temporal continuity has a similar performance with that of the free-viewing conditions. Temporal continuity can be applied to future gaze prediction and if it is good, users' current gaze positions can be directly utilized to predict their gaze positions in the future. Conclusions The current gaze's future prediction performances are further evaluated in both free-viewing and task-oriented conditions and discover that the current gaze can be efficiently applied to the task of short-term future gaze prediction. The task of long-term gaze prediction still remains to be explored.
Our related work:
EHTask: Recognizing User Tasks from Eye and Head Movements in Immersive Virtual Reality
Research progress of user task prediction and algorithm analysis (in Chinese)
Eye Fixation Forecasting in Task-Oriented Virtual Reality
FixationNet: Forecasting Eye Fixations in Task-Oriented Virtual Environments
Gaze Analysis and Prediction in Virtual Reality
DGaze: CNN-Based Gaze Prediction in Dynamic Scenes
SGaze: A Data-Driven Eye-Head Coordination Model for Realtime Gaze Prediction