Eye Gaze Tracking in 3D Immersive Environments

doi:10.16182/j.issn1004731x.joss.201806004

Abstract

Abstract: Aiming at the problem that human-computer interaction in immersive environments is entirely dependent on the body movement with low operational efficiency,a 3D eye gaze tracking method is proposed to gain the 3D gaze point of the user. Thus the interactive operation could be achieved, which provides a natural and bidirectional way for interaction. The Leap Motion controller is innovatively used to track the coordinates of eyes and the head position is tracked with the motion capture device. The gaze point under free movement can be estimated based on the mapping equation that is obtained in the initial calibration state. Experimental results show that when user moves freely in the 3.0 m×3.2 m×2.0 m space, the frequency of estimation of 3D gaze point is up to 60 Hz and the error is within 45 mm, which lays a foundation for the wide application of eye gaze tracking in immersive virtual environments.

Key words: 3D gaze tracking, dual gaze vectors, immersive environments, free movement

CLC Number:

TP391.9

Zhao Xincan, Pan Shihao, Wang Yaping, Tie Yun. Eye Gaze Tracking in 3D Immersive Environments[J]. Journal of System Simulation, 2018, 30(6): 2027-2035.

References

[1] Hansen D W, Ji Q.In the eye of the beholder: A survey of models for eyes and gaze[J]. IEEE transactions on pattern analysis and machine intelligence (S0162-8828), 2010, 32(3): 478-500.
[2] Yoo D H, Chung M J.A novel non-intrusive eye gaze estimation using cross-ratio under large head motion[J]. Computer Vision and Image Understanding (S1077-3142), 2005, 98(1): 25-51.
[3] Zhang Z, Cai Q.Improving cross-ratio-based eye tracking techniques by leveraging the binocular fixation constraint[C]// Proceedings of the Symposium on Eye Tracking Research and Applications. ACM, 2014: 267-270.
[4] Shin Y G, Choi K A, Kim S T, et al.A novel 2-D mapping-based remote eye gaze tracking method using two IR light sources[C]// Consumer Electronics (ICCE), 2015 IEEE International Conference on. IEEE, 2015: 190-191.
[5] Zhu Z, Ji Q, Bennett K P.Nonlinear eye gaze mapping function estimation via support vector regression[C]// Pattern Recognition, 2006. ICPR 2006. 18th International Conference on. IEEE, 2006: 1132-1135.
[6] Gneo M, Schmid M, Conforto S, et al.A free geometry model-independent neural eye-gaze tracking system[J]. Journal of neuroengineering and rehabilitation (S1743-0003), 2012, 9(1): 82.
[7] Zhu Z, Ji Q.Novel eye gaze tracking techniques under natural head movement[J]. IEEE Transactions on biomedical engineering (S1558-2531), 2007, 54(12): 2246-2260.
[8] Chen J, Tong Y, Gray W, et al.A robust 3D eye gaze tracking system using noise reduction[C]// Proceedings of the 2008 symposium on Eye tracking research & applications. ACM, 2008: 189-196.
[9] Sun L, Liu Z, Sun M T.Real time gaze estimation with a consumer depth camera[J]. Information Sciences (S0020-0255), 2015, 320: 346-360.
[10] Xiong X, Cai Q, Liu Z, et al.Eye gaze tracking using an RGBD camera: a comparison with a RGB solution[C]// Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication. ACM, 2014: 1113-1121.
[11] Hou W, Ding Y, Qin X, et al.Evaluation of Cognitive Awareness Based on Dual Task Situation[C]// International Conference on Human Centered Computing. Springer, Cham, 2016: 160-171.
[12] McMurrough C, Conly C, Athitsos V, et al. A mobile, low-cost headset for 3D point of gaze estimation[J]. International Journal of Advanced Computer Science (S1819-9224), 2014, 1(1): 2-5.
[13] Marin G, Dominio F, Zanuttigh P.Hand gesture recognition with leap motion and kinect devices[C]// Image Processing (ICIP), 2014 IEEE International Conference on. IEEE, 2014: 1565-1569.
[14] Weichert F, Bachmann D, Rudak B, et al.Analysis of the accuracy and robustness of the leap motion controller[J]. Sensors (S1424-8220), 2013, 13(5): 6380-6393.
[15] Guna J, Jakus G, Pogačnik M, et al.An analysis of the precision and reliability of the leap motion sensor and its suitability for static and dynamic tracking[J]. Sensors (S1424-8220), 2014, 14(2): 3702-3720.
[16] Shao G, Che M, Zhang B, et al.A novel simple 2D model of eye gaze estimation[C]// Intelligent Human-Machine Systems and Cybernetics (IHMSC), 2010 2nd International Conference on. IEEE, 2010, 1: 300-304.
[17] Li D, Winfield D, Parkhurst D J.Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches[C]// Computer Vision and Pattern Recognition-Workshops, 2005. CVPR Workshops. IEEE Computer Society Conference on. IEEE, 2005: 79-79.
[18] Zhu Z, Ji Q.Eye gaze tracking under natural head movements[C]// Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on. IEEE, 2005: 918-923.
[19] Chambers T L, Aglawe A, Reiners D, et al.Real-time simulation for a virtual reality-based MIG welding training system[J]. Virtual Reality (S1359-4338), 2012, 16(1): 45-55.