Range Image Sensor Based Eye Gaze Estimation by Using the Relationship Between the Face and Eye Directions

Haruya Tamaki; Tsugunosuke Sakai; Yosuke Ota; Fusako Kusunoki; Shigenori Inagaki; Ryohei Egusa; Masanori Sugimoto; Hiroshi Mizoguchi

doi:10.21307/ijssis-2017-965

.blurhash-client-img { display: none !important; }

Range Image Sensor Based Eye Gaze Estimation by Using the Relationship Between the Face and Eye Directions

International Journal on Smart Sensing and Intelligent Systems

Volume 9 (2016): Issue 4 (January 2016)

By: Haruya Tamaki, Tsugunosuke Sakai, Yosuke Ota, Fusako Kusunoki, Shigenori Inagaki, Ryohei Egusa, Masanori Sugimoto and Hiroshi Mizoguchi

Open Access

|Dec 2016

Abstract

In this paper, we estimate the eye gaze by using the face direction to estimate the object of interest in an extensive area such as an educational display or museum exhibit. However, the direction of the gaze may differ from that of the face. Therefore, our approach was to use a method that utilizes both the face and eye directions to improve the accuracy of our estimation compared to only using the face direction. The first part of our study involved apprehending the relationship between the direction of the face and the eyes. The second part entailed estimating the eye gaze using this relationship. We then evaluated the effectiveness of this method in comparison to using the relationship with the face direction only.

References

Brandherm Boris, Helmut Prendinger, and Mitsuru Ishizuka, “Interest estimation based on dynamic Bayesian networks for visual attentive presentation agents.” Proceedings of the 9th International Conference on Multimodal Interfaces, ACM, pp. 346-349, 2007.10.1145/1322192.1322253
Search in Google Scholar Back to article
Newman R, Matsumoto Y, Rougeaux S, and Zelinsky A, “Real-time stereo tracking for head pose and gaze estimation.” Automatic Face and Gesture Recognition, Proceedings Fourth IEEE International Conference on, IEEE, pp. 122-128, 2000.
Search in Google Scholar Back to article
Huang Chi-Wu, and Chun-Wei Hu, “An wearable eye tracker for coordinates of POG estimation using 3D model.” Consumer Electronics-Taiwan (ICCE-TW), IEEE International Conference on, pp. 1-2, 2016.10.1109/ICCE-TW.2016.7520914
Search in Google Scholar Back to article
Shih-Chen Tseng, Zong-Sian Jiang, Chun-Wei Hu, “Projective Mapping Compensation for the Head Movement during Eye Tracking”, Consumer Electronics — Taiwan (ICCE-TW), IEEE International Conference on, pp. 131-132, 2014.
Search in Google Scholar Back to article
D. W. Hansen, Q. Ji, “In the Eye of the Beholder: A Survey of Models for Eyes and Gaze”, IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 32, no. 3, pp. 478-500, 2010.10.1109/TPAMI.2009.30
Search in Google Scholar Back to article
Doshi Anup and Mohan M. Trivedi, “Attention estimation by simultaneous observation of viewer and view.” Computer Vision and Pattern Recognition Workshops (CVPRW), IEEE Computer Society Conference on, pp. 21-27, 2010.10.1109/CVPRW.2010.5543272
Search in Google Scholar Back to article
Tursky, B. “Recording of human eye movements.” Bioelectric Recording Techniques Part C, Academic Press, 1974.
Search in Google Scholar Back to article
[8]Hess, B.J.M. “Dual-search coil for measuring 3-dimensional eye movements in experimental animals.” Vision Reseach 30.4, pp. 597-602, 1990.10.1016/0042-6989(90)90070-2
Back to article
Poole, Alex, and Linden J. Ball. “Eye tracking in HCI and usability research.” Encyclopedia of human computer interaction 1, pp. 211-219, 2006.10.4018/978-1-59140-562-7.ch034
Search in Google Scholar Back to article
Zhang Zhengyou, “Microsoft Kinect Sensor and its Effect,” MultiMedia, IEEE, Vol.19, No.2, pp.4-10, 2012.10.1109/MMUL.2012.24
Search in Google Scholar Back to article
T.F.Cootes, G.J Edwards, and C.J Taylor “View-based Active Appearance Model” Image and Vision Computing 20, pp.657-664, 2002.10.1016/S0262-8856(02)00055-0
Search in Google Scholar Back to article
Stegmann, Mikkel Bille. “Active appearance models.” Diss. PhD thesis, Technical University of Denmark, 125, 129, 2007.
Search in Google Scholar Back to article

Articles in this issue

DOI: https://doi.org/10.21307/ijssis-2017-965 | Journal eISSN: 1178-5608

Journal RSS Feed

Language: English

Page range: 2297 - 2309

Submitted on: Oct 15, 2016

Accepted on: Nov 2, 2016

Published on: Dec 1, 2016

Published by: Macquarie University, Australia

In partnership with: Paradigm Publishing Services

Publication frequency: 1 issue per year

Keywords:

Range image sensor,

Eye gaze direction,

Face direction,

Relationship between face and eyes,

Active Appearance Models

Related subjects:

Engineering,

Introductions and overviews,

Engineering, other

© 2016 Haruya Tamaki, Tsugunosuke Sakai, Yosuke Ota, Fusako Kusunoki, Shigenori Inagaki, Ryohei Egusa, Masanori Sugimoto, Hiroshi Mizoguchi, published by Macquarie University, Australia
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Volume 9 (2016): Issue 4 (January 2016)