Skip to content

Research at St Andrews

Highly accurate and fully automatic 3D head pose estimation and eye gaze estimation using RGB-D sensors and 3D morphable models

Research output: Contribution to journalArticle

DOI

Open Access permissions

Open

Author(s)

Reza Shoja Ghiass, Ognjen Arandjelovic, Denis Laurendeau

School/Research organisations

Abstract

This work addresses the problem of automatic head pose estimation and its application in 3D gaze estimation using low quality RGB-D sensors without any subject cooperation or manual intervention. The previous works on 3D head pose estimation using RGB-D sensors require either an offline step for supervised learning or 3D head model construction, which may require manual intervention or subject cooperation for complete head model reconstruction. In this paper, we propose a 3D pose estimator based on low quality depth data, which is not limited by any of the aforementioned steps. Instead, the proposed technique relies on modeling the subject's face in 3D rather than the complete head, which, in turn, relaxes all of the constraints in the previous works. The proposed method is robust, highly accurate and fully automatic. Moreover, it does not need any offline step. Unlike some of the previous works, the method only uses depth data for pose estimation. The experimental results on the Biwi head pose database confirm the efficiency of our algorithm in handling large pose variations and partial occlusion. We also evaluated the performance of our algorithm on IDIAP database for 3D head pose and eye gaze estimation.

Close

Details

Original languageEnglish
Article number4280
Number of pages21
JournalSensors
Volume18
Issue number12
DOIs
Publication statusPublished - 5 Dec 2018

    Research areas

  • 3D morphable models, 3D head pose estimation, 3D eye gaze estimation, Iterative closest point, RGB-D sensors

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. A more principled use of the p-value? Not so fast: a critique of Colquhoun's argument

    Arandelović, O., 15 May 2019, In : Royal Society Open Science. 6, 5, 5 p., 181519.

    Research output: Contribution to journalArticle

  2. Colorectal cancer outcome prediction from H&E whole slide images using machine learning and automatically inferred phenotype profiles

    Yue, X., Dimitriou, N., Caie, P., Harrison, D. & Arandjelovic, O., 18 Mar 2019, Proceedings of 11th International Conference on Bioinformatics and Computational Biology, BICOB 2019: Honolulu; United States; 18 March 2019 through 20 March 2019. Eulenstein, O., Al-Mubaid, H. & Ding, Q. (eds.). EasyChair, p. 139-127 11 p. (EPiC Series in Computing; vol. 60).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  3. Reimagining the central challenge of face recognition: turning a problem into an advantage

    Arandelovic, O., Nov 2018, In : Pattern Recognition. 83, p. 388-400 13 p.

    Research output: Contribution to journalArticle

Related by journal

  1. Sensors (Journal)

    Ross Gillanders (Member of editorial board)
    2018 → …

    Activity: Publication peer-review and editorial work typesPeer review of manuscripts

Related by journal

  1. Modulated Raman spectroscopy for enhanced cancer diagnosis at the cellular level

    De Luca, A. C., Dholakia, K. & Mazilu, M., Jun 2015, In : Sensors. 15, 6, p. 13680-13704 25 p.

    Research output: Contribution to journalReview article

  2. Energy-efficient sensing in wireless sensor networks using compressed sensing

    Razzaque, M. A. & Dobson, S. A., 12 Feb 2014, In : Sensors. 14, 2, p. 2822-2859

    Research output: Contribution to journalArticle

  3. Slotted photonic crystal sensors

    Scullion, M. G., Krauss, T. F. & Di Falco, A., Mar 2013, In : Sensors. 13, 3, p. 3675-3710 36 p.

    Research output: Contribution to journalReview article

  4. Laser chemosensor with rapid responsivity and inherent memory based on a polymer of intrinsic microporosity

    Wang, Y., McKeown, N. B., Msayib, K. J., Turnbull, G. A. & Samuel, I. D. W., Mar 2011, In : Sensors. 11, 3, p. 2478-2487 10 p.

    Research output: Contribution to journalArticle

ID: 257462583