Skip to content

Research at St Andrews

Vesselness features and the inverse compositional AAM for robust face recognition sing thermal IR

Research output: ResearchConference contribution

Author(s)

Reza Shoja Ghiass, Oggie Arandelovic, Hakim Bendada, Xavier Maldague

School/Research organisations

Abstract

Over the course of the last decade, infrared (IR) and particularly thermal IR imaging based face recognition has emerged as a promising complement to conventional, visible spectrum based approaches which continue to struggle when applied in the real world. While inherently insensitive to visible spectrum illumination changes, IR images introduce specific challenges of their own, most notably sensitivity to factors which affect facial heat emission patterns, e.g. emotional state, ambient temperature, and alcohol intake. In addition, facial expression and pose changes are more difficult to correct in IR images because the y are less rich in high frequency detail which is an important cue for fitting any deformable model. In this paper we describe a novel method which addresses the se major challenges. Specifically, to normalize for pose and facial expression changes we generate a synthetic frontal image of a face in a canonical, neutral facial expression from an image of the face in an arbitrary pose and facial expression. This is achieved by piecewise affine warping which follows active appearance model (AAM) fitting. This is the first publication which explores the use of an AAM on thermal IR images; we propose a pre-processing step which enhances detail in thermal images, making AAM convergence faster and more accurate. To overcome the problem of thermal IR image sensitivity to the exact pattern of facial temperature emissions we describe a representation based on reliable anatomical features. In contrast to previous approaches, our representation is not binary; rather, our method accounts for the reliability of the extracted features. This makes the proposed representation much more robust both to pose and scale changes. The effectiveness of the proposed approach is demonstrated on the largest public database of thermal IR images of faces on which it achieved 100% identification rate, significantly outperforming previously described methods.

Close

Details

Original languageEnglish
Title of host publicationProceedings of the 27th AAAI Conference on Artificial Intelligence, AAAI 2013
Pages357-364
Number of pages8
StatePublished - 2013
Event27th AAAI Conference on Artificial Intelligence, AAAI 2013 - Bellevue, WA, United States
Duration: 14 Jul 201318 Jul 2013

Conference

Conference27th AAAI Conference on Artificial Intelligence, AAAI 2013
CountryUnited States
CityBellevue, WA
Period14/07/1318/07/13

Discover related content
Find related publications, people, projects and more using interactive charts.

View graph of relations

Related by author

  1. Discovering topic structures of a temporally evolving document corpus

    Beykikhoshk, A., Arandelovic, O., Phung, D. & Venkatesh, S. 10 Aug 2017 In : Knowledge and Information Systems. 55, 3, p. 599-632 34 p.

    Research output: Research - peer-reviewArticle

  2. Machine learning based prediction of consumer purchasing decisions: the evidence and its significance

    Stubseid, S. & Arandelovic, O. 2 Feb 2018 Thirty-Second AAAI Conference on Artificial Intelligence: February 2-7, 2018, New Orleans, Louisiana. Palo Alto: AAAI Press

    Research output: ResearchConference contribution

  3. Baseline fusion for image an pattern recognition - what not to do (and how to do better)

    Arandelovic, O. Dec 2017 In : Journal of Imaging. 3, 4, 16 p., 44

    Research output: Research - peer-reviewArticle

ID: 242480483