Hidden Markov model analysis reveals the advantage of analytic eye movement patterns in face recognition across cultures

Tim Chuk, Kate Crookes, William G. Hayward, Antoni B. Chan, Janet H. Hsiao

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

It remains controversial whether culture modulates eye movement behavior in face recognition. Inconsistent results have been reported regarding whether cultural differences in eye movement patterns exist, whether these differences affect recognition performance, and whether participants use similar eye movement patterns when viewing faces from different ethnicities. These inconsistencies may be due to substantial individual differences in eye movement patterns within a cultural group. Here we addressed this issue by conducting individual-level eye movement data analysis using hidden Markov models (HMMs). Each individual's eye movements were modeled with an HMM. We clustered the individual HMMs according to their similarities and discovered three common patterns in both Asian and Caucasian participants: holistic (looking mostly at the face center), left-eye-biased analytic (looking mostly at the two individual eyes in addition to the face center with a slight bias to the left eye), and right-eye-based analytic (looking mostly at the right eye in addition to the face center). The frequency of participants adopting the three patterns did not differ significantly between Asians and Caucasians, suggesting little modulation from culture. Significantly more participants (75%) showed similar eye movement patterns when viewing own- and other-race faces than different patterns. Most importantly, participants with left-eye-biased analytic patterns performed significantly better than those using either holistic or right-eye-biased analytic patterns. These results suggest that active retrieval of facial feature information through an analytic eye movement pattern may be optimal for face recognition regardless of culture.

Original languageEnglish
Pages (from-to)102-117
Number of pages16
JournalCognition
Volume169
DOIs
Publication statusPublished - 1 Dec 2017

Fingerprint

model analysis
Eye Movements
Caucasian
cultural difference
data analysis
ethnicity
Facial Recognition
Face Recognition
Hidden Markov Model
Individuality
trend
performance
Group

Cite this

Chuk, Tim ; Crookes, Kate ; Hayward, William G. ; Chan, Antoni B. ; Hsiao, Janet H. / Hidden Markov model analysis reveals the advantage of analytic eye movement patterns in face recognition across cultures. In: Cognition. 2017 ; Vol. 169. pp. 102-117.
@article{a366ba4fa8b645fc9fb97c3e3ae61380,
title = "Hidden Markov model analysis reveals the advantage of analytic eye movement patterns in face recognition across cultures",
abstract = "It remains controversial whether culture modulates eye movement behavior in face recognition. Inconsistent results have been reported regarding whether cultural differences in eye movement patterns exist, whether these differences affect recognition performance, and whether participants use similar eye movement patterns when viewing faces from different ethnicities. These inconsistencies may be due to substantial individual differences in eye movement patterns within a cultural group. Here we addressed this issue by conducting individual-level eye movement data analysis using hidden Markov models (HMMs). Each individual's eye movements were modeled with an HMM. We clustered the individual HMMs according to their similarities and discovered three common patterns in both Asian and Caucasian participants: holistic (looking mostly at the face center), left-eye-biased analytic (looking mostly at the two individual eyes in addition to the face center with a slight bias to the left eye), and right-eye-based analytic (looking mostly at the right eye in addition to the face center). The frequency of participants adopting the three patterns did not differ significantly between Asians and Caucasians, suggesting little modulation from culture. Significantly more participants (75{\%}) showed similar eye movement patterns when viewing own- and other-race faces than different patterns. Most importantly, participants with left-eye-biased analytic patterns performed significantly better than those using either holistic or right-eye-biased analytic patterns. These results suggest that active retrieval of facial feature information through an analytic eye movement pattern may be optimal for face recognition regardless of culture.",
keywords = "Eye movement, Face recognition, Hidden Markov model",
author = "Tim Chuk and Kate Crookes and Hayward, {William G.} and Chan, {Antoni B.} and Hsiao, {Janet H.}",
year = "2017",
month = "12",
day = "1",
doi = "10.1016/j.cognition.2017.08.003",
language = "English",
volume = "169",
pages = "102--117",
journal = "Cognition",
issn = "0010-0277",
publisher = "Elsevier",

}

Hidden Markov model analysis reveals the advantage of analytic eye movement patterns in face recognition across cultures. / Chuk, Tim; Crookes, Kate; Hayward, William G.; Chan, Antoni B.; Hsiao, Janet H.

In: Cognition, Vol. 169, 01.12.2017, p. 102-117.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Hidden Markov model analysis reveals the advantage of analytic eye movement patterns in face recognition across cultures

AU - Chuk, Tim

AU - Crookes, Kate

AU - Hayward, William G.

AU - Chan, Antoni B.

AU - Hsiao, Janet H.

PY - 2017/12/1

Y1 - 2017/12/1

N2 - It remains controversial whether culture modulates eye movement behavior in face recognition. Inconsistent results have been reported regarding whether cultural differences in eye movement patterns exist, whether these differences affect recognition performance, and whether participants use similar eye movement patterns when viewing faces from different ethnicities. These inconsistencies may be due to substantial individual differences in eye movement patterns within a cultural group. Here we addressed this issue by conducting individual-level eye movement data analysis using hidden Markov models (HMMs). Each individual's eye movements were modeled with an HMM. We clustered the individual HMMs according to their similarities and discovered three common patterns in both Asian and Caucasian participants: holistic (looking mostly at the face center), left-eye-biased analytic (looking mostly at the two individual eyes in addition to the face center with a slight bias to the left eye), and right-eye-based analytic (looking mostly at the right eye in addition to the face center). The frequency of participants adopting the three patterns did not differ significantly between Asians and Caucasians, suggesting little modulation from culture. Significantly more participants (75%) showed similar eye movement patterns when viewing own- and other-race faces than different patterns. Most importantly, participants with left-eye-biased analytic patterns performed significantly better than those using either holistic or right-eye-biased analytic patterns. These results suggest that active retrieval of facial feature information through an analytic eye movement pattern may be optimal for face recognition regardless of culture.

AB - It remains controversial whether culture modulates eye movement behavior in face recognition. Inconsistent results have been reported regarding whether cultural differences in eye movement patterns exist, whether these differences affect recognition performance, and whether participants use similar eye movement patterns when viewing faces from different ethnicities. These inconsistencies may be due to substantial individual differences in eye movement patterns within a cultural group. Here we addressed this issue by conducting individual-level eye movement data analysis using hidden Markov models (HMMs). Each individual's eye movements were modeled with an HMM. We clustered the individual HMMs according to their similarities and discovered three common patterns in both Asian and Caucasian participants: holistic (looking mostly at the face center), left-eye-biased analytic (looking mostly at the two individual eyes in addition to the face center with a slight bias to the left eye), and right-eye-based analytic (looking mostly at the right eye in addition to the face center). The frequency of participants adopting the three patterns did not differ significantly between Asians and Caucasians, suggesting little modulation from culture. Significantly more participants (75%) showed similar eye movement patterns when viewing own- and other-race faces than different patterns. Most importantly, participants with left-eye-biased analytic patterns performed significantly better than those using either holistic or right-eye-biased analytic patterns. These results suggest that active retrieval of facial feature information through an analytic eye movement pattern may be optimal for face recognition regardless of culture.

KW - Eye movement

KW - Face recognition

KW - Hidden Markov model

UR - http://www.scopus.com/inward/record.url?scp=85028723416&partnerID=8YFLogxK

U2 - 10.1016/j.cognition.2017.08.003

DO - 10.1016/j.cognition.2017.08.003

M3 - Article

VL - 169

SP - 102

EP - 117

JO - Cognition

JF - Cognition

SN - 0010-0277

ER -