Quantifying dynamic facial expressions under naturalistic conditions

Jayson Jeganathan, Megan Campbell, Matthew Hyett, Gordon Parker, Michael Breakspear

Research output: Contribution to journalArticlepeer-review

Abstract

Facial affect is expressed dynamically - a giggle, grimace, or an agitated frown. However, the characterisation of human affect has relied almost exclusively on static images. This approach cannot capture the nuances of human communication or support the naturalistic assessment of affective disorders. Using the latest in machine vision and systems modelling, we studied dynamic facial expressions of people viewing emotionally salient film clips. We found that the apparent complexity of dynamic facial expressions can be captured by a small number of simple spatiotemporal states - composites of distinct facial actions, each expressed with a unique spectral fingerprint. Sequential expression of these states is common across individuals viewing the same film stimuli but varies in those with the melancholic subtype of major depressive disorder. This approach provides a platform for translational research, capturing dynamic facial expressions under naturalistic conditions and enabling new quantitative tools for the study of affective disorders and related mental illnesses.

Original languageEnglish
Article numbere79581
Number of pages20
JournaleLife
Volume11
DOIs
Publication statusPublished - 31 Aug 2022

Fingerprint

Dive into the research topics of 'Quantifying dynamic facial expressions under naturalistic conditions'. Together they form a unique fingerprint.

Cite this