Learning interpretable expression-sensitive features for 3D dynamic facial expression recognition

Mingliang Xue, Ajmal Mian, Xiaodong Duan, Wanquan Liu

Research output: Chapter in Book/Conference paperConference paper

1 Citation (Scopus)

Abstract

Different facial components carry different amount of information being conveyed for 3D dynamic expression recognition. Hence, identifying facial components that are highly relevant to specific expression changes is crucial for discriminative facial expression recognition. This work aims to learn expression-sensitive features, which are expected to not only yield comparable recognition performance with the state-of-the-art ones, but also can be interpreted by human. Firstly, spatio-temporal features (HOG3D) are extracted from local depth patch-sequences to represent facial expression dynamics. A two-phase feature selection process is then proposed to determine the facial components that can best distinguish the expressions. In order to verify the effectiveness of the resulting facial components, the expression-sensitive features from the corresponding area are fed into a hierarchical classifier for facial expression recognition. The proposed method is evaluated on the BU-4DFE benchmark database, and results show that learned expression-sensitive features can achieve a comparable recognition performance with existing methods. Additionally, the resulting HOG3D features after feature selection can be used to generate semantic interpretation of the expression dynamics.

Original languageEnglish
Title of host publicationProceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019
PublisherIEEE, Institute of Electrical and Electronics Engineers
ISBN (Electronic)9781728100890
DOIs
Publication statusPublished - 2019
Event14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019 - Lille, France
Duration: 14 May 201918 May 2019

Publication series

NameProceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019

Conference

Conference14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019
CountryFrance
CityLille
Period14/05/1918/05/19

Fingerprint Dive into the research topics of 'Learning interpretable expression-sensitive features for 3D dynamic facial expression recognition'. Together they form a unique fingerprint.

Cite this