Deep, dense and accurate 3D face correspondence for generating population specific deformable models

    Research output: Contribution to journalArticle

    21 Citations (Scopus)
    380 Downloads (Pure)

    Abstract

    We present a multilinear algorithm to automatically establish dense point-to-point correspondence over an arbitrarily large number of population specific 3D faces across identities, facial expressions and poses. The algorithm is initialized with a subset of anthropometric landmarks detected by our proposed Deep Landmark Identification Network which is trained on synthetic images. The landmarks are used to segment the 3D face into Voronoi regions by evolving geodesic level set curves. Exploiting the intrinsic features of these regions, we extract discriminative keypoints on the facial manifold to elastically match the regions across faces for establishing dense correspondence. Finally, we generate a Region based 3D Deformable Model which is fitted to unseen faces to transfer the correspondences. We evaluate our algorithm on the tasks of facial landmark detection and recognition using two benchmark datasets. Comparison with thirteen state-of-the-art techniques shows the efficacy of our algorithm.
    Original languageEnglish
    Pages (from-to)238-250
    JournalPattern Recognition
    Volume69
    DOIs
    Publication statusPublished - Sep 2017

    Fingerprint Dive into the research topics of 'Deep, dense and accurate 3D face correspondence for generating population specific deformable models'. Together they form a unique fingerprint.

  • Cite this