Spatially optimized data-level fusion of texture and shape for face recognition

    Research output: Contribution to journalArticle

    46 Citations (Scopus)

    Abstract

    Data-level fusion is believed to have the potential for enhancing human face recognition. However, due to a number of challenges, current techniques have failed to achieve its full potential. We propose spatially optimized data/pixel-level fusion of 3-D shape and texture for face recognition. Fusion functions are objectively optimized to model expression and illumination variations in linear subspaces for invariant face recognition. Parameters of adjacent functions are constrained to smoothly vary for effective numerical regularization. In addition to spatial optimization, multiple nonlinear fusion models are combined to enhance their learning capabilities. Experiments on the FRGC v2 data set show that spatial optimization, higher order fusion functions, and the combination of multiple such functions systematically improve performance, which is, for the first time, higher than score-level fusion in a similar experimental setup.
    Original languageEnglish
    Pages (from-to)859-872
    JournalIEEE Transactions on Image Processing
    Volume21
    Issue number2
    DOIs
    Publication statusPublished - 11 Aug 2012

    Fingerprint Dive into the research topics of 'Spatially optimized data-level fusion of texture and shape for face recognition'. Together they form a unique fingerprint.

    Cite this