Spatially optimized data-level fusion of texture and shape for face recognition

    Research output: Contribution to journalArticlepeer-review

    50 Citations (Scopus)


    Data-level fusion is believed to have the potential for enhancing human face recognition. However, due to a number of challenges, current techniques have failed to achieve its full potential. We propose spatially optimized data/pixel-level fusion of 3-D shape and texture for face recognition. Fusion functions are objectively optimized to model expression and illumination variations in linear subspaces for invariant face recognition. Parameters of adjacent functions are constrained to smoothly vary for effective numerical regularization. In addition to spatial optimization, multiple nonlinear fusion models are combined to enhance their learning capabilities. Experiments on the FRGC v2 data set show that spatial optimization, higher order fusion functions, and the combination of multiple such functions systematically improve performance, which is, for the first time, higher than score-level fusion in a similar experimental setup.
    Original languageEnglish
    Pages (from-to)859-872
    JournalIEEE Transactions on Image Processing
    Issue number2
    Publication statusPublished - 11 Aug 2012


    Dive into the research topics of 'Spatially optimized data-level fusion of texture and shape for face recognition'. Together they form a unique fingerprint.

    Cite this