Face recognition using sparse approximated nearest points between image sets

    Research output: Contribution to journalArticlepeer-review

    154 Citations (Scopus)


    We propose an efficient and robust solution for image set classification. A joint representation of an image set is proposed which includes the image samples of the set and their affine hull model. The model accounts for unseen appearances in the form of affine combinations of sample images. To calculate the between-set distance, we introduce the Sparse Approximated Nearest Point (SANP). SANPs are the nearest points of two image sets such that each point can be sparsely approximated by the image samples of its respective set. This novel sparse formulation enforces sparsity on the sample coefficients and jointly optimizes the nearest points as well as their sparse approximations. Unlike standard sparse coding, the data to be sparsely approximated are not fixed. A convex formulation is proposed to find the optimal SANPs between two sets and the accelerated proximal gradient method is adapted to efficiently solve this optimization. We also derive the kernel extension of the SANP and propose an algorithm for dynamically tuning the RBF kernel parameter while matching each pair of image sets. Comprehensive experiments on the UCSD/Honda, CMU MoBo, and YouTube Celebrities face datasets show that our method consistently outperforms the state of the art.
    Original languageEnglish
    Pages (from-to)1992-2004
    JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
    Issue number10
    Early online date3 Jan 2012
    Publication statusPublished - 15 Aug 2012


    Dive into the research topics of 'Face recognition using sparse approximated nearest points between image sets'. Together they form a unique fingerprint.

    Cite this