Hierarchical sparse spectral clustering for image set classification

Arif Mahmood, Ajmal Mian

    Research output: Chapter in Book/Conference paperConference paperpeer-review

    5 Citations (Scopus)


    We present a structural matching technique for robust classification based on image sets. In set based classification, a probe set is matched with a number of gallery sets and assigned the label of the most similar set. We represent each image set by a sparse dictionary and compute a similarity matrix by matching all the dictionary atoms of the gallery and probe sets. The similarity matrix comprises the sparse coding coefficients and forms a fully connected directed graph. The nodes of the graph are the dictionary atoms and the edges are the sparse coefficients. The graph is converted to an undirected graph with positive edge weights and spectral clustering is used to cut the graph into two balanced partitions using the normalized cut algorithm. This process is repeated until the graph reduces to critical and non-critical partitions. A critical partition contains atoms with the same gallery label along with one or more probe atoms whereas a non-critical partition either consists of only probe atoms or atoms with multiple gallery labels with no probe atom. Using the critical partitions, we define a novel set based similarity measure and assign the probe set the label of the gallery set with maximum similarity. The proposed algorithm is applied to image set based face recognition using two standard databases. Comparison with existing techniques shows the validity and robustness of our algorithm in the presence of outlier images.
    Original languageEnglish
    Title of host publicationProceedings of the British Machine Vision Conference 2012
    Place of PublicationUK
    PublisherBMVA Press
    ISBN (Print)1901725464
    Publication statusPublished - 2012
    EventBritish Machine Vision Conference 2012 - Surrey, United Kingdom
    Duration: 3 Sept 20127 Sept 2012


    ConferenceBritish Machine Vision Conference 2012
    Abbreviated titleBMVC 2012
    Country/TerritoryUnited Kingdom


    Dive into the research topics of 'Hierarchical sparse spectral clustering for image set classification'. Together they form a unique fingerprint.

    Cite this