Histogram of Oriented Principal Components for Cross-View Action Recognition

Hossein Rahmani, Arif Mahmood, Du Huynh, Ajmal Mian

    Research output: Contribution to journalArticle

    86 Citations (Scopus)

    Abstract

    Existing techniques for 3D action recognition are sensitive to viewpoint variations because they extract features from depth images which are viewpoint dependent. In contrast, we directly process pointclouds for cross-view action recognition from unknown and unseen views. We propose the histogram of oriented principal components (HOPC) descriptor that is robust to noise, viewpoint, scale and action speed variations. At a 3D point, HOPC is computed by projecting the three scaled eigenvectors of the pointcloud within its local spatio-temporal support volume onto the vertices of a regular dodecahedron. HOPC is also used for the detection of spatio-temporal keypoints (STK) in 3D pointcloud sequences so that view-invariant STK descriptors (or Local HOPC descriptors) at these key locations only are used for action recognition. We also propose a global descriptor computed from the normalized spatio-temporal distribution of STKs in 4-D, which we refer to as STK-D. We have evaluated the performance of our proposed descriptors against nine existing techniques on two cross-view and three single-view human action recognition datasets. The experimental results show that our techniques provide significant improvement over state-of-the-art methods.

    Original languageEnglish
    Article number7415989
    Pages (from-to)2430-2443
    Number of pages14
    JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
    Volume38
    Issue number12
    DOIs
    Publication statusPublished - 1 Dec 2016

    Fingerprint Dive into the research topics of 'Histogram of Oriented Principal Components for Cross-View Action Recognition'. Together they form a unique fingerprint.

    Cite this