Auxiliary Classifier Generative Adversarial Network with Soft Labels in Imbalanced Acoustic Event Detection

Xianjun Xia, Roberto Togneri, Ferdous Sohel, David Huang

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

In acoustic event detection, the training data size of some acoustic events are often small and imbalanced. To deal with these, this paper proposes to generate the virtual training data categorically using the auxiliary classifier generative adversarial networks. Soft labels of acoustic events are first calculated to represent the acoustic event localization information. The closer the current frame is to the middle of the manually labeled acoustic event, the higher the soft label will be, which makes the soft labels positively correlated to the acoustic event localization. Then the acoustic event class and the quantized soft labels are used as the input condition to the auxiliary classifier generative adversarial networks to generate arbitrary number of training samples. Experimental results on the TUT Sound Event 2016 under the home environment and TUT Sound Event 2017 under the street environment demonstrate the improved performance of the proposed technique compared to existing acoustic event detection systems.

Original languageEnglish
Pages (from-to)1359-1371
JournalIEEE Transactions on Multimedia
Volume21
Issue number6
Early online date1 Jan 2018
DOIs
Publication statusPublished - Jun 2019

Fingerprint Dive into the research topics of 'Auxiliary Classifier Generative Adversarial Network with Soft Labels in Imbalanced Acoustic Event Detection'. Together they form a unique fingerprint.

Cite this