Bimodal human emotion classification in the speaker-dependent scenario. | [Proceedings of Pakistan Academy of Sciences • 2015]

Author(s):

1. Sanaul-Haq: Department of Electronics, University of Peshawar, Peshawar, Pakistan

2. Tariqullah Jan: Department of Electrical Engineering, University of Engineering & Technology, Peshawar, Pakistan

3. Asiya Jehangir: Department of Electrical Engineering, University of Engineering & Technology, Peshawar, Pakistan

4. Muhammad Asif: Department of Electronics, University of Peshawar, Peshawar, Pakistan

5. Amjad Ali: Department of Electrical Engineering, Sarhad University of Science and Information Technology, Peshawar, Pakistan

6. Naveed Ahmad: Department of Computer Science, University of Peshawar, Peshawar, Pakistan

Abstract:

This paper investigates the recognition of expressed emotion from speech and facial expressions for the speaker-dependent task. The experiments were performed to develop a baseline system for the audio-visual emotion classification, and to investigate different ways of combining the audio and visual information to achieve better emotion classification. The extracted features were composed of 106 audio and 240 visual features. The audio features consisted of pitch, energy, duration and MFCC features, whereas the visual features were related to positions of the 2D marker coordinates. The Plus l-Take Away r algorithm was used for feature selection based on the Mahalanobis distance, Bhattacharyya distance, and KL-divergence as selection criteria. The feature selection was followed by feature reduction using the PCA and LDA, and classification using the Gaussian classifier. Both unimodal and bimodal approaches were used for emotion classification. The audio-visual fusion was investigated at two different levels: feature- level and decision-level. The emotion classification results comparable to human performance were achieved on the SAVEE database.

Page(s): 27-38

DOI: DOI not available

Published: Journal: Proceedings of Pakistan Academy of Sciences, Volume: 52, Issue: 1, Year: 2015

Keywords:

Keywords are not available for this article.

References:

References are not available for this document.

Citations

Citations are not available for this document.

Citations

Downloads

Views