Bimodal human emotion classification in the speaker-dependent scenario. | Proceedings of Pakistan Academy of Sciences 2015

Author(s)

Sanaul-Haq Department of Electronics, University of Peshawar, Peshawar, Pakistan

Tariqullah Jan Department of Electrical Engineering, University of Engineering & Technology, Peshawar, Pakistan

Asiya Jehangir Department of Electrical Engineering, University of Engineering & Technology, Peshawar, Pakistan

Muhammad Asif Department of Electronics, University of Peshawar, Peshawar, Pakistan

Amjad Ali Department of Electrical Engineering, Sarhad University of Science and Information Technology, Peshawar, Pakistan

Naveed Ahmad Department of Computer Science, University of Peshawar, Peshawar, Pakistan

Abstract

This paper investigates the recognition of expressed emotion from speech and facial expressions for the speaker-dependent task. The experiments were performed to develop a baseline system for the audio-visual emotion classification, and to investigate different ways of combining the audio and visual information to achieve better emotion classification. The extracted features were composed of 106 audio and 240 visual features. The audio features consisted of pitch, energy, duration and MFCC features, whereas the visual features were related to positions of the 2D marker coordinates. The Plus l-Take Away r algorithm was used for feature selection based on the Mahalanobis distance, Bhattacharyya distance, and KL-divergence as selection criteria. The feature selection was followed by feature reduction using the PCA and LDA, and classification using the Gaussian classifier. Both unimodal and bimodal approaches were used for emotion classification. The audio-visual fusion was investigated at two different levels: feature- level and decision-level. The emotion classification results comparable to human performance were achieved on the SAVEE database.

Publication Details

Page(s) 27-38

DOI DOI not available

Published Journal: Proceedings of Pakistan Academy of Sciences, Volume: 52, Issue: 1, Year: 2015

Keywords

Keywords are not available for this article.

References

References are not available for this document.

Citations

Citations are not available for this document.