Speech Emotion Recognition Using Spectrogram Patterns as Features

Abstract

In this paper we tackle the problem of identifying emotions from speech by using features derived from spectrogram patterns. Towards this goal we create a spectrogram for each speech signal. Produced spectrograms are divided into non-overlapping partitions based on different frequency ranges. After performing a discretization operation on each partition we mine partition-specific patterns that discriminate an emotion from all other emotions. A classifier is then trained with features obtained from the extracted patterns. Our experimental evaluations indicate that the spectrogram-based patterns outperform the standard set of acoustic features. It is also shown that the results can further be improved with the increasing number of spectrogram partitions. © 2020 Elsevier B.V. All rights reserved.