Recognition of Negative Emotion Using Long Short-Term Memory with Bio-Signal Feature Compression

• Main Authors: JeeEun Lee, Sun K. Yoo
• Format: Article
• Language: English
• Published: MDPI AG 2020-01-01
• Series: Sensors
• Subjects: emotion; bio-signal; auto-encoder; lstm
• Online Access: https://www.mdpi.com/1424-8220/20/2/573

Negative emotion is one reason why stress causes negative feedback. Therefore, many studies are being done to recognize negative emotions. However, emotion is difficult to classify because it is subjective and difficult to quantify. Moreover, emotion changes over time and is affected by mood. Therefore, we measured electrocardiogram (ECG), skin temperature (ST), and galvanic skin response (GSR) to detect objective indicators. We also compressed the features associated with emotion using a stacked auto-encoder (SAE). Finally, the compressed features and time information were used in training through long short-term memory (LSTM). As a result, the proposed LSTM used with the feature compression model showed the highest accuracy (99.4%) for recognizing negative emotions. The results of the suggested model were 11.3% higher than with a neural network (NN) and 5.6% higher than with SAE.