Emotion Recognition Based on Skin Potential Signals with a Portable Wireless Device

Emotion recognition is of great importance for artificial intelligence, robots, and medicine etc. Although many techniques have been developed for emotion recognition, with certain successes, they rely heavily on complicated and expensive equipment.<b> </b>Skin potential (SP) has been re...

Full description

Bibliographic Details
Main Authors: Shuhao Chen, Ke Jiang, Haoji Hu, Haoze Kuang, Jianyi Yang, Jikui Luo, Xinhua Chen, Yubo Li
Format: Article
Language:English
Published: MDPI AG 2021-02-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/3/1018
id doaj-1a685bdb67b441d5982f5869cd41f7cf
record_format Article
spelling doaj-1a685bdb67b441d5982f5869cd41f7cf2021-02-03T00:05:24ZengMDPI AGSensors1424-82202021-02-01211018101810.3390/s21031018Emotion Recognition Based on Skin Potential Signals with a Portable Wireless DeviceShuhao Chen0Ke Jiang1Haoji Hu2Haoze Kuang3Jianyi Yang4Jikui Luo5Xinhua Chen6Yubo Li7College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, ChinaCollege of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, ChinaCollege of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, ChinaCollege of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, ChinaCollege of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, ChinaCollege of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, ChinaZhejiang Key Laboratory for Pulsed Power Tanslational Medicine, Hangzhou Ruidi Biotech Ltd., Hangzhou 310000, ChinaCollege of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, ChinaEmotion recognition is of great importance for artificial intelligence, robots, and medicine etc. Although many techniques have been developed for emotion recognition, with certain successes, they rely heavily on complicated and expensive equipment.<b> </b>Skin potential (SP) has been recognized to be correlated with human emotions for a long time, but has been largely ignored due to the lack of systematic research. In this paper, we propose a single SP-signal-based method for emotion recognition. Firstly, we developed a portable wireless device to measure the SP signal between the middle finger and left wrist. Then, a video induction experiment was designed to stimulate four kinds of typical emotion (happiness, sadness, anger, fear) in 26 subjects. Based on the device and video induction, we obtained a dataset consisting of 397 emotion samples. We extracted 29 features from each of the emotion samples and used eight well-established algorithms to classify the four emotions based on these features. Experimental results show that the gradient-boosting decision tree (GBDT), logistic regression (LR) and random forest (RF) algorithms achieved the highest accuracy of 75%. The obtained accuracy is similar to, or even better than, that of other methods using multiple physiological signals. Our research demonstrates the feasibility of the SP signal’s integration into existing physiological signals for emotion recognition.https://www.mdpi.com/1424-8220/21/3/1018emotion recognitiongradient-boosting decision treeskin potentialportable device
collection DOAJ
language English
format Article
sources DOAJ
author Shuhao Chen
Ke Jiang
Haoji Hu
Haoze Kuang
Jianyi Yang
Jikui Luo
Xinhua Chen
Yubo Li
spellingShingle Shuhao Chen
Ke Jiang
Haoji Hu
Haoze Kuang
Jianyi Yang
Jikui Luo
Xinhua Chen
Yubo Li
Emotion Recognition Based on Skin Potential Signals with a Portable Wireless Device
Sensors
emotion recognition
gradient-boosting decision tree
skin potential
portable device
author_facet Shuhao Chen
Ke Jiang
Haoji Hu
Haoze Kuang
Jianyi Yang
Jikui Luo
Xinhua Chen
Yubo Li
author_sort Shuhao Chen
title Emotion Recognition Based on Skin Potential Signals with a Portable Wireless Device
title_short Emotion Recognition Based on Skin Potential Signals with a Portable Wireless Device
title_full Emotion Recognition Based on Skin Potential Signals with a Portable Wireless Device
title_fullStr Emotion Recognition Based on Skin Potential Signals with a Portable Wireless Device
title_full_unstemmed Emotion Recognition Based on Skin Potential Signals with a Portable Wireless Device
title_sort emotion recognition based on skin potential signals with a portable wireless device
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2021-02-01
description Emotion recognition is of great importance for artificial intelligence, robots, and medicine etc. Although many techniques have been developed for emotion recognition, with certain successes, they rely heavily on complicated and expensive equipment.<b> </b>Skin potential (SP) has been recognized to be correlated with human emotions for a long time, but has been largely ignored due to the lack of systematic research. In this paper, we propose a single SP-signal-based method for emotion recognition. Firstly, we developed a portable wireless device to measure the SP signal between the middle finger and left wrist. Then, a video induction experiment was designed to stimulate four kinds of typical emotion (happiness, sadness, anger, fear) in 26 subjects. Based on the device and video induction, we obtained a dataset consisting of 397 emotion samples. We extracted 29 features from each of the emotion samples and used eight well-established algorithms to classify the four emotions based on these features. Experimental results show that the gradient-boosting decision tree (GBDT), logistic regression (LR) and random forest (RF) algorithms achieved the highest accuracy of 75%. The obtained accuracy is similar to, or even better than, that of other methods using multiple physiological signals. Our research demonstrates the feasibility of the SP signal’s integration into existing physiological signals for emotion recognition.
topic emotion recognition
gradient-boosting decision tree
skin potential
portable device
url https://www.mdpi.com/1424-8220/21/3/1018
work_keys_str_mv AT shuhaochen emotionrecognitionbasedonskinpotentialsignalswithaportablewirelessdevice
AT kejiang emotionrecognitionbasedonskinpotentialsignalswithaportablewirelessdevice
AT haojihu emotionrecognitionbasedonskinpotentialsignalswithaportablewirelessdevice
AT haozekuang emotionrecognitionbasedonskinpotentialsignalswithaportablewirelessdevice
AT jianyiyang emotionrecognitionbasedonskinpotentialsignalswithaportablewirelessdevice
AT jikuiluo emotionrecognitionbasedonskinpotentialsignalswithaportablewirelessdevice
AT xinhuachen emotionrecognitionbasedonskinpotentialsignalswithaportablewirelessdevice
AT yuboli emotionrecognitionbasedonskinpotentialsignalswithaportablewirelessdevice
_version_ 1724290252565118976