Toward Emotion Recognition From Physiological Signals in the Wild: Approaching the Methodological Issues in Real-Life Data Collection

Emotion, mood, and stress recognition (EMSR) has been studied in laboratory settings for decades. In particular, physiological signals are widely used to detect and classify affective states in lab conditions. However, physiological reactions to emotional stimuli have been found to differ in laborat...

Full description

Bibliographic Details
Main Authors: Fanny Larradet, Radoslaw Niewiadomski, Giacinto Barresi, Darwin G. Caldwell, Leonardo S. Mattos
Format: Article
Language:English
Published: Frontiers Media S.A. 2020-07-01
Series:Frontiers in Psychology
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fpsyg.2020.01111/full
id doaj-ef7ba8896e9f4e9896a5f21942459945
record_format Article
spelling doaj-ef7ba8896e9f4e9896a5f219424599452020-11-25T02:32:37ZengFrontiers Media S.A.Frontiers in Psychology1664-10782020-07-011110.3389/fpsyg.2020.01111501635Toward Emotion Recognition From Physiological Signals in the Wild: Approaching the Methodological Issues in Real-Life Data CollectionFanny Larradet0Radoslaw Niewiadomski1Radoslaw Niewiadomski2Giacinto Barresi3Darwin G. Caldwell4Leonardo S. Mattos5Advanced Robotics, Istituto Italiano di Tecnologia, Genoa, ItalyContact Unit, Istituto Italiano di Tecnologia, Genoa, ItalyDepartment of Psychology and Cognitive Science, University of Trento, Rovereto, ItalyRehab Technologies, Istituto Italiano di Tecnologia, Genoa, ItalyAdvanced Robotics, Istituto Italiano di Tecnologia, Genoa, ItalyAdvanced Robotics, Istituto Italiano di Tecnologia, Genoa, ItalyEmotion, mood, and stress recognition (EMSR) has been studied in laboratory settings for decades. In particular, physiological signals are widely used to detect and classify affective states in lab conditions. However, physiological reactions to emotional stimuli have been found to differ in laboratory and natural settings. Thanks to recent technological progress (e.g., in wearables) the creation of EMSR systems for a large number of consumers during their everyday activities is increasingly possible. Therefore, datasets created in the wild are needed to insure the validity and the exploitability of EMSR models for real-life applications. In this paper, we initially present common techniques used in laboratory settings to induce emotions for the purpose of physiological dataset creation. Next, advantages and challenges of data collection in the wild are discussed. To assess the applicability of existing datasets to real-life applications, we propose a set of categories to guide and compare at a glance different methodologies used by researchers to collect such data. For this purpose, we also introduce a visual tool called Graphical Assessment of Real-life Application-Focused Emotional Dataset (GARAFED). In the last part of the paper, we apply the proposed tool to compare existing physiological datasets for EMSR in the wild and to show possible improvements and future directions of research. We wish for this paper and GARAFED to be used as guidelines for researchers and developers who aim at collecting affect-related data for real-life EMSR-based applications.https://www.frontiersin.org/article/10.3389/fpsyg.2020.01111/fullemotion recognitiondata collectionin-the-wildphysiological signalsemotion elicitation and assessment
collection DOAJ
language English
format Article
sources DOAJ
author Fanny Larradet
Radoslaw Niewiadomski
Radoslaw Niewiadomski
Giacinto Barresi
Darwin G. Caldwell
Leonardo S. Mattos
spellingShingle Fanny Larradet
Radoslaw Niewiadomski
Radoslaw Niewiadomski
Giacinto Barresi
Darwin G. Caldwell
Leonardo S. Mattos
Toward Emotion Recognition From Physiological Signals in the Wild: Approaching the Methodological Issues in Real-Life Data Collection
Frontiers in Psychology
emotion recognition
data collection
in-the-wild
physiological signals
emotion elicitation and assessment
author_facet Fanny Larradet
Radoslaw Niewiadomski
Radoslaw Niewiadomski
Giacinto Barresi
Darwin G. Caldwell
Leonardo S. Mattos
author_sort Fanny Larradet
title Toward Emotion Recognition From Physiological Signals in the Wild: Approaching the Methodological Issues in Real-Life Data Collection
title_short Toward Emotion Recognition From Physiological Signals in the Wild: Approaching the Methodological Issues in Real-Life Data Collection
title_full Toward Emotion Recognition From Physiological Signals in the Wild: Approaching the Methodological Issues in Real-Life Data Collection
title_fullStr Toward Emotion Recognition From Physiological Signals in the Wild: Approaching the Methodological Issues in Real-Life Data Collection
title_full_unstemmed Toward Emotion Recognition From Physiological Signals in the Wild: Approaching the Methodological Issues in Real-Life Data Collection
title_sort toward emotion recognition from physiological signals in the wild: approaching the methodological issues in real-life data collection
publisher Frontiers Media S.A.
series Frontiers in Psychology
issn 1664-1078
publishDate 2020-07-01
description Emotion, mood, and stress recognition (EMSR) has been studied in laboratory settings for decades. In particular, physiological signals are widely used to detect and classify affective states in lab conditions. However, physiological reactions to emotional stimuli have been found to differ in laboratory and natural settings. Thanks to recent technological progress (e.g., in wearables) the creation of EMSR systems for a large number of consumers during their everyday activities is increasingly possible. Therefore, datasets created in the wild are needed to insure the validity and the exploitability of EMSR models for real-life applications. In this paper, we initially present common techniques used in laboratory settings to induce emotions for the purpose of physiological dataset creation. Next, advantages and challenges of data collection in the wild are discussed. To assess the applicability of existing datasets to real-life applications, we propose a set of categories to guide and compare at a glance different methodologies used by researchers to collect such data. For this purpose, we also introduce a visual tool called Graphical Assessment of Real-life Application-Focused Emotional Dataset (GARAFED). In the last part of the paper, we apply the proposed tool to compare existing physiological datasets for EMSR in the wild and to show possible improvements and future directions of research. We wish for this paper and GARAFED to be used as guidelines for researchers and developers who aim at collecting affect-related data for real-life EMSR-based applications.
topic emotion recognition
data collection
in-the-wild
physiological signals
emotion elicitation and assessment
url https://www.frontiersin.org/article/10.3389/fpsyg.2020.01111/full
work_keys_str_mv AT fannylarradet towardemotionrecognitionfromphysiologicalsignalsinthewildapproachingthemethodologicalissuesinreallifedatacollection
AT radoslawniewiadomski towardemotionrecognitionfromphysiologicalsignalsinthewildapproachingthemethodologicalissuesinreallifedatacollection
AT radoslawniewiadomski towardemotionrecognitionfromphysiologicalsignalsinthewildapproachingthemethodologicalissuesinreallifedatacollection
AT giacintobarresi towardemotionrecognitionfromphysiologicalsignalsinthewildapproachingthemethodologicalissuesinreallifedatacollection
AT darwingcaldwell towardemotionrecognitionfromphysiologicalsignalsinthewildapproachingthemethodologicalissuesinreallifedatacollection
AT leonardosmattos towardemotionrecognitionfromphysiologicalsignalsinthewildapproachingthemethodologicalissuesinreallifedatacollection
_version_ 1724818975701860352