Vocal Synchrony of Robots Boosts Positive Affective Empathy

Robots that can talk with humans play increasingly important roles in society. However, current conversation robots remain unskilled at eliciting empathic feelings in humans. To address this problem, we used a robot that speaks in a voice synchronized with human vocal prosody. We conducted an experi...

Full description

Bibliographic Details
Main Authors: Shogo Nishimura, Takuya Nakamura, Wataru Sato, Masayuki Kanbara, Yuichiro Fujimoto, Hirokazu Kato, Norihiro Hagita
Format: Article
Language:English
Published: MDPI AG 2021-03-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/11/6/2502
id doaj-cf19928af73e40e1a648a343b5333a99
record_format Article
spelling doaj-cf19928af73e40e1a648a343b5333a992021-03-12T00:01:26ZengMDPI AGApplied Sciences2076-34172021-03-01112502250210.3390/app11062502Vocal Synchrony of Robots Boosts Positive Affective EmpathyShogo Nishimura0Takuya Nakamura1Wataru Sato2Masayuki Kanbara3Yuichiro Fujimoto4Hirokazu Kato5Norihiro Hagita6Nara Institute of Science and Technology, Graduate School of Information Science, Ikoma, Nara 630-0192, JapanNara Institute of Science and Technology, Graduate School of Information Science, Ikoma, Nara 630-0192, JapanPsychological Process Team, Robotics Project, BZP, RIKEN, Kyoto 619-0288, JapanNara Institute of Science and Technology, Graduate School of Information Science, Ikoma, Nara 630-0192, JapanNara Institute of Science and Technology, Graduate School of Information Science, Ikoma, Nara 630-0192, JapanNara Institute of Science and Technology, Graduate School of Information Science, Ikoma, Nara 630-0192, JapanArt Science Department, Osaka University of Arts, Osaka 585-8555, JapanRobots that can talk with humans play increasingly important roles in society. However, current conversation robots remain unskilled at eliciting empathic feelings in humans. To address this problem, we used a robot that speaks in a voice synchronized with human vocal prosody. We conducted an experiment in which human participants held positive conversations with the robot by reading scenarios under conditions with and without vocal synchronization. We assessed seven subjective responses related to affective empathy (e.g., emotional connection) and measured the physiological emotional responses using facial electromyography from the corrugator supercilii and zygomatic major muscles as well as the skin conductance level. The subjective ratings consistently revealed heightened empathic responses to the robot in the synchronization condition compared with that under the de-synchronizing condition. The physiological signals showed that more positive and stronger emotional arousal responses to the robot with synchronization. These findings suggest that robots that are able to vocally synchronize with humans can elicit empathic emotional responses.https://www.mdpi.com/2076-3417/11/6/2502human–robot interactionaffective empathynonverbal synchronyprosodic features
collection DOAJ
language English
format Article
sources DOAJ
author Shogo Nishimura
Takuya Nakamura
Wataru Sato
Masayuki Kanbara
Yuichiro Fujimoto
Hirokazu Kato
Norihiro Hagita
spellingShingle Shogo Nishimura
Takuya Nakamura
Wataru Sato
Masayuki Kanbara
Yuichiro Fujimoto
Hirokazu Kato
Norihiro Hagita
Vocal Synchrony of Robots Boosts Positive Affective Empathy
Applied Sciences
human–robot interaction
affective empathy
nonverbal synchrony
prosodic features
author_facet Shogo Nishimura
Takuya Nakamura
Wataru Sato
Masayuki Kanbara
Yuichiro Fujimoto
Hirokazu Kato
Norihiro Hagita
author_sort Shogo Nishimura
title Vocal Synchrony of Robots Boosts Positive Affective Empathy
title_short Vocal Synchrony of Robots Boosts Positive Affective Empathy
title_full Vocal Synchrony of Robots Boosts Positive Affective Empathy
title_fullStr Vocal Synchrony of Robots Boosts Positive Affective Empathy
title_full_unstemmed Vocal Synchrony of Robots Boosts Positive Affective Empathy
title_sort vocal synchrony of robots boosts positive affective empathy
publisher MDPI AG
series Applied Sciences
issn 2076-3417
publishDate 2021-03-01
description Robots that can talk with humans play increasingly important roles in society. However, current conversation robots remain unskilled at eliciting empathic feelings in humans. To address this problem, we used a robot that speaks in a voice synchronized with human vocal prosody. We conducted an experiment in which human participants held positive conversations with the robot by reading scenarios under conditions with and without vocal synchronization. We assessed seven subjective responses related to affective empathy (e.g., emotional connection) and measured the physiological emotional responses using facial electromyography from the corrugator supercilii and zygomatic major muscles as well as the skin conductance level. The subjective ratings consistently revealed heightened empathic responses to the robot in the synchronization condition compared with that under the de-synchronizing condition. The physiological signals showed that more positive and stronger emotional arousal responses to the robot with synchronization. These findings suggest that robots that are able to vocally synchronize with humans can elicit empathic emotional responses.
topic human–robot interaction
affective empathy
nonverbal synchrony
prosodic features
url https://www.mdpi.com/2076-3417/11/6/2502
work_keys_str_mv AT shogonishimura vocalsynchronyofrobotsboostspositiveaffectiveempathy
AT takuyanakamura vocalsynchronyofrobotsboostspositiveaffectiveempathy
AT watarusato vocalsynchronyofrobotsboostspositiveaffectiveempathy
AT masayukikanbara vocalsynchronyofrobotsboostspositiveaffectiveempathy
AT yuichirofujimoto vocalsynchronyofrobotsboostspositiveaffectiveempathy
AT hirokazukato vocalsynchronyofrobotsboostspositiveaffectiveempathy
AT norihirohagita vocalsynchronyofrobotsboostspositiveaffectiveempathy
_version_ 1724223544587452416