The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction
With impressive developments in human–robot interaction it may seem that technology can do anything. Especially in the domain of social robots which suggest to be much more than programmed machines because of their anthropomorphic shape, people may overtrust the robot's actual capabilities and...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2021-04-01
|
Series: | Frontiers in Robotics and AI |
Subjects: | |
Online Access: | https://www.frontiersin.org/articles/10.3389/frobt.2021.554578/full |
id |
doaj-df95458d39574082a9d0f33ddf23d9da |
---|---|
record_format |
Article |
spelling |
doaj-df95458d39574082a9d0f33ddf23d9da2021-04-13T06:11:37ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442021-04-01810.3389/frobt.2021.554578554578The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot InteractionDaniel Ullrich0Andreas Butz1Sarah Diefenbach2Department of Computer Science, LMU Munich, Munich, GermanyDepartment of Computer Science, LMU Munich, Munich, GermanyDepartment of Psychology, LMU Munich, Munich, GermanyWith impressive developments in human–robot interaction it may seem that technology can do anything. Especially in the domain of social robots which suggest to be much more than programmed machines because of their anthropomorphic shape, people may overtrust the robot's actual capabilities and its reliability. This presents a serious problem, especially when personal well-being might be at stake. Hence, insights about the development and influencing factors of overtrust in robots may form an important basis for countermeasures and sensible design decisions. An empirical study [N = 110] explored the development of overtrust using the example of a pet feeding robot. A 2 × 2 experimental design and repeated measurements contrasted the effect of one's own experience, skill demonstration, and reputation through experience reports of others. The experiment was realized in a video environment where the participants had to imagine they were going on a four-week safari trip and leaving their beloved cat at home, making use of a pet feeding robot. Every day, the participants had to make a choice: go to a day safari without calling options (risk and reward) or make a boring car trip to another village to check if the feeding was successful and activate an emergency call if not (safe and no reward). In parallel to cases of overtrust in other domains (e.g., autopilot), the feeding robot performed flawlessly most of the time until in the fourth week; it performed faultily on three consecutive days, resulting in the cat's death if the participants had decided to go for the day safari on these days. As expected, with repeated positive experience about the robot's reliability on feeding the cat, trust levels rapidly increased and the number of control calls decreased. Compared to one's own experience, skill demonstration and reputation were largely neglected or only had a temporary effect. We integrate these findings in a conceptual model of (over)trust over time and connect these to related psychological concepts such as positivism, instant rewards, inappropriate generalization, wishful thinking, dissonance theory, and social concepts from human–human interaction. Limitations of the present study as well as implications for robot design and future research are discussed.https://www.frontiersin.org/articles/10.3389/frobt.2021.554578/fullhuman–robot interactionovertrustprior experiencereputationdemonstrationpsychological perspective |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Daniel Ullrich Andreas Butz Sarah Diefenbach |
spellingShingle |
Daniel Ullrich Andreas Butz Sarah Diefenbach The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction Frontiers in Robotics and AI human–robot interaction overtrust prior experience reputation demonstration psychological perspective |
author_facet |
Daniel Ullrich Andreas Butz Sarah Diefenbach |
author_sort |
Daniel Ullrich |
title |
The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction |
title_short |
The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction |
title_full |
The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction |
title_fullStr |
The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction |
title_full_unstemmed |
The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction |
title_sort |
development of overtrust: an empirical simulation and psychological analysis in the context of human–robot interaction |
publisher |
Frontiers Media S.A. |
series |
Frontiers in Robotics and AI |
issn |
2296-9144 |
publishDate |
2021-04-01 |
description |
With impressive developments in human–robot interaction it may seem that technology can do anything. Especially in the domain of social robots which suggest to be much more than programmed machines because of their anthropomorphic shape, people may overtrust the robot's actual capabilities and its reliability. This presents a serious problem, especially when personal well-being might be at stake. Hence, insights about the development and influencing factors of overtrust in robots may form an important basis for countermeasures and sensible design decisions. An empirical study [N = 110] explored the development of overtrust using the example of a pet feeding robot. A 2 × 2 experimental design and repeated measurements contrasted the effect of one's own experience, skill demonstration, and reputation through experience reports of others. The experiment was realized in a video environment where the participants had to imagine they were going on a four-week safari trip and leaving their beloved cat at home, making use of a pet feeding robot. Every day, the participants had to make a choice: go to a day safari without calling options (risk and reward) or make a boring car trip to another village to check if the feeding was successful and activate an emergency call if not (safe and no reward). In parallel to cases of overtrust in other domains (e.g., autopilot), the feeding robot performed flawlessly most of the time until in the fourth week; it performed faultily on three consecutive days, resulting in the cat's death if the participants had decided to go for the day safari on these days. As expected, with repeated positive experience about the robot's reliability on feeding the cat, trust levels rapidly increased and the number of control calls decreased. Compared to one's own experience, skill demonstration and reputation were largely neglected or only had a temporary effect. We integrate these findings in a conceptual model of (over)trust over time and connect these to related psychological concepts such as positivism, instant rewards, inappropriate generalization, wishful thinking, dissonance theory, and social concepts from human–human interaction. Limitations of the present study as well as implications for robot design and future research are discussed. |
topic |
human–robot interaction overtrust prior experience reputation demonstration psychological perspective |
url |
https://www.frontiersin.org/articles/10.3389/frobt.2021.554578/full |
work_keys_str_mv |
AT danielullrich thedevelopmentofovertrustanempiricalsimulationandpsychologicalanalysisinthecontextofhumanrobotinteraction AT andreasbutz thedevelopmentofovertrustanempiricalsimulationandpsychologicalanalysisinthecontextofhumanrobotinteraction AT sarahdiefenbach thedevelopmentofovertrustanempiricalsimulationandpsychologicalanalysisinthecontextofhumanrobotinteraction AT danielullrich developmentofovertrustanempiricalsimulationandpsychologicalanalysisinthecontextofhumanrobotinteraction AT andreasbutz developmentofovertrustanempiricalsimulationandpsychologicalanalysisinthecontextofhumanrobotinteraction AT sarahdiefenbach developmentofovertrustanempiricalsimulationandpsychologicalanalysisinthecontextofhumanrobotinteraction |
_version_ |
1721529314191605760 |