The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction

With impressive developments in human–robot interaction it may seem that technology can do anything. Especially in the domain of social robots which suggest to be much more than programmed machines because of their anthropomorphic shape, people may overtrust the robot's actual capabilities and...

Full description

Bibliographic Details
Main Authors: Daniel Ullrich, Andreas Butz, Sarah Diefenbach
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-04-01
Series:Frontiers in Robotics and AI
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frobt.2021.554578/full
id doaj-df95458d39574082a9d0f33ddf23d9da
record_format Article
spelling doaj-df95458d39574082a9d0f33ddf23d9da2021-04-13T06:11:37ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442021-04-01810.3389/frobt.2021.554578554578The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot InteractionDaniel Ullrich0Andreas Butz1Sarah Diefenbach2Department of Computer Science, LMU Munich, Munich, GermanyDepartment of Computer Science, LMU Munich, Munich, GermanyDepartment of Psychology, LMU Munich, Munich, GermanyWith impressive developments in human–robot interaction it may seem that technology can do anything. Especially in the domain of social robots which suggest to be much more than programmed machines because of their anthropomorphic shape, people may overtrust the robot's actual capabilities and its reliability. This presents a serious problem, especially when personal well-being might be at stake. Hence, insights about the development and influencing factors of overtrust in robots may form an important basis for countermeasures and sensible design decisions. An empirical study [N = 110] explored the development of overtrust using the example of a pet feeding robot. A 2 × 2 experimental design and repeated measurements contrasted the effect of one's own experience, skill demonstration, and reputation through experience reports of others. The experiment was realized in a video environment where the participants had to imagine they were going on a four-week safari trip and leaving their beloved cat at home, making use of a pet feeding robot. Every day, the participants had to make a choice: go to a day safari without calling options (risk and reward) or make a boring car trip to another village to check if the feeding was successful and activate an emergency call if not (safe and no reward). In parallel to cases of overtrust in other domains (e.g., autopilot), the feeding robot performed flawlessly most of the time until in the fourth week; it performed faultily on three consecutive days, resulting in the cat's death if the participants had decided to go for the day safari on these days. As expected, with repeated positive experience about the robot's reliability on feeding the cat, trust levels rapidly increased and the number of control calls decreased. Compared to one's own experience, skill demonstration and reputation were largely neglected or only had a temporary effect. We integrate these findings in a conceptual model of (over)trust over time and connect these to related psychological concepts such as positivism, instant rewards, inappropriate generalization, wishful thinking, dissonance theory, and social concepts from human–human interaction. Limitations of the present study as well as implications for robot design and future research are discussed.https://www.frontiersin.org/articles/10.3389/frobt.2021.554578/fullhuman–robot interactionovertrustprior experiencereputationdemonstrationpsychological perspective
collection DOAJ
language English
format Article
sources DOAJ
author Daniel Ullrich
Andreas Butz
Sarah Diefenbach
spellingShingle Daniel Ullrich
Andreas Butz
Sarah Diefenbach
The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction
Frontiers in Robotics and AI
human–robot interaction
overtrust
prior experience
reputation
demonstration
psychological perspective
author_facet Daniel Ullrich
Andreas Butz
Sarah Diefenbach
author_sort Daniel Ullrich
title The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction
title_short The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction
title_full The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction
title_fullStr The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction
title_full_unstemmed The Development of Overtrust: An Empirical Simulation and Psychological Analysis in the Context of Human–Robot Interaction
title_sort development of overtrust: an empirical simulation and psychological analysis in the context of human–robot interaction
publisher Frontiers Media S.A.
series Frontiers in Robotics and AI
issn 2296-9144
publishDate 2021-04-01
description With impressive developments in human–robot interaction it may seem that technology can do anything. Especially in the domain of social robots which suggest to be much more than programmed machines because of their anthropomorphic shape, people may overtrust the robot's actual capabilities and its reliability. This presents a serious problem, especially when personal well-being might be at stake. Hence, insights about the development and influencing factors of overtrust in robots may form an important basis for countermeasures and sensible design decisions. An empirical study [N = 110] explored the development of overtrust using the example of a pet feeding robot. A 2 × 2 experimental design and repeated measurements contrasted the effect of one's own experience, skill demonstration, and reputation through experience reports of others. The experiment was realized in a video environment where the participants had to imagine they were going on a four-week safari trip and leaving their beloved cat at home, making use of a pet feeding robot. Every day, the participants had to make a choice: go to a day safari without calling options (risk and reward) or make a boring car trip to another village to check if the feeding was successful and activate an emergency call if not (safe and no reward). In parallel to cases of overtrust in other domains (e.g., autopilot), the feeding robot performed flawlessly most of the time until in the fourth week; it performed faultily on three consecutive days, resulting in the cat's death if the participants had decided to go for the day safari on these days. As expected, with repeated positive experience about the robot's reliability on feeding the cat, trust levels rapidly increased and the number of control calls decreased. Compared to one's own experience, skill demonstration and reputation were largely neglected or only had a temporary effect. We integrate these findings in a conceptual model of (over)trust over time and connect these to related psychological concepts such as positivism, instant rewards, inappropriate generalization, wishful thinking, dissonance theory, and social concepts from human–human interaction. Limitations of the present study as well as implications for robot design and future research are discussed.
topic human–robot interaction
overtrust
prior experience
reputation
demonstration
psychological perspective
url https://www.frontiersin.org/articles/10.3389/frobt.2021.554578/full
work_keys_str_mv AT danielullrich thedevelopmentofovertrustanempiricalsimulationandpsychologicalanalysisinthecontextofhumanrobotinteraction
AT andreasbutz thedevelopmentofovertrustanempiricalsimulationandpsychologicalanalysisinthecontextofhumanrobotinteraction
AT sarahdiefenbach thedevelopmentofovertrustanempiricalsimulationandpsychologicalanalysisinthecontextofhumanrobotinteraction
AT danielullrich developmentofovertrustanempiricalsimulationandpsychologicalanalysisinthecontextofhumanrobotinteraction
AT andreasbutz developmentofovertrustanempiricalsimulationandpsychologicalanalysisinthecontextofhumanrobotinteraction
AT sarahdiefenbach developmentofovertrustanempiricalsimulationandpsychologicalanalysisinthecontextofhumanrobotinteraction
_version_ 1721529314191605760