A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methods

Fully automated self-help interventions can serve as highly cost-effective mental health promotion tools for massive amounts of people. However, these interventions are often characterised by poor adherence. One way to address this problem is to mimic therapy support by a conversational agent. The o...

Full description

Bibliographic Details
Main Authors: Kien Hoa Ly, Ann-Marie Ly, Gerhard Andersson
Format: Article
Language:English
Published: Elsevier 2017-12-01
Series:Internet Interventions
Online Access:http://www.sciencedirect.com/science/article/pii/S221478291730091X
id doaj-280eecd7024c4d309a4daeaf80e9d15b
record_format Article
spelling doaj-280eecd7024c4d309a4daeaf80e9d15b2020-11-24T20:53:04ZengElsevierInternet Interventions2214-78292017-12-0110C394610.1016/j.invent.2017.10.002A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methodsKien Hoa Ly0Ann-Marie Ly1Gerhard Andersson2Department of Behavioural Sciences and Learning, Linköping University, Linköping, SwedenDepartment of Psychology, Mittuniversitetet, Östersund, SwedenDepartment of Behavioural Sciences and Learning, Linköping University, Linköping, SwedenFully automated self-help interventions can serve as highly cost-effective mental health promotion tools for massive amounts of people. However, these interventions are often characterised by poor adherence. One way to address this problem is to mimic therapy support by a conversational agent. The objectives of this study were to assess the effectiveness and adherence of a smartphone app, delivering strategies used in positive psychology and CBT interventions via an automated chatbot (Shim) for a non-clinical population — as well as to explore participants' views and experiences of interacting with this chatbot. A total of 28 participants were randomized to either receive the chatbot intervention (n = 14) or to a wait-list control group (n = 14). Findings revealed that participants who adhered to the intervention (n = 13) showed significant interaction effects of group and time on psychological well-being (FS) and perceived stress (PSS-10) compared to the wait-list control group, with small to large between effect sizes (Cohen's d range 0.14–1.06). Also, the participants showed high engagement during the 2-week long intervention, with an average open app ratio of 17.71 times for the whole period. This is higher compared to other studies on fully automated interventions claiming to be highly engaging, such as Woebot and the Panoply app. The qualitative data revealed sub-themes which, to our knowledge, have not been found previously, such as the moderating format of the chatbot. The results of this study, in particular the good adherence rate, validated the usefulness of replicating this study in the future with a larger sample size and an active control group. This is important, as the search for fully automated, yet highly engaging and effective digital self-help interventions for promoting mental health is crucial for the public health.http://www.sciencedirect.com/science/article/pii/S221478291730091X
collection DOAJ
language English
format Article
sources DOAJ
author Kien Hoa Ly
Ann-Marie Ly
Gerhard Andersson
spellingShingle Kien Hoa Ly
Ann-Marie Ly
Gerhard Andersson
A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methods
Internet Interventions
author_facet Kien Hoa Ly
Ann-Marie Ly
Gerhard Andersson
author_sort Kien Hoa Ly
title A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methods
title_short A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methods
title_full A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methods
title_fullStr A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methods
title_full_unstemmed A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methods
title_sort fully automated conversational agent for promoting mental well-being: a pilot rct using mixed methods
publisher Elsevier
series Internet Interventions
issn 2214-7829
publishDate 2017-12-01
description Fully automated self-help interventions can serve as highly cost-effective mental health promotion tools for massive amounts of people. However, these interventions are often characterised by poor adherence. One way to address this problem is to mimic therapy support by a conversational agent. The objectives of this study were to assess the effectiveness and adherence of a smartphone app, delivering strategies used in positive psychology and CBT interventions via an automated chatbot (Shim) for a non-clinical population — as well as to explore participants' views and experiences of interacting with this chatbot. A total of 28 participants were randomized to either receive the chatbot intervention (n = 14) or to a wait-list control group (n = 14). Findings revealed that participants who adhered to the intervention (n = 13) showed significant interaction effects of group and time on psychological well-being (FS) and perceived stress (PSS-10) compared to the wait-list control group, with small to large between effect sizes (Cohen's d range 0.14–1.06). Also, the participants showed high engagement during the 2-week long intervention, with an average open app ratio of 17.71 times for the whole period. This is higher compared to other studies on fully automated interventions claiming to be highly engaging, such as Woebot and the Panoply app. The qualitative data revealed sub-themes which, to our knowledge, have not been found previously, such as the moderating format of the chatbot. The results of this study, in particular the good adherence rate, validated the usefulness of replicating this study in the future with a larger sample size and an active control group. This is important, as the search for fully automated, yet highly engaging and effective digital self-help interventions for promoting mental health is crucial for the public health.
url http://www.sciencedirect.com/science/article/pii/S221478291730091X
work_keys_str_mv AT kienhoaly afullyautomatedconversationalagentforpromotingmentalwellbeingapilotrctusingmixedmethods
AT annmariely afullyautomatedconversationalagentforpromotingmentalwellbeingapilotrctusingmixedmethods
AT gerhardandersson afullyautomatedconversationalagentforpromotingmentalwellbeingapilotrctusingmixedmethods
AT kienhoaly fullyautomatedconversationalagentforpromotingmentalwellbeingapilotrctusingmixedmethods
AT annmariely fullyautomatedconversationalagentforpromotingmentalwellbeingapilotrctusingmixedmethods
AT gerhardandersson fullyautomatedconversationalagentforpromotingmentalwellbeingapilotrctusingmixedmethods
_version_ 1716798246086508544