Skip to main content

Research Repository

Advanced Search

Preliminary evaluation of the engagement and effectiveness of a mental health chatbot.

Daley, Kate; Hungerbuehler, Ines; Cavanagh, Kate; Claro, Heloísa G.; Swinton, Paul; Kapps, Michael

Authors

Kate Daley

Ines Hungerbuehler

Kate Cavanagh

Heloísa G. Claro

Paul Swinton

Michael Kapps



Abstract

Background: Mental health difficulties are highly prevalent yet access to support is impeded by barriers of stigma, cost and availability. These issues are even more prevalent in low- and middle-income countries, and use of digital technology is one way to overcome these barriers. Digital health interventions have been shown to be effective but often struggle with low engagement rates, particularly in the absence of any human support. Chatbots could offer a scalable solution, simulating human support at a lower cost. Objective: To complete a preliminary evaluation of engagement and effectiveness of Vitalk, a mental health chatbot, at reducing anxiety, depression and stress. Methods: Real world data was analysed from 3629 Vitalk users who had completed the first phase of a Vitalk program (‘less anxiety’, ‘less stress’ or ‘better mood’). Programs were delivered through written conversation with the chatbot. Engagement was calculated from the number of responses sent to the chatbot divided by days in the program. Results: Users sent an average of 8.17 responses / day. For all three programs, target outcome scores reduced between baseline and follow up with large effect sizes for anxiety (Cohen's d = -0.85), depression (Cohen's d = -0.91) and stress (Cohen's d =-0.81). Increased engagement resulted in improved post-intervention values for anxiety and depression. Conclusion: This study highlights the potential of a chatbot to reduce mental health symptoms in the general population within Brazil. Whilst findings show promise, further research is required.

Citation

DALEY, K., HUNGERBUEHLER, I., CAVANAGH, K., CLARO, H.G., SWINTON, P. and KAPPS, M. [2020]. Preliminary evaluation of the engagement and effectiveness of a mental health chatbot. Frontiers in digital health [online], (accepted). Available from: https://doi.org/10.3389/fdgth.2020.576361

Journal Article Type Article
Acceptance Date Nov 10, 2020
Deposit Date Nov 10, 2020
Publicly Available Date Nov 10, 2020
Journal Frontiers in digital health
Electronic ISSN 2673-253X
Publisher Frontiers Media
Peer Reviewed Peer Reviewed
DOI https://doi.org/10.3389/fdgth.2020.576361
Keywords Digital health; Online; Chatbot; Conversational agent(s); Mental health; Depression; Anxiety; Stress; Low-and middle-income
Public URL https://rgu-repository.worktribe.com/output/996308

Files

DALEY [2020] Preliminary evaluation (AAM) (556 Kb)
PDF

Publisher Licence URL
https://creativecommons.org/licenses/by/4.0/





You might also like



Downloadable Citations