Vickybot, a Chatbot for Anxiety-Depressive Symptoms and Work-Related Burnout in Primary Care and Health Care Professionals: Development, Feasibility, and Potential Effectiveness Studies
-
Published:2023-04-03
Issue:
Volume:25
Page:e43293
-
ISSN:1438-8871
-
Container-title:Journal of Medical Internet Research
-
language:en
-
Short-container-title:J Med Internet Res
Author:
Anmella GerardORCID, Sanabra MiriamORCID, Primé-Tous MireiaORCID, Segú XavierORCID, Cavero MyriamORCID, Morilla IvetteORCID, Grande IriaORCID, Ruiz VictoriaORCID, Mas AriadnaORCID, Martín-Villalba InésORCID, Caballo AlejandroORCID, Esteva Julia-ParisadORCID, Rodríguez-Rey ArturoORCID, Piazza FlaviaORCID, Valdesoiro Francisco JoséORCID, Rodriguez-Torrella ClaudiaORCID, Espinosa MartaORCID, Virgili GiuliaORCID, Sorroche CarlotaORCID, Ruiz AliciaORCID, Solanes AleixORCID, Radua JoaquimORCID, Also María AntonietaORCID, Sant ElisendaORCID, Murgui SandraORCID, Sans-Corrales MireiaORCID, H Young AllanORCID, Vicens VictorORCID, Blanch JordiORCID, Caballeria ElsaORCID, López-Pelayo HugoORCID, López ClaraORCID, Olivé VictoriaORCID, Pujol LauraORCID, Quesada SebastianaORCID, Solé BrisaORCID, Torrent CarlaORCID, Martínez-Aran AnabelORCID, Guarch JoanaORCID, Navinés RicardORCID, Murru AndreaORCID, Fico GiovannaORCID, de Prisco MicheleORCID, Oliva VicenzoORCID, Amoretti SilviaORCID, Pio-Carrino CasimiroORCID, Fernández-Canseco MaríaORCID, Villegas MartaORCID, Vieta EduardORCID, Hidalgo-Mazzei DiegoORCID
Abstract
Background
Many people attending primary care (PC) have anxiety-depressive symptoms and work-related burnout compounded by a lack of resources to meet their needs. The COVID-19 pandemic has exacerbated this problem, and digital tools have been proposed as a solution.
Objective
We aimed to present the development, feasibility, and potential effectiveness of Vickybot, a chatbot aimed at screening, monitoring, and reducing anxiety-depressive symptoms and work-related burnout, and detecting suicide risk in patients from PC and health care workers.
Methods
Healthy controls (HCs) tested Vickybot for reliability. For the simulation study, HCs used Vickybot for 2 weeks to simulate different clinical situations. For feasibility and effectiveness study, people consulting PC or health care workers with mental health problems used Vickybot for 1 month. Self-assessments for anxiety (Generalized Anxiety Disorder 7-item) and depression (Patient Health Questionnaire-9) symptoms and work-related burnout (based on the Maslach Burnout Inventory) were administered at baseline and every 2 weeks. Feasibility was determined from both subjective and objective user-engagement indicators (UEIs). Potential effectiveness was measured using paired 2-tailed t tests or Wilcoxon signed-rank test for changes in self-assessment scores.
Results
Overall, 40 HCs tested Vickybot simultaneously, and the data were reliably transmitted and registered. For simulation, 17 HCs (n=13, 76% female; mean age 36.5, SD 9.7 years) received 98.8% of the expected modules. Suicidal alerts were received correctly. For the feasibility and potential effectiveness study, 34 patients (15 from PC and 19 health care workers; 76% [26/34] female; mean age 35.3, SD 10.1 years) completed the first self-assessments, with 100% (34/34) presenting anxiety symptoms, 94% (32/34) depressive symptoms, and 65% (22/34) work-related burnout. In addition, 27% (9/34) of patients completed the second self-assessment after 2 weeks of use. No significant differences were found between the first and second self-assessments for anxiety (t8=1.000; P=.34) or depressive (t8=0.40; P=.70) symptoms. However, work-related burnout scores were moderately reduced (z=−2.07, P=.04, r=0.32). There was a nonsignificant trend toward a greater reduction in anxiety-depressive symptoms and work-related burnout with greater use of the chatbot. Furthermore, 9% (3/34) of patients activated the suicide alert, and the research team promptly intervened with successful outcomes. Vickybot showed high subjective UEI (acceptability, usability, and satisfaction), but low objective UEI (completion, adherence, compliance, and engagement). Vickybot was moderately feasible.
Conclusions
The chatbot was useful in screening for the presence and severity of anxiety and depressive symptoms, and for detecting suicidal risk. Potential effectiveness was shown to reduce work-related burnout but not anxiety or depressive symptoms. Subjective perceptions of use contrasted with low objective-use metrics. Our results are promising but suggest the need to adapt and enhance the smartphone-based solution to improve engagement. A consensus on how to report UEIs and validate digital solutions, particularly for chatbots, is required.
Publisher
JMIR Publications Inc.
Subject
Health Informatics
Cited by
20 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|