Datasheet1_Understanding the impact of an AI-enabled conversational agent mobile app on users’ mental health and wellbeing with a self-reported maternal event: a mixed method real-world data mHealth study.docx

BackgroundMaternal mental health care is variable and with limited accessibility. Artificial intelligence (AI) conversational agents (CAs) could potentially play an important role in supporting maternal mental health and wellbeing. Our study examined data from real-world users who self-reported a maternal event while engaging with a digital mental health and wellbeing AI-enabled CA app (Wysa) for emotional support. The study evaluated app effectiveness by comparing changes in self-reported depressive symptoms between a higher engaged group of users and a lower engaged group of users and derived qualitative insights into the behaviors exhibited among higher engaged maternal event users based on their conversations with the AI CA.MethodsReal-world anonymised data from users who reported going through a maternal event during their conversation with the app was analyzed. For the first objective, users who completed two PHQ-9 self-reported assessments (n = 51) were grouped as either higher engaged users (n = 28) or lower engaged users (n = 23) based on their number of active session-days with the CA between two screenings. A non-parametric Mann–Whitney test (M–W) and non-parametric Common Language effect size was used to evaluate group differences in self-reported depressive symptoms. For the second objective, a Braun and Clarke thematic analysis was used to identify engagement behavior with the CA for the top quartile of higher engaged users (n = 10 of 51). Feedback on the app and demographic information was also explored.ResultsResults revealed a significant reduction in self-reported depressive symptoms among the higher engaged user group compared to lower engaged user group (M–W p = .004) with a high effect size (CL = 0.736). Furthermore, the top themes that emerged from the qualitative analysis revealed users expressed concerns, hopes, need for support, reframing their thoughts and expressing their victories and gratitude.ConclusionThese findings provide preliminary evidence of the effectiveness and engagement and comfort of using this AI-based emotionally intelligent mobile app to support mental health and wellbeing across a range of maternal events and experiences.

背景：母体心理健康护理存在差异，且可及性有限。人工智能（AI）对话代理（CAs）在支持母体心理健康和福祉方面可能发挥重要作用。本研究调查了真实世界用户在使用数字心理健康和福祉AI赋能的对话应用（Wysa）进行情感支持时，自我报告的母体事件数据。研究通过比较高度参与用户组和低度参与用户组在自我报告抑郁症状方面的变化，评估了应用的有效性，并基于用户与AI对话代理的对话，从高度参与母体事件用户的行为中提炼出定性见解。方法：分析了用户在应用对话中报告经历母体事件的真实世界匿名数据。对于第一个目标，完成两次PHQ-9自我报告评估（n=51）的用户根据其在两次筛查之间的活跃会话天数被分为高度参与用户组（n=28）或低度参与用户组（n=23）。使用非参数Mann-Whitney检验（M-W）和非参数共同语言效应量来评估两组自我报告抑郁症状的差异。对于第二个目标，采用Braun和Clarke主题分析，以识别高度参与用户组前四分之一（n=10/51）与对话代理的参与行为。此外，还探讨了应用反馈和人口统计信息。结果：结果显示，与低度参与用户组相比，高度参与用户组的自我报告抑郁症状显著减少（M-W p=0.004），效应量高（CL=0.736）。此外，定性分析中浮现出的主要主题表明，用户表达了担忧、希望、支持需求，重构他们的思想，并表达他们的胜利和感激。结论：这些发现为使用基于AI的情感智能移动应用支持各类母体事件和经历的心理健康和福祉的有效性、参与度和舒适度提供了初步证据。