Internet-Delivered Self-help for Adults With ADHD (MyADHD): Usability Study

Robin Maria Francisca Kenter, Adrian Schønning, Yavuz Inal, Robin Maria Francisca Kenter, Adrian Schønning, Yavuz Inal

Abstract

Background: Although effective pharmacological treatment exists, many adults with attention-deficit/hyperactivity disorder (ADHD) prefer a nonpharmacological option for managing their symptoms. Internet-delivered self-help interventions have the potential to address this unmet supportive care need reported by adults with ADHD, at relatively low costs. However, if the intervention does not offer optimal functions, content, and layout, it could decrease adherence and engagement and potentially compromise the effectiveness of such interventions. Thus, there is a need for examining the usability and factors that enhance and impair the usability of internet-delivered self-help interventions.

Objective: This study evaluates the usability of an internet-delivered self-help intervention for adults with ADHD (MyADHD). The main goals were to (1) collect qualitative and quantitative data on usability and (2) identify usability problems.

Methods: Individual think-aloud interviews and staged usability testing (N=5) were conducted to evaluate the usability of the MyADHD intervention in terms of function, content, and design. MyADHD end users provided iterative feedback to maximize engagement and usability. They performed tasks involved in operating the intervention and provided "think-aloud" commentary and postsession usability ratings. The interviews were recorded, transcribed verbatim, and analyzed.

Results: Participants were satisfied with the overall usability of the program. The average perceived usability score out of 100 was 70 for the first round of testing and improved to 77.5 after applying modifications, with a mean score of 75.5 (SD 5.9) for all rounds of usability testing. The analysis of the interviews revealed 3 central themes: functionality, content, and layout.

Conclusions: Optimizing the usability of internet-delivered self-guided interventions is a critical step in the design and development process. The usability testing in this study provided valuable information from users' perspectives on the content and platform of the intervention. Analysis revealed the need for intervention enhancement with regard to design, functionality, and content from the perspective of potential end users. Overall, participants saw value in the MyADHD intervention and were confident that they could use it for the self-management of symptoms and expressed the desire to use the entire intervention when it becomes available. Through this development process, we produced an intervention that is likely to be used successfully and is ready for deployment in a randomized controlled trial.

Trial registration: ClinicalTrials.gov NCT04511169; https://ichgcp.net/clinical-trials-registry/NCT04511169.

Keywords: adults with attention-deficit/hyperactivity disorder; attention-deficit/hyperactivity disorder; care needs; internet-delivered; intervention; self-guided intervention; self-help; usability; usability study; usability testing; user evaluation.

Conflict of interest statement

Conflicts of Interest: None declared.

©Robin Maria Francisca Kenter, Adrian Schønning, Yavuz Inal. Originally published in JMIR Formative Research (https://formative.jmir.org), 21.10.2022.

References

    1. Andersson G, Titov N, Dear BF, Rozental A, Carlbring P. Internet-delivered psychological treatments: from innovation to implementation. World Psychiatry. 2019;18(1):20–28. doi: 10.1002/wps.20610. doi: 10.1002/wps.20610.
    1. Folker AP, Mathiasen K, Lauridsen SM, Stenderup E, Dozeman E, Folker MP. Implementing internet-delivered cognitive behavior therapy for common mental health disorders: a comparative case study of implementation challenges perceived by therapists and managers in five European internet services. Internet Interv. 2018 Mar;11:60–70. doi: 10.1016/j.invent.2018.02.001.
    1. Andersson G, Titov N. Advantages and limitations of internet-based interventions for common mental disorders. World Psychiatry. 2014 Feb;13(1):4–11. doi: 10.1002/wps.20083.
    1. Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, Mackinnon A, Meyer B, Botella C, Littlewood E, Andersson G, Christensen H, Klein JP, Schröder J, Bretón-López J, Scheider J, Griffiths K, Farrer L, Huibers Marcus J H, Phillips Rachel, Gilbody Simon, Moritz Steffen, Berger Thomas, Pop Victor, Spek Viola, Cuijpers Pim. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry. 2017 Apr;74(4):351–359. doi: 10.1001/jamapsychiatry.2017.0044.2604310
    1. Karyotaki E, Kleiboer A, Smit F, Turner DT, Pastor AM, Andersson G, Berger T, Botella C, Breton JM, Carlbring P, Christensen H, de Graaf E, Griffiths K, Donker T, Farrer L, Huibers MJH, Lenndin J, Mackinnon A, Meyer B, Moritz S, Riper H, Spek V, Vernmark K, Cuijpers P. Predictors of treatment dropout in self-guided web-based interventions for depression: an ‘individual patient data’ meta-analysis. Psychol Med. 2015 Apr;45(13):2717–2726. doi: 10.1017/s0033291715000665.
    1. American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders. Washington, DC: American Psychiatric Association; 2013. pp. 591–643.
    1. Faraone SV, Biederman J, Mick E. The age-dependent decline of attention deficit hyperactivity disorder: a meta-analysis of follow-up studies. Psychol Med. 2006 Feb;36(2):159–165. doi: 10.1017/S003329170500471X.S003329170500471X
    1. Franke B, Michelini G, Asherson P, Banaschewski T, Bilbow A, Buitelaar JK, Cormand B, Faraone SV, Ginsberg Y, Haavik J, Kuntsi J, Larsson H, Lesch K, Ramos-Quiroga JA, Réthelyi JM, Ribases M, Reif A. Live fast, die young? A review on the developmental trajectories of ADHD across the lifespan. Eur Neuropsychopharmacol. 2018 Oct;28(10):1059–1088. doi: 10.1016/j.euroneuro.2018.08.001.
    1. Kessler RC, Adler LA, Barkley R, Biederman J, Conners CK, Faraone SV, Greenhill LL, Jaeger S, Secnik K, Spencer T, Üstün TB, Zaslavsky AM. Patterns and predictors of attention-deficit/hyperactivity disorder persistence into adulthood: results from the National Comorbidity Survey Replication. Biol Psychiatry. 2005 Jun;57(11):1442–1451. doi: 10.1016/j.biopsych.2005.04.001.
    1. Spencer T, Biederman J, Wilens T. Pharmacotherapy of attention deficit hyperactivity disorder. Child Adolesc Psychiatr Clin N Am. 2000 Jan;9(1):77–97.
    1. Solberg BS, Haavik J, Halmøy A. Health care services for adults with ADHD: patient satisfaction and the role of psycho-education. J Atten Disord. 2015 Jun;23(1):99–108. doi: 10.1177/1087054715587941.
    1. Moëll B, Kollberg L, Nasri B, Lindefors N, Kaldo V. Living SMART — a randomized controlled trial of a guided online course teaching adults with ADHD or sub-clinical ADHD to use smartphones to structure their everyday life. Internet Interv. 2015 Mar;2(1):24–31. doi: 10.1016/j.invent.2014.11.004.
    1. Nasri B. New Approach to the Treatment of ADHD Through Internet and Smartphones: From Impairment to Improvement. Sweden: Karolinska Institutet; 2017.
    1. Nordby ES, Kenter RM, Lundervold AJ, Nordgreen T. A self-guided internet-delivered intervention for adults with ADHD: a feasibility study. Internet Interv. 2021 Sep;25:100416. doi: 10.1016/j.invent.2021.100416.
    1. Torous J, Nicholas J, Larsen ME, Firth J, Christensen H. Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements. Evid Based Ment Health. 2018 Aug;21(3):116–119. doi: 10.1136/eb-2018-102891.eb-2018-102891
    1. ISO 9241-11:2018: Ergonomics of Human-System Interaction - Part 11: Usability: Definitions and Concepts. International Organization for Standardization. 2018. [2022-09-12]. .
    1. Inal Y, Wake JD, Guribye F, Nordgreen T. Usability evaluations of mobile mental health technologies: systematic review. J Med Internet Res. 2020 Jan;22(1):e15337. doi: 10.2196/15337. v22i1e15337
    1. Kenter RMF, Lundervold AJ, Nordgreen T. A self-guided internet-delivered intervention for adults with ADHD: a protocol for a randomized controlled trial. Internet Interv. 2021 Dec;26:100485. doi: 10.1016/j.invent.2021.100485. S2214-7829(21)00125-1
    1. Nielsen J, Landauer KT. A mathematical model of the finding of usability problems. Proceedings of the INTERACT'93 and CHI'93 Conference on Human Factors in Computing Systems; CHI ’93; April 24-29, 1993; Amsterdam, The Netherlands. 1993.
    1. Nielsen J. Finding usability problems through heuristic evaluation. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems; CHI’92; May 3-7, 1992; Monterey, CA. 1992.
    1. Fan M, Lin J, Chung C, Truong KN. Concurrent think-aloud verbalizations and usability problems. ACM Trans Comput-Hum Interact. 2019;26(5):1–35. doi: 10.1145/3325281.
    1. Brinck T, Gergle D, Wood SD. Usability for the Web: Designing Web Sites That Work. San Francisco, CA: Elsevier; 2001.
    1. Brooke J. Sus: a quick and dirty usability. Usability Eval Ind. 1996;189(3):4–7. doi: 10.1201/9781498710411-35.
    1. Lewis JR. The System Usability Scale: past, present, and future. Int J Human–Comput Interact. 2018 Mar;34(7):577–590. doi: 10.1080/10447318.2018.1455307.
    1. Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: adding an adjective rating scale. J Usability Stud. 2009;4(3):114–123.
    1. McLellan S, Muddimer A, Camille Peres S. The effect of experience on system usability scale ratings. J Usability Stud. 2012;7(2):56–67.
    1. Lewis JR, Sauro J. The factor structure of the system usability scale. International Conference on Human Centered Design; HCI International 2009; July 19-24, 2009; San Diego, CA. Springer; 2009.
    1. Yardley L, Ainsworth Ben, Arden-Close Emily, Muller Ingrid. The person-based approach to enhancing the acceptability and feasibility of interventions. Pilot Feasibility Stud. 2015;1:37. doi: 10.1186/s40814-015-0033-z. 33
    1. Castleberry A. NVivo 10 [software program]. Version 10. QSR International; 2012. Am J Pharmaceutical Education. 2014 Feb;78(1):25–27. doi: 10.5688/ajpe78125.
    1. Pettersson R, Söderström S, Edlund-Söderström K, Nilsson KW. Internet-based cognitive behavioral therapy for adults With ADHD in outpatient psychiatric care. J Atten Disord. 2016 Jul;21(6):508–521. doi: 10.1177/1087054714539998.
    1. Titov N, Dear B, Nielssen O, Staples L, Hadjistavropoulos H, Nugent M, Adlam K, Nordgreen T, Bruvik KH, Hovland A, Repål A, Mathiasen K, Kraepelien M, Blom K, Svanborg C, Lindefors N, Kaldo V. ICBT in routine care: a descriptive analysis of successful clinics in five countries. Internet Interv. 2018 Sep;13:108–115. doi: 10.1016/j.invent.2018.07.006. S2214-7829(18)30037-X
    1. Simpson HB, Marcus SM, Zuckoff A, Franklin M, Foa EB. Patient adherence to cognitive-behavioral therapy predicts long-term outcome in obsessive-compulsive disorder. J Clin Psychiatry. 2012 Sep;73(09):1265–1266. doi: 10.4088/jcp.12l07879.
    1. Zapata BC, Fernández-Alemán JL, Idri A, Toval A. Empirical studies on usability of mHealth apps: a systematic literature review. J Med Syst. 2015 Jan;39(2):1. doi: 10.1007/s10916-014-0182-2.
    1. Díaz-García A, González-Robles A, Fernández-Álvarez J, Castilla D, Mira A, Bretón J. Usability of a transdiagnostic internet-delivered protocol for anxiety and depression in community patients. In: Cipresso P, Serino S, Villani D, editors. Pervasive Computing Paradigms for Mental Health. MindCare 2019. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering. Cham: Springer; 2019.
    1. Etzelmueller A, Radkovsky A, Hannig W, Berking M, Ebert DD. Patient's experience with blended video- and internet based cognitive behavioural therapy service in routine care. Internet Interv. 2018 Jun;12:165–175. doi: 10.1016/j.invent.2018.01.003.
    1. de Wit J, Dozeman E, Ruwaard J, Alblas J, Riper H. Web-based support for daily functioning of people with mild intellectual disabilities or chronic psychiatric disorders: A feasibility study in routine practice. Internet Interv. 2015 May;2(2):161–168. doi: 10.1016/j.invent.2015.02.007.

Source: PubMed

スポンサーと協力者

医学的状態

薬物療法

3
購読する