Applying human-centered design to maximize acceptability, feasibility, and usability of mobile technology supervision in Kenya: a mixed methods pilot study protocol

Noah S Triplett, Sean Munson, Anne Mbwayo, Teresia Mutavi, Bryan J Weiner, Pamela Collins, Cyrilla Amanya, Shannon Dorsey, Noah S Triplett, Sean Munson, Anne Mbwayo, Teresia Mutavi, Bryan J Weiner, Pamela Collins, Cyrilla Amanya, Shannon Dorsey

Abstract

Background: Although research continues to support task-shifting as an effective model of delivering evidence-based practices (EBPs), little scholarship has focused how to scale up and sustain task-shifting in low- and middle-income countries, including how to sustainably supervise lay counselors. Ongoing supervision is critical to ensure EBPs are delivered with fidelity; however, the resources and expertise required to provide ongoing supervision may limit the potential to scale up and sustain task shifting. Opportunities may exist to leverage mobile technology to replace or supplement in-person supervision in low-resource contexts, but contextual variables, such as network connectivity and lay counselor preferences surrounding mobile technology, must be examined and considered when designing and implementing mobile technology supervision.

Methods: This study builds from an existing randomized trial in Kenya, wherein teachers and community health volunteers have been trained to provide trauma-focused cognitive behavioral therapy as lay counselors. The study will use an iterative and mixed methods approach, with qualitative interviews and a Human-Centered Design (HCD) workshop informing a non-randomized pilot trial. Semi-structured interviews will be conducted with lay counselors and supervisors to understand how mobile technology is currently being used for supervision and determine the barriers and facilitators to mobile technology supervision. Data from these interviews will inform an HCD workshop, where lay counselors and supervisors "re-design" supervision to most effectively leverage mobile technology. Workshop participants will also participate in focus groups to gather perceptions on the use of HCD techniques. The final outcome of the workshop will be a set of refined workflows, which will be tested in a mixed method, nonrandomized pilot with newly trained lay counselors and existing supervisors. The pilot trial will evaluate the acceptability, feasibility, and usability of mobile technology supervision through self-report questionnaires as well as perceptions of effectiveness through qualitative interviews with a subset of lay counselors and all supervisors.

Discussion: This study will provide a launching point for future research on supervision and methods to engage stakeholders to design and tailor interventions and implementation supports to fit low-resourced contexts.

Trial registration: The parent trial from which this study builds was registered on ClinicalTrials.gov on August 9, 2017 ( NCT03243396 ).

Keywords: Human-centered design; Mobile technology; Supervision; Task-shifting.

Conflict of interest statement

Dorsey has received honoraria for providing TF-CBT training and has received grant funding to test TF-CBT. Other authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Study approach
Fig. 2
Fig. 2
Interaction design foundation framework
Fig. 3
Fig. 3
Pilot trial design

References

    1. Vos T, Lim SS, Abbafati C, Abbas KM, Abbasi M, Abbasifard M, et al. Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet. 2020;396(10258):1204–1222.
    1. World Health Organization. Mental Health Atlas 2017. Geneva; 2018.
    1. Demyttenaere K, Bruffaerts R, Posada-Villa J, Gasquet I, Kovess V, Lepine JP, et al. Prevalence, severity, and unmet need for treatment of mental disorders in the World Health Organization World Mental Health Surveys. J Am Med Assoc. 2004;291:2581–2590.
    1. Van Ginneken N, Tharyan P, Lewin S, Rao GN, Meera SM, Pian J, et al. Non-specialist health worker interventions for the care of mental, neurological and substance-abuse disorders in low- and middle-income countries. Cochrane Database Syst Rev. 2013;11:CD009149.
    1. Weiss WM, Murray LK, Zangana GAS, Mahmooth Z, Kaysen D, Dorsey S, et al. Community-based mental health treatments for survivors of torture and militant attacks in Southern Iraq: A randomized control trial. BMC Psychiatry. 2015;15(1).
    1. Hoeft TJ, Fortney JC, Patel V, Unützer J. Task-sharing approaches to improve mental health care in rural and other low-resource settings: a systematic review. J Rural Heal. 2018;34(1):48–62.
    1. Chibanda D, Weiss HA, Verhey R, Simms V, Munjoma R, Rusakaniko S, et al. Effect of a primary care-based psychological intervention on symptoms of common mental disorders in Zimbabwe: a randomized clinical trial. JAMA - J Am Med Assoc. 2016;316(24):2618–2626.
    1. Murray LK, Dorsey S, Haroz E, Lee C, Alsiary MM, Haydary A, et al. A common elements treatment approach for adult mental health problems in low- and middle-income countries. Cogn Behav Pract. 2014;21(2):111–123.
    1. Dorsey S, Lucid L, Martin P, King KM, O’Donnell K, Murray LK, et al. Task-shared trauma-focused cognitive behavioral therapy for children who experienced parental death in Kenya and Tanzania: a randomized clinical trial. JAMA Psychiatry. 2019.
    1. van Ginneken N, Tharyan P, Lewin S, Rao GN, Meera SM, Pian J, et al. Non-specialist health worker interventions for the care of mental, neurological and substance-abuse disorders in low- and middle-income countries. Cochrane Database Syst Rev. 2013;(11):–CD009149 [cited 2019 Sep 3]. Available from: .
    1. Padmanathan P, De Silva MJ. The acceptability and feasibility of task-sharing for mental healthcare in low and middle income countries: a systematic review. Soc Sci Med. 2013;97:82–86.
    1. Beidas RS, Kendall PC. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol Sci Pract. 2010;17(1):1–30.
    1. Herschell AD, Kolko DJ, Baumann BL, Davis AC. The role of therapist training in the implementation of psychosocial treatments: a review and critique with recommendations. Clin Psychol Rev. 2010;30(4):448–466.
    1. Rawson RA, Rataemane S, Rataemane L, Ntlhe N, Fox RS, McCuller J, et al. Dissemination and implementation of cognitive behavioral therapy for stimulant dependence: a randomized trial comparison of 3 approaches. Subst Abus. 2013;34(2):108–117.
    1. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Heal Ment Heal Serv Res. 2011;38(2):65–76.
    1. Gilkey MB, Moss JL, Roberts AJ, Dayton AM, Grimshaw AH, Brewer NT. Comparing in-person and webinar delivery of an immunization quality improvement program: a process evaluation of the adolescent AFIX trial. Implement Sci. 2014;9(1):3–5.
    1. Stewart RE, Adams DR, Mandell DS, Hadley TR, Evans AC, Rubin R, et al. The perfect storm: collision of the business of mental health and the implementation of evidence-based practices. Psychiatr Serv. 2016;67(2):159–161.
    1. Rahman A, Akhtar P, Hamdani SU, Atif N, Nazir H, Uddin I, et al. Using technology to scale-up training and supervision of community health workers in the psychosocial management of perinatal depression: a non-inferiority, randomized controlled trial. Glob Ment Heal. 2019;6:1–5.
    1. Lancaster GA, Thabane L. Guidelines for reporting non-randomised pilot and feasibility studies. Pilot Feasibility Stud. 2019;5:114.
    1. Schulz KF, Altman DG, Moher D. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMC Med. 2010;8.
    1. Dorsey S, Gray CL, Wasonga AI, Amanya C, Weiner BJ, Belden CM, et al. Advancing successful implementation of task-shifted mental health care in low-resource settings (BASIC): Protocol for a stepped wedge cluster randomized trial. BMC Psychiatry. 2020;20(1):10.
    1. Cohen JA, Mannarino AP, Deblinger E. Treating trauma and traumatic grief in children and adolescents. New York City: Guilford Press; 2006. p. 273.
    1. Dorsey S, Lucid L, Martin P, King KM, O’Donnell K, Murray LK, et al. Effectiveness of task-shifted trauma-focused cognitive behavioral therapy for children who experienced parental death and posttraumatic stress in Kenya and Tanzania: a randomized clinical trial. JAMA Psychiatry. 2020.
    1. Pea RD. User centered system design: new perspectives on human-computer interaction. J Educ Comput Res. 1987;3 [cited 2019 Sep 3]. Available from: .
    1. Houde S, Hill C. What do prototypes prototype? In: Handbook of human-computer interaction: Elsevier; 1997. p. 367–81.
    1. Lyon AR, Koerner K. User-centered design for psychosocial intervention development and implementation. Clin Psychol (New York) 2016;23(2):180–200.
    1. Bazzano AN, Martin J, Hicks E, Faughnan M, Murphy L. Human-centred design in global health: a scoping review of applications and contexts. PLoS One. 2017;12(11).
    1. Lyon AR, Munson SA, Renn BN, Atkins DC, Pullmann MD, Friedman E, et al. Use of human-centered design to improve implementation of evidence-based psychotherapies in low-resource communities: protocol for studies applying a framework to assess usability. JMIR Res Protoc. 2019;8(10):e1499.
    1. Lyon A, Coifman J, Cook H, Liu F, Ludwig K, Dorsey S. The Cognitive Walk-Through for Implementation Strategies (CWIS): a pragmatic methodology for assessing strategy usability. In: 11th Annual Conference on the Science of Dissemination and Implementation. Washington, D.C; 2018.
    1. Pendse SR, Lalani FM, De Choudhury M, Sharma A, Kumar N. Conference on Human Factors in Computing Systems - Proceedings. New York: Association for Computing Machinery; 2020. “Like shock absorbers”: understanding the human infrastructures of technology-mediated mental health support; pp. 1–14.
    1. What is User Centered Design? | Interaction Design Foundation [Internet]. [cited 2019 Oct 16]. Available from: .
    1. Guest G, Bunce A, Johnson L. How many interviews are enough?: An experiment with data saturation and variability. Field methods. 2006;18(1):59–82.
    1. Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Ment Heal Ment Heal Serv Res. 2015;42(5):533–544.
    1. IDEO. The field guide to human-centered design. 1st ed: ; 2015. p. 1–5.
    1. Kujala S. User studies: A practical approach to user involvement for gathering user needs and requirements. 2002.
    1. Maguire M. Methods to support human-centred design. Int J Hum Comput Stud. 2001;55(4):587–634.
    1. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.
    1. QSR International Pty Ltd . NVivo qualitative data analysis software. 2018.
    1. Hill CE, Thompson BJ, Williams EN. A guide to conducting consensual qualitative research. Couns Psychol. 1997;25(4):517–572.
    1. Oracle Corporation . Workflow process components overview (Sun Identity Manager Deployment Reference) 2010.
    1. Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):1–12.
    1. Lyon A, Pullmann M, Jacobson J, Osterhage K, Al AM, Renn B, et al. Assessing the usability of complex psychosocial interventions: the intervention usability scale. 2020.
    1. Lyon A, Pullmann M, Jacobson J, Osterhage K, Al AM, Renn B, et al. Assessing the usability of complex psychosocial interventions: the intervention usability scale. 2020.
    1. R Core Team . R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2019.
    1. Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Adm Policy Ment Health. 2011;38(1):44–53.
    1. Bhatti Y, Taylor A, Harris M, Wadge H, Escobar E, Prime M, et al. Global lessons in frugal innovation to improve health care delivery in the United States. Health Aff. 2017;36(11):1912–1919.
    1. Naslund JA, Aschbrenner KA, Araya R, Marsch LA, Unützer J, Patel V, et al. Digital technology for treating and preventing mental disorders in low-income and middle-income countries: a narrative review of the literature. Lancet Psychiatry. 2017;4(6):486–500.
    1. Naslund JA, Shidhaye R, Patel V. Digital technology for building capacity of nonspecialist health workers for task sharing and scaling up mental health care globally. Harv Rev Psychiatry. 2019;27(3):181–192.
    1. Kemp CG, Petersen I, Bhana A, Rao D. Supervision of task-shared mental health care in low-resource settings: a commentary on programmatic experience. Glob Heal Sci Pract. 2019;7(2):150–159.
    1. Aarons GA, Ehrhart MG, Moullin JC, Torres EM, Green AE. Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol. Implement Sci. 2017;12(1):29.
    1. Midboe AM, Martino S, Krein SL, Frank JW, Painter JT, Chandler M, et al. Testing implementation facilitation of a primary care-based collaborative care clinical program using a hybrid type III interrupted time series design: a study protocol. Implement Sci. 2018;13(1):145.

Source: PubMed

3
Iratkozz fel