Improving Implementation of eMental Health for Mood Disorders in Routine Practice: Systematic Review of Barriers and Facilitating Factors

Christiaan Vis, Mayke Mol, Annet Kleiboer, Leah Bührmann, Tracy Finch, Jan Smit, Heleen Riper, Christiaan Vis, Mayke Mol, Annet Kleiboer, Leah Bührmann, Tracy Finch, Jan Smit, Heleen Riper

Abstract

Background: Electronic mental health interventions (eMental health or eMH) can be used to increase accessibility of mental health services for mood disorders, with indications of comparable clinical outcomes as face-to-face psychotherapy. However, the actual use of eMH in routine mental health care lags behind expectations. Identifying the factors that might promote or inhibit implementation of eMH in routine care may help to overcome this gap between effectiveness studies and routine care.

Objective: This paper reports the results of a systematic review of the scientific literature identifying those determinants of practices relevant to implementing eMH for mood disorders in routine practice.

Methods: A broad search strategy was developed with high sensitivity to four key terms: implementation, mental health care practice, mood disorder, and eMH. The reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) framework was applied to guide the review and structure the results. Thematic analysis was applied to identify the most important determinants that facilitate or hinder implementation of eMH in routine practice.

Results: A total of 13,147 articles were screened, of which 48 studies were included in the review. Most studies addressed aspects of the reach (n=33) of eMH, followed by intervention adoption (n=19), implementation of eMH (n=6), and maintenance (n=4) of eMH in routine care. More than half of the studies investigated the provision of mental health services through videoconferencing technologies (n=26), followed by Internet-based interventions (n=20). The majority (n=44) of the studies were of a descriptive nature. Across all RE-AIM domains, we identified 37 determinants clustered in six main themes: acceptance, appropriateness, engagement, resources, work processes, and leadership. The determinants of practices are expressed at different levels, including patients, mental health staff, organizations, and health care system level. Depending on the context, these determinants hinder or facilitate successful implementation of eMH.

Conclusions: Of the 37 determinants, three were reported most frequently: (1) the acceptance of eMH concerning expectations and preferences of patients and professionals about receiving and providing eMH in routine care, (2) the appropriateness of eMH in addressing patients' mental health disorders, and (3) the availability, reliability, and interoperability with other existing technologies such as the electronic health records are important factors for mental health care professionals to remain engaged in providing eMH to their patients in routine care. On the basis of the taxonomy of determinants of practices developed in this review, implementation-enhancing interventions can be designed and applied to achieve better implementation outcomes. Suggestions for future research and implementation practice are provided.

Keywords: RE-AIM; barriers and facilitators; determinants of practices; eMental health; implementation; mood disorders; review; routine practice.

Conflict of interest statement

Conflicts of Interest: None declared.

©Christiaan Vis, Mayke Mol, Annet Kleiboer, Leah Bührmann, Tracy Finch, Jan Smit, Heleen Riper. Originally published in JMIR Mental Health (http://mental.jmir.org), 16.03.2018.

Figures

Figure 1
Figure 1
Information flow through the different phases of the systematic review.
Figure 2
Figure 2
Spider diagram of the spread of the number of studies (n=48) categorized under the RE-AIM dimensions and the six main groups of determinants we identified in literature: acceptance, appropriateness, engagement, resources, work processes, and leadership. RE-AIM: reach, effectiveness, adoption, implementation, and maintenance.

References

    1. Lindefors N, Andersson G. In: Guided Internet-Based Treatments in Psychiatry. Lindefors N, Andersson G, editors. Cham: Springer; 2016.
    1. Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry. 2014 Oct;13(3):288–95. doi: 10.1002/wps.20151. doi: 10.1002/wps.20151.
    1. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012 Jun;32(4):329–42. doi: 10.1016/j.cpr.2012.02.004.
    1. Riper H, Andersson G, Christensen H, Cuijpers P, Lange A, Eysenbach G. Theme issue on e-mental health: a growing field in internet research. J Med Internet Res. 2010;12(5):e74. doi: 10.2196/jmir.1713.
    1. May CR, Johnson M, Finch T. Implementation, context and complexity. Implement Sci. 2016 Dec 19;11(1):141. doi: 10.1186/s13012-016-0506-3.
    1. Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009 Jan;36(1):24–34. doi: 10.1007/s10488-008-0197-4.
    1. Topooco N, Riper H, Araya R, Berking M, Brunn M, Chevreul K, Cieslak R, Ebert D, Etchmendy E, Herrero R, Kleiboer A, Krieger T, García-Palacios A, Cerga-Pashoja A, Smoktunowicz E, Urech A, Vis C, Andersson G. Attitudes towards digital treatment for depression: a European stakeholder survey. Internet Interv. 2017 Jun;8:1–9. doi: 10.1016/j.invent.2017.01.001.
    1. Wensing M, Oxman A, Baker R, Godycki-Cwirko M, Flottorp S, Szecsenyi J, Grimshaw J, Eccles M. Tailored Implementation For Chronic Diseases (TICD): a project protocol. Implement Sci. 2011 Sep 07;6:103. doi: 10.1186/1748-5908-6-103.
    1. Krause J, Agarwal S, Bodicoat DH, Ring A, Shepherd D, Rogers S, Wensing M, Baker R. Evaluation of a tailored intervention to improve management of overweight and obesity in primary care: study protocol of a cluster randomised controlled trial. Trials. 2014 Mar 19;15:82. doi: 10.1186/1745-6215-15-82.
    1. Aarons GA, Sommerfeld DH. Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. J Am Acad Child Adolesc Psychiatry. 2012 Apr;51(4):423–31. doi: 10.1016/j.jaac.2012.01.018.
    1. Fleuren MA, Paulussen TG, Van Dommelen DP, Van Buuren BS. Towards a measurement instrument for determinants of innovations. Int J Qual Health Care. 2014 Oct;26(5):501–10. doi: 10.1093/intqhc/mzu060.
    1. Wensing M, Huntink E, van Lieshout LJ, Godycki-Cwirko M, Kowalczyk A, Jäger C, Steinhäuser J, Aakhus E, Flottorp S, Eccles M, Baker R. Tailored implementation of evidence-based practice for patients with chronic diseases. PLoS One. 2014;9(7):e101981. doi: 10.1371/journal.pone.0101981.
    1. Wozney L, Newton AS, Gehring ND, Bennett K, Huguet A, Hartling L, Dyson MP, McGrath P. Implementation of eMental Health care: viewpoints from key informants from organizations and agencies with eHealth mandates. BMC Med Inform Decis Mak. 2017 Jun 2;17(1):1. doi: 10.1186/s12911-017-0474-9.
    1. Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012 Sep;43(3):337–50. doi: 10.1016/j.amepre.2012.05.024.
    1. Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:53. doi: 10.1186/s13012-015-0242-0.
    1. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999 Sep;89(9):1322–1327. doi: 10.2105/AJPH.89.9.1322.
    1. Glasgow RE, Klesges LM, Dzewaltowski DA, Estabrooks PA, Vogt TM. Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res. 2006 Oct;21(5):688–94. doi: 10.1093/her/cyl081.
    1. Gaglio B, Shoup JA, Glasgow RE. The RE-AIM framework: a systematic review of use over time. Am J Public Health. 2013 Jun;103(6):e38–46. doi: 10.2105/AJPH.2013.301299.
    1. Belza B, Toobert DJ, Glasgow RE. National Council on Aging. Washington: National Council on Aging; 2014. RE-AIM for Program Planning: Overview and Applications; pp. 1–14.
    1. Jilcott S, Ammerman A, Sommers J, Glasgow RE. Applying the RE-AIM framework to assess the public health impact of policy change. Ann Behav Med. 2007 Oct;34(2):105–14. doi: 10.1080/08836610701564055.
    1. Kleiboer A, Smit J, Bosmans J, Ruwaard J, Andersson G, Topooco N, Berger T, Krieger T, Botella C, Baños R, Chevreul K, Araya R, Cerga-Pashoja A, Cieślak R, Rogala A, Vis C, Draisma S, van Schaik A, Kemmeren L, Ebert D, Berking M, Funk B, Cuijpers P, Riper H. European COMPARative Effectiveness research on blended Depression treatment versus treatment-as-usual (E-COMPARED): study protocol for a randomized controlled, non-inferiority trial in eight European countries. Trials. 2016 Dec 03;17(1):387. doi: 10.1186/s13063-016-1511-1.
    1. Krist AH, Phillips SM, Sabo RT, Balasubramanian BA, Heurtin-Roberts S, Ory MG, Johnson SB, Sheinfeld-Gorin SN, Estabrooks PA, Ritzwoller DP, Glasgow RE, MOHR Study Group Adoption, reach, implementation, and maintenance of a behavioral and mental health assessment in primary care. Ann Fam Med. 2014;12(6):525–33. doi: 10.1370/afm.1710.
    1. Saw A, Kim J, Lim J, Powell C, Tong EK. Smoking cessation counseling for Asian immigrants with serious mental illness: using RE-AIM to understand challenges and lessons learned in primary care-behavioral health integration. Health Promot Pract. 2013 Sep;14(5 Suppl):70S–9S. doi: 10.1177/1524839913483141.
    1. Young J, Gilwee J, Holman M, Messier R, Kelly M, Kessler R. Mental health, substance abuse, and health behavior intervention as part of the patient-centered medical home: a case study. Behav Med Pract Policy Res. 2012 Jun 20;2(3):345–354. doi: 10.1007/s13142-012-0148-1.
    1. Arora PG, Connors EH, Blizzard A, Coble K, Gloff N, Pruitt D. Dissemination and implementation science in program evaluation: A telemental health clinical consultation case example. Eval Program Plann. 2017 Dec;60:56–63. doi: 10.1016/j.evalprogplan.2016.09.003.
    1. Mol M, Dozeman E, van Schaik DJ, Vis CP, Riper H, Smit JH. The therapist's role in the implementation of internet-based cognitive behavioural therapy for patients with depression: study protocol. BMC Psychiatry. 2016 Sep 30;16(1):338. doi: 10.1186/s12888-016-1045-9.
    1. Green S, Higgins J. Cochrane Handbook for Systematic Reviews of Interventions. Chichester, UK: John Wiley & Sons, Ltd; 2008. Sep 26, Preparing a Cochrane review; pp. 11–30.
    1. Arai L, Britten N, Popay J, Roberts H, Petticrew M, Rodgers M, Sowden A. Testing methodological developments in the conduct of narrative synthesis: a demonstration review of research on the implementation of smoke alarm interventions. Evid Policy J Res Debate Pract. 2007 Aug 01;3(3):361–383. doi: 10.1332/174426407781738029.
    1. Mays N, Pope C, Popay J. Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J Health Serv Res Policy. 2005 Jul;10 Suppl 1:6–20. doi: 10.1258/1355819054308576.
    1. Popay J, Roberts H, Snowden A, Petticrew M, Arai L, Rodgers M, Britten N, Roen K, Duffy S. . 2006. Apr, [2018-03-09]. Guidance on the Conduct of Narrative Synthesis in Systematic Reviews: A Product from the ESRC Methods Programme .
    1. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011 Mar;38(2):65–76. doi: 10.1007/s10488-010-0319-7.
    1. Porta M. A Dictionary of Epidemiology, Sixth edition. New York: Oxford University Press; 2014.
    1. Beattie A, Shaw A, Kaur S, Kessler D. Primary-care patients' expectations and experiences of online cognitive behavioural therapy for depression: a qualitative study. Health Expect. 2009 Mar;12(1):45–59. doi: 10.1111/j.1369-7625.2008.00531.x. Included in the review .
    1. De Las Cuevas C, Artiles J, De La Fuente J, Serrano P. Telepsychiatry in the Canary Islands: user acceptance and satisfaction. J Telemed Telecare. 2003;9(4):221–4. doi: 10.1258/135763303322225553. Included in the review.
    1. Gibson KL, Coulson H, Miles R, Kakekakekung C, Daniels E, O'Donnell S. Conversations on telemental health: listening to remote and rural First Nations communities. Rural Remote Health. 2011;11(2):1656. Included in the review .
    1. Graham C, Franses A, Kenwright M, Marks I. Psychotherapy by computer: a postal survey of responders to a teletext article. Psychiatr bull. 2018 Jan 2;24(09):331–332. doi: 10.1192/pb.24.9.331. Included in the review.
    1. Handley TE, Kay-Lambkin FJ, Inder KJ, Attia JR, Lewin TJ, Kelly BJ. Feasibility of internet-delivered mental health treatments for rural populations. Soc Psychiatry Psychiatr Epidemiol. 2014 Feb;49(2):275–82. doi: 10.1007/s00127-013-0708-9. Included in the review.
    1. Hilty DM, Nesbitt TS, Kuenneth CA, Cruz GM, Hales RE. Rural versus suburban primary care needs, utilization, and satisfaction with telepsychiatric consultation. J Rural Health. 2007;23(2):163–5. doi: 10.1111/j.1748-0361.2007.00084.x. Included in the review.
    1. Mucic D. International telepsychiatry: a study of patient acceptability. J Telemed Telecare. 2008 Jul;14(5):241–243. doi: 10.1258/jtt.2008.080301. Included in the review.
    1. Musiat P, Goldstone P, Tarrier N. Understanding the acceptability of e-mental health--attitudes and expectations towards computerised self-help treatments for mental health problems. BMC Psychiatry. 2014 Apr 11;14(1):109. doi: 10.1186/1471-244X-14-109. Included in the review .
    1. Saurman E, Lyle D, Perkins D, Roberts R. Successful provision of emergency mental health care to rural and remote New South Wales: an evaluation of the Mental Health Emergency Care-Rural Access Program. Aust Health Rev. 2014 Feb;38(1):58–64. doi: 10.1071/AH13050. Included in the review.
    1. Boggs JM, Beck A, Felder JN, Dimidjian S, Metcalf CA, Segal ZV. Web-based intervention in mindfulness meditation for reducing residual depressive symptoms and relapse prophylaxis: a qualitative study. J Med Internet Res. 2014 Mar 24;16(3):e87. doi: 10.2196/jmir.3129. Included in the review .
    1. Buist A, Coman G, Silvas A, Burrows G. An evaluation of the telepsychiatry programme in Victoria, Australia. J Telemed Telecare. 2000;6(4):216–21. doi: 10.1258/1357633001935383. Included in the review.
    1. Casey LM, Joy A, Clough BA. The impact of information on attitudes toward e-mental health services. Cyberpsychol Behav Soc Netw. 2013 Aug;16(8):593–8. doi: 10.1089/cyber.2012.0515. Included in the review.
    1. Ebert DD, Berking M, Cuijpers P, Lehr D, Pörtner M, Baumeister H. Increasing the acceptance of internet-based mental health interventions in primary care patients with depressive symptoms. A randomized controlled trial. J Affect Disord. 2015 May 01;176:9–17. doi: 10.1016/j.jad.2015.01.056. Included in the review.
    1. Jones RB, Ashurst EJ. Online anonymous discussion between service users and health professionals to ascertain stakeholder concerns in using e-health services in mental health. Health Informatics J. 2013 Dec;19(4):281–99. doi: 10.1177/1460458212474908. Included in the review.
    1. Mohr DC, Siddique J, Ho J, Duffecy J, Jin L, Fokuo JK. Interest in behavioral and psychological treatments delivered face-to-face, by telephone, and by internet. Ann Behav Med. 2010 Aug;40(1):89–98. doi: 10.1007/s12160-010-9203-7. Included in the review .
    1. Montero-Marín J, Prado-Abril J, Botella C, Mayoral-Cleries F, Baños R, Herrera-Mercadal P, Romero-Sanchiz P, Gili M, Castro A, Nogueira R, García-Campayo J. Expectations among patients and health professionals regarding Web-based interventions for depression in primary care: a qualitative study. J Med Internet Res. 2015 Mar 10;17(3):e67. doi: 10.2196/jmir.3985. Included in the review .
    1. Proudfoot J, Parker G, Hadzi PD, Manicavasagar V, Adler E, Whitton A. Community attitudes to the appropriation of mobile phones for monitoring and managing depression, anxiety, and stress. J Med Internet Res. 2010 Dec 19;12(5):e64. doi: 10.2196/jmir.1475. Included in the review .
    1. Werner P. Willingness to use telemedicine for psychiatric care. Telemed J E Health. 2004;10(3):286–93. doi: 10.1089/tmj.2004.10.286. Included in the review.
    1. Carper MM, McHugh RK, Barlow DH. The dissemination of computer-based psychological treatment: a preliminary analysis of patient and clinician perceptions. Adm Policy Ment Health. 2011 Oct 15;40(2):87–95. doi: 10.1007/s10488-011-0377-5. Included in the review.
    1. Gibson K, O'Donnell S, Coulson H, Kakepetum-Schultz T. Mental health professionals' perspectives of telemental health with remote and rural First Nations communities. J Telemed Telecare. 2011;17(5):263–7. doi: 10.1258/jtt.2011.101011. Included in the review.
    1. Jameson JP, Farmer MS, Head KJ, Fortney J, Teal CR. VA community mental health service providers' utilization of and attitudes toward telemental health care: the gatekeeper's perspective. J Rural Health. 2011;27(4):425–32. doi: 10.1111/j.1748-0361.2011.00364.x. Included in the review.
    1. May CR, Ellis NT, Atkinson T, Gask L, Mair F, Smith C. Psychiatry by videophone: a trial service in north west England. Stud Health Technol Inform. 1999;68:207–10. Included in the review.
    1. May C, Gask L, Atkinson T, Ellis N, Mair F, Esmail A. Resisting and promoting new technologies in clinical practice: the case of telepsychiatry. Soc Sci Med. 2001 Jun;52(12):1889–1901. doi: 10.1016/s0277-9536(00)00305-1. Included in the review.
    1. Monthuy-Blanc J, Bouchard S, Maïano C, Séguin M. Factors influencing mental health providers' intention to use telepsychotherapy in First Nations communities. Transcult Psychiatry. 2013 Apr;50(2):323–43. doi: 10.1177/1363461513487665. Included in the review.
    1. Sinclair C, Holloway K, Riley G, Auret K. Online mental health resources in rural Australia: clinician perceptions of acceptability. J Med Internet Res. 2013 Sep 05;15(9):e193. doi: 10.2196/jmir.2772. Included in the review .
    1. van der Vaart R, Witting M, Riper H, Kooistra L, Bohlmeijer ET, van Gemert-Pijnen LJ. Blending online therapy into regular face-to-face therapy for depression: content, ratio and preconditions according to patients and therapists using a Delphi study. BMC Psychiatry. 2014 Dec 14;14(1):355. doi: 10.1186/s12888-014-0355-z. Included in the review .
    1. Whitten P, Kuwahara E. A multi-phase telepsychiatry programme in Michigan: organizational factors affecting utilization and user perceptions. J Telemed Telecare. 2004;10(5):254–61. doi: 10.1258/1357633042026378. Included in the review.
    1. Ohinmaa A, Roine R, Hailey D, Kuusimäki ML, Winblad I. The use of videoconferencing for mental health services in Finland. J Telemed Telecare. 2008;14(5):266–70. doi: 10.1258/jtt.2008.071212. Included in the review.
    1. Wilhelmsen M, Høifødt RS, Kolstrup N, Waterloo K, Eisemann M, Chenhall R, Risør MB. Norwegian general practitioners' perspectives on implementation of a guided web-based cognitive behavioral therapy for depression: a qualitative study. J Med Internet Res. 2014 Sep 10;16(9):e208. doi: 10.2196/jmir.3556. Included in the review .
    1. Adler G, Pritchett LR, Kauth MR, Nadorff D. A pilot project to improve access to telepsychotherapy at rural clinics. Telemed J E Health. 2014 Jan;20(1):83–5. doi: 10.1089/tmj.2013.0085. Included in the review .
    1. Austen S, McGrath M. Telemental health technology in deaf and general mental-health services: access and use. Am Ann Deaf. 2006;151(3):311–317. doi: 10.1353/aad.2006.0033. Included in the review.
    1. Casey LM, Wright MA, Clough BA. Comparison of perceived barriers and treatment preferences associated with internet-based and face-to-face psychological treatment of depression. Int J Cyber Behav Psychol Learn. 2014 Oct;4(4):16–22. doi: 10.4018/ijcbpl.2014100102. Included in the review.
    1. Hailey D, Ohinmaa A, Roine R, Bulger T. Uptake of telemental health services in Alberta: a success, but not in all regions. J Telemed Telecare. 2016 Dec 02;13(3_suppl):42–44. doi: 10.1258/135763307783247329. Included in the review.
    1. Simpson J, Doze S, Urness D, Hailey D, Jacobs P. Telepsychiatry as a routine service--the perspective of the patient. J Telemed Telecare. 2001;7(3):155–60. doi: 10.1258/1357633011936318. Included in the review.
    1. Whitten P, Do Cz, Kingsley C. An analysis of telepsychiatry programs from an organizational perspective. Cyberpsychol Behav. 2000 Dec;3(6):911–916. doi: 10.1089/109493100452165. Included in the review.
    1. Greenwood J, Chamberlain C, Parker G. Evaluation of a rural telepsychiatry service. Australas Psychiatry. 2004 Sep;12(3):268–72. doi: 10.1080/j.1039-8562.2004.02097.x. Included in the review.
    1. Morrison C, Walker G, Ruggeri K, Hughes JM. An implementation pilot of the MindBalance web-based intervention for depression in three IAPT services. tCBT. 2014 Nov 14;7:e15. doi: 10.1017/S1754470X14000221. Included in the review.
    1. Rowe N, Gibson S, Morley S, Krupinski EA. Ten-year experience of a private nonprofit telepsychiatry service. Telemed J E Health. 2008 Dec;14(10):1078–86. doi: 10.1089/tmj.2008.0037. Included in the review.
    1. Simpson J, Doze S, Urness D, Hailey D, Jacobs P. Evaluation of a routine telepsychiatry service. J Telemed Telecare. 2001;7(2):90–8. doi: 10.1258/1357633011936219. Included in the review.
    1. Avey JP, Hobbs RL. Dial in: fostering the use of telebehavioral health services in frontier Alaska. Psychol Serv. 2013 Aug;10(3):289–97. doi: 10.1037/a0028231. Included in the review.
    1. Rohland BM, Saleh SS, Rohrer JE, Romitti PA. Acceptability of telepsychiatry to a rural population. Psychiatr Serv. 2000 May;51(5):672–4. doi: 10.1176/appi.ps.51.5.672. Included in the review.
    1. Hadjistavropoulos HD, Thompson MJ, Klein B, Austin DW. Dissemination of therapist-assisted internet cognitive behaviour therapy: development and open pilot study of a workshop. Cogn Behav Ther. 2012;41(3):230–40. doi: 10.1080/16506073.2011.645550. Included in the review.
    1. Callahan EJ, Hilty DM, Nesbitt TS. Patient satisfaction with telemedicine consultation in primary care: comparison of ratings of medical and mental health applications. Telemed J. 1998;4(4):363–9. doi: 10.1089/tmj.1.1998.4.363. Included in the review.
    1. Fortney JC, Pyne JM, Mouden SB, Mittal D, Hudson TJ, Schroeder GW, Williams DK, Bynum CA, Mattox R, Rost KM. Practice-based versus telemedicine-based collaborative care for depression in rural federally qualified health centers: a pragmatic randomized comparative effectiveness trial. Am J Psychiatry. 2013 Apr;170(4):414–25. doi: 10.1176/appi.ajp.2012.12050696. Included in the review .
    1. Swinton JJ, Robinson WD, Bischoff RJ. Telehealth and rural depression: physician and patient perspectives. Fam Syst Health. 2009 Jun;27(2):172–82. doi: 10.1037/a0016014. Included in the review.
    1. DeAndrea DC. Testing the proclaimed affordances of online support groups in a nationally representative sample of adults seeking mental health assistance. J Health Commun. 2015;20(2):147–56. doi: 10.1080/10810730.2014.914606. Included in the review.
    1. Titov N, Andrews G, Kemp A, Robinson E. Characteristics of adults with anxiety or depression treated at an internet clinic: comparison with a national survey and an outpatient clinic. PLoS One. 2010 May 28;5(5):e10885. doi: 10.1371/journal.pone.0010885. Included in the review .
    1. Reifels L, Bassilios B, King KE, Fletcher JR, Blashki G, Pirkis JE. Innovations in primary mental healthcare. Aust Health Rev. 2013 Jun;37(3):312–7. doi: 10.1071/AH12203. Included in the review.
    1. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. doi: 10.1111/j.0887-378X.2004.00325.x.
    1. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O, Peacock R. Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Soc Sci Med. 2005 Jul;61(2):417–30. doi: 10.1016/j.socscimed.2004.12.001.
    1. Drozd F, Vaskinn L, Bergsund HB, Haga SM, Slinning K, Bjørkli CA. The implementation of internet interventions for depression: a scoping review. J Med Internet Res. 2016 Sep 08;18(9):e236. doi: 10.2196/jmir.5670.
    1. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation Research: A Synthesis of the Literature. Tampa, Florida, USA: National Implementation Research Network, FMHI Publication #231; 2005. pp. 1–119.
    1. Ross J, Stevenson F, Lau R, Murray E. Factors that influence the implementation of e-health: a systematic review of systematic reviews (an update) Implement Sci. 2016 Dec 26;11(1):146. doi: 10.1186/s13012-016-0510-7.
    1. Hadjistavropoulos HD, Pugh NE, Nugent MM, Hesser H, Andersson G, Ivanov M, Butz CG, Marchildon G, Asmundson GJ, Klein B, Austin DW. Therapist-assisted internet-delivered cognitive behavior therapy for depression and anxiety: translating evidence into clinical practice. J Anxiety Disord. 2014 Dec;28(8):884–893. doi: 10.1016/j.janxdis.2014.09.018.
    1. Schueller SM, Tomasino KN, Mohr DC. Integrating human support into behavioral intervention technologies: the efficiency model of support. Clin Psychol Sci Pract. 2016 Nov 17;24(1):27–45. doi: 10.1111/cpsp.12173.
    1. Vis C, Kleiboer A, Prior R, Bønes E, Cavallo M, Clark SA, Dozeman E, Ebert D, Etzelmueller A, Favaretto G, Zabala AF, Kolstrup N, Mancin S, Mathiassen K, Myrbakk VN, Mol M, Jimenez JP, Power K, van Schaik A, Wright C, Zanalda E, Pederson CD, Smit J, Riper H. Implementing and up-scaling evidence-based eMental health in Europe: the study protocol for the MasterMind project. Internet Interv. 2015 Nov;2(4):399–409. doi: 10.1016/j.invent.2015.10.002.

Source: PubMed

Подписаться