Exploring the Relationship Between the Acceptability of an Internet-Based Intervention for Depression in Primary Care and Clinical Outcomes: Secondary Analysis of a Randomized Controlled Trial

Adriana Mira, Carla Soler, Marta Alda, Rosa Baños, Diana Castilla, Adoración Castro, Javier García-Campayo, Azucena García-Palacios, Margalida Gili, Mariena Hurtado, Fermín Mayoral, Jesús Montero-Marín, Crisitina Botella, Adriana Mira, Carla Soler, Marta Alda, Rosa Baños, Diana Castilla, Adoración Castro, Javier García-Campayo, Azucena García-Palacios, Margalida Gili, Mariena Hurtado, Fermín Mayoral, Jesús Montero-Marín, Crisitina Botella

Abstract

Background: Depression is one of the most prevalent psychological disorders worldwide. Although psychotherapy for depression is effective, there are barriers to its implementation in primary care in Spain. The use of the Internet has been shown to be a feasible solution. However, the acceptability of Internet-based interventions has not been studied sufficiently. Objective: To assess the acceptability of an Internet-based intervention (IBI) for depression in primary care, and explore the relationship between expectations and satisfaction and the improvement in the clinical variables in primary care patients receiving this intervention. Furthermore, it offers data about the effects of some sociodemographic characteristics on these acceptability variables and analyzes whether the expectations are related to finalizing the intervention. Methods: Data were based on depressive patients who were participants in a randomized controlled trial. In the present study, we present the data from all the participants in the Internet intervention groups (N = 198). All the participants filled out the expectation and satisfaction scales (six-item scales regarding treatment logic, satisfaction, recommending, usefulness for other disorders, usefulness for the patient, and unpleasantness), the Beck Depression Inventory-II, and the secondary outcome measures: depression and anxiety impairment, and positive and negative affect. Results: Results showed that participants' expectations and satisfaction with the program were both high and differences in expectations and satisfaction depended on some sociodemographic variables (age: older people have higher expectations; sex: women have greater satisfaction). A positive relationship between these variables and intervention efficacy was found: expectations related to "usefulness for the patient" were a statistically related predictor to the results on the BDI-II (Beta = 0.364), and the perception of how logical the treatment is (Beta = 0.528) was associated with change in the clinical variable. Furthermore, the higher the expectations, the higher the improvements exhibited by the patients in all measures evaluated during the ten intervention modules. High expectations were also directly related to finalizing the intervention. Conclusions: This is the first study in Spain to address this issue in the field of IBIs for depression in primary care. The IBI showed high acceptance related to the intervention's efficacy and completion. Research on IBI acceptability could help to implement the treatment offered. Clinical Trial Registration: www.ClinicalTrials.gov, identifier NCT01611818.

Keywords: Internet-based intervention; acceptability; depression; expectations; primary care; satisfaction.

References

    1. Fernández FC, Martínez ÁM, Barragán AB, Martín M, del Mar Molero M. Prevalencia de la depresión en España: análisis de los últimos 15 años. Eur J Invest (2015) 5(2):267–79. 10.30552/ejihpe.v5i2.118
    1. Haro JM, Ayuso-Mateos JL, Bitter I, Demotes-Mainard J, Leboyer M, Lewis SW, et al. ROAMER: roadmap for mental health research in Europe. Int J Meth Psych Res (2014) 23(S1):1–14. 10.1002/mpr.1406
    1. Cuijpers P, Beekman AT, Reynolds CF. Preventing depression: a global priority. JAMA (2012) 307(10):1033–4. 10.1001/jama.2012.271
    1. Smit F, Cuijpers P, Oostenbrink J, Batelaan N, de Graaf R, Beekman A. Costs of nine common mental disorders: implications for curative and preventive psychiatry. J Ment Health Policy (2006) 9(4):193–200.
    1. Cano-Vindel A, Salguero JM, Mae Wood C, Dongil E, Latorre JM. La depresión en atención primaria: prevalencia, diagnóstico y tratamiento. Papeles del psicólogo (2012) 33(1):2–11.
    1. Üstün TB, Ayuso-Mateos JL, Chatterji S, Mathers C, Murray CJ. Global burden of depressive disorders in the year 2000. Br J Psychiatry (2004) 184(5):386–92. 10.1192/bjp.184.5.386
    1. World Health Organization Depression and other common mental disorders. CC BY-NC-SA 30 IGO (2017) (1):1–22.
    1. Mohr DC, Ho J, Duffecy J, Baron KG, Lehman KA, Jin L, et al. Perceived barriers to psychological treatments and their relationship to depression. J Clin Psychol (2010) 66(4):394–409. 10.1002/jclp.20659
    1. Lester H, Howe A. Depression in primary care: three key challenges. Postgrad med j (2008) 84(996):545–48. 10.1136/pgmj.2008.068387
    1. Marks IM, Cavanagh K, Gega L. Computer-aided psychotherapy: revolution or bubble? Br J Psychiatry (2007) 191(6):471–73. 10.1192/bjp.bp.107.041152
    1. Purves DG, Bennett M, Wellman N. An open trial in the NHS of Blues Begone®: a new home based computerized CBT program. Behav Cogn Psychother (2009) 37(5):541–51. 10.1017/S1352465809990282
    1. Cuijpers P, van Straten A, Warmerdam L, van Rooy MJ. Recruiting participants for interventions to prevent the onset of depressive disorders: possible ways to increase participation rates. BMC Health Serv Res (2010) 10(1):181. 10.1186/1472-6963-10-181
    1. Kazdin AE, Blasé SL. Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspect Psychol Sci (2011) 6(1):21–37. 10.1177/1745691610393527
    1. Kazdin AE, Rabbitt SM. Novel models for delivering mental health services and reducing the burdens of mental illness. Clin Psychol Sci (2013) 1(2):170–91. 10.1177/2167702612463566
    1. Cuijpers P, van Straten A, Schuurmans J, van Oppen P, Hollon SD, Andersson G. Psychotherapy for chronic major depression and dysthymia: a meta-analysis. Clin Psychol Rev (2010) 30(1):51–62. 10.1016/j.cpr.2009.09.003
    1. Ellis LA, Collin P, Hurley PJ, Davenport TA, Burns JM, Hickie IB. Young men’s attitudes and behaviour in relation to mental health and technology: implications for the development of online mental health services. BMC Psychiatry (2013) 13(1):119. 10.1186/1471-244X-13-119
    1. Kazdin AE. Technology-based interventions and reducing the burdens of mental illness: perspectives and comments on the special series. Cogn Behav Pract (2015) 22(3):359–66. 10.1016/j.cbpra.2015.04.004
    1. Kaltenthaler E, Brazier J, De Nigris E, Tumur I, Ferriter M, Beverley C, et al. Computerised cognitive behaviour therapy for depression and anxiety update: a systematic review and economic evaluation. Health Technol Asses (2006) 10(33):1–186. 10.3310/hta10330
    1. Kaltenthaler E, Parry G, Beverley C, Ferriter M. Computerised cognitive–behavioural therapy for depression: systematic review. Br J Psychiatry (2008) 193(3):181–4. 10.1192/bjp.bp.106.025981
    1. Johansson R, Andersson G. Internet-based psychological treatments for depression. Expert Rev Neurother (2012) 12(7):861–9. 10.1586/ern.12.63
    1. Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, et al. Efficacy of self-guided Internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry (2017) 74(4):351–9. 10.1001/jamapsychiatry.2017.0044
    1. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev (2012) 32(4):329–42. 10.1016/j.cpr.2012.02.004
    1. Paganini S, Teigelkötter W, Buntrock C, Baumeister H. Economic evaluations of internet-and mobile-based interventions for the treatment and prevention of depression: a systematic review. J Affect Disord (2018) 225:733–55. 10.1016/j.jad.2017.07.018
    1. Schröder J, Berger T, Westermann S, Klein JP, Moritz S. Internet interventions for depression: new developments. Dialogues Clin Neurosci (2016) 18(2):203.
    1. Spek V, Cuijpers PIM, Nyklíček I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med (2007) 37(3):319–28. 10.1017/S0033291706008944
    1. Gun SY, Titov N, Andrews G. Acceptability of Internet treatment of anxiety and depression. Australas Psychiatry (2011) 19(3):259–64. 10.3109/10398562.2011.562295
    1. Quero S, Botella C, Bretón JM, Soler C, Mira A, Baños RM. Future clinical psychologists’ attitudes toward an Internet-based intervention for treating. 18th Annual CyberPsychology and Cybertherapy Conference: Proceedings of Experience the Future of Health & Well-Being. Brussels, Belgium: Virtual Reality Medical Institute & Interactive Media Institute; (2013).
    1. González-Peña P, Torres R, del Barrio V, Olmedo M. Uso de las nuevas tecnologías por parte de los psicólogos españoles y sus necesidades. Clínica y Salud (2017) 28(2):81–91. 10.1016/j.clysa.2017.01.001
    1. Montero-Marín J, Araya R, Pérez-Yus M, Mayoral F, Gili M, Botella C, et al. An internet-based intervention for depression in primary care in Spain: a randomized controlled trial. J Med Internet Res (2016) 18(8):e231. 10.2196/jmir.5695
    1. Clarke G, Eubanks D, Reid CK, O’Connor E, DeBar LL, Lynch F, et al. Overcoming depression on the Internet (ODIN)(2): a randomized trial of a self-help depression skills program with reminders. J Med Internet Res (2005) 7(2):e16. 10.2196/jmir.7.2.e16
    1. Learmonth D, Rai S. Taking computerized CBT beyond primary care. Brit J Clin Psychol (2008) 47(1):111–8. 10.1348/014466507X248599
    1. Montero-Marín J, Prado-Abril J, Botella C, Mayoral-Cleries F, Baños R, Herrera-Mercadal P, et al. Expectations among patients and health professionals regarding Web-based interventions for depression in primary care: a qualitative study. J Med Internet Res (2015) 17(3). 10.1186/1471-244X-13-64
    1. Whiteside U, Richards J, Steinfeld B, Simon G, Caka S, Tachibana C, et al. Online cognitive behavioral therapy for depressed primary care patients: a pilot feasibility project. Perm J (2014) 18(2):21. 10.7812/TPP/13-155
    1. De Graaf LE, Gerhards SAH, Arntz A, Riper H, Metsemakers JFM, Evers SMAA, et al. Clinical effectiveness of online computerised cognitive–behavioural therapy without support for depression in primary care: randomised trial. Brit J Psychiat (2009) 195(1):73–80. 10.1192/bjp.bp.108.054429
    1. Ebert DD, Berking M, Cuijpers P, Lehr D, Pörtner M, Baumeister H. Increasing the acceptance of Internet-based mental health interventions in primary care patients with depressive symptoms. J Affect Disord (2015) 176:9–17. 10.1016/j.jad.2015.01.056
    1. Schröder J, Berger T, Meyer B, Lutz W, Hautzinger M, Späth C, et al. Attitudes towards Internet interventions among psychotherapists and individuals with mild to moderate depression symptoms. Cognit Ther Res (2017) 41(5):745–56. 10.1007/s10608-017-9850-0
    1. Wallin EE, Mattsson S, Olsson EM. The preference for Internet-based psychological interventions by individuals without past or current use of mental health treatment delivered online: a survey study with mixed-methods analysis. JMIR Ment Health (2016) 3(2):e25. 10.2196/mental.5324
    1. Kazdin AE. Acceptability of alternative treatments for deviant child behavior. J Appl Behav Anal (1980) 13(2):259–73. 10.1901/jaba.1980.13-259
    1. Rush B, Scott RE. Approved telehealth outcome indicator guidelines: quality, access, acceptability and cost. Calgary, AB, Canada: Calgary Health Telematics Unit, University of Calgary; (2004).
    1. Swift JK, Callahan JL. The impact of client treatment preferences on outcome: a meta-analysis. J Clin Psychol (2009) 65(4):368–81. 10.1016/j.cpr.2005.03.002
    1. Peñate W, Fumero A. A meta-review of Internet computer-based psychological treatments for anxiety disorders. J Telemed Telecare (2016) 22(1):3–11. 10.1177/1357633X15586491
    1. Botella C, Gallego MJ, García-Palacios A, Baños RM, Quero S, Alcañiz M. The acceptability of an Internet-based self-help treatment for fear of public speaking. Brit J Guid Couns (2009) 37(3):297–311. 10.1080/03069880902957023
    1. Botella C, Mira A, Moragrega I, García-Palacios A, Bretón-López J, Castilla D, et al. An Internet-based program for depression using activity and physiological sensors: efficacy, expectations, satisfaction, and ease of use. Neuropsych Dis Treat (2016) 12:393. 10.2147/NDT.S93315
    1. Botella C, Pérez-Ara MÁ, Bretón-López J, Quero S, García-Palacios A, Baños RM. In vivo versus augmented reality exposure in the treatment of small animal phobia: a randomized controlled trial. PLoS One (2016) 11(2):e0148237. 10.1371/journal.pone.0148237
    1. De Graaf LE, Huibers MJ, Riper H, Gerhards SA, Arntz A. Use and acceptability of unsupported online computerized cognitive behavioral therapy for depression and associations with clinical outcome. J Affect Disord (2009) 116(3):227–31. 10.1016/j.jad.2008.12.009
    1. Greenberg RP, Constantino MJ, Bruce N. Are patient expectations still relevant for psychotherapy process and outcome? Clin Psychol Rev (2006) 26(6):657–78. 10.1016/j.cpr.2005.03.002
    1. Buchanan T, Johnson JA, Goldbergn LR. Implementing a five-factor personality inventory for use on the internet. Eur J Psychol Assess (2005) 21(2):115–27. 10.1027/1015-5759.21.2.115
    1. Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: toward a unified view. MIS Quarterly (2003) 27(3):425–78. 10.2307/30036540
    1. Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly (1989) 13(3):319. 10.2307/249008
    1. Holden RJ, Karsh B. The technology acceptance model: its past and its future in health care. J Biomed Inform (2010) Feb 43(1):159–72. 10.1016/j.jbi.2009.07.002
    1. Dünnebeil S, Sunyaev A, Blohm I, Leimeister JM, Krcmar H. Determinants of physicians’ technology acceptance for e-health in ambulatory care. Int J Med Inform (2012) Nov 81(11):746–60. 10.1016/j.ijmedinf.2012.02.002
    1. Wootton BM, Titov N, Dear BF, Spence J, Kemp A. The acceptability of Internet-based treatment and characteristics of an adult sample with obsessive compulsive disorder: an Internet survey. PLoS One (2011) 6(6):e20548. 10.1371/journal.pone.0020548
    1. López-del-Hoyo Y, Olivan B, Luciano JV, Mayoral F, Roca M, Gili M, et al. Low intensity vs. BMC Psychiatry (2013) 13(1):21. 10.1186/1471-244X-13-21
    1. Sanz J, García-Vera MP, Espinosa R, Fortún M, Vázquez C. Adaptación española del Inventario para la Depresión de Beck-II (BDI-II): 3. Clínica y salud (2005) 16(2):249–80.
    1. Lecrubier Y, Sheehan DV, Weiller E, Amorim P, Bonora I, Sheehan KH, et al. The Mini International Neuropsychiatric Interview (MINI). Eur Psychiat (1997) 12(5):224–31. 10.1016/S0924-9338(97)83296-8
    1. Algoe SB, Fredrickson BL. Emotional fitness and the movement of affective science from lab to field. Am Psychol (2011) 66(1):35. 10.1037/a0021720
    1. Ekers D, Richards D, McMillan D, Bland JM, Gilbody S. Behavioural activation delivered by the non-specialist: phase II randomised controlled trial. Brit J Psychiat (2011) 198(1):66–72. 10.1192/bjp.bp.110.079111
    1. Mira A, Bretón-López J, García-Palacios A, Quero S, Baños RM, Botella C. An Internet-based program for depressive symptoms using human and automated support: a randomized controlled trial. Neuropsych Dis Treat (2017) 13:987. 10.2147/NDT.S130994
    1. Ferrando L, Bobes J, Gibert J, Lecrubier Y. MINI International Neuropsychiatric Interview. Spanish version, 5(0). In: Bobes J, Bousoño M, González MP, editors. Management of mental and behavioral disorders in primary care. Gofer; (1997).
    1. Beck AT, Steer RA, Brown GK. Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological; (1996) 78(2):490–8. 10.1037/t00742-000
    1. Schotte CKW, Maes M, Cluydts R, De Doncker D, Cosyns P. Construct validity of the Beck Depression Inventory in a depressive population. J Affect Disord (1997) 46(2):115–25. 10.1016/S0165-0327(97)00094-3
    1. Bentley KH, Gallagher MW, Carl JR, Barlow DH. Development and validation of the Overall Depression Severity and Impairment Scale. Psychol Assessment (2014) 26(3):815. 10.1037/a0036216
    1. González-Robles A, Mira A, Breton-Lopez J, Riera A, Raya D, Baños RM, et al. Psychometric properties of the Overall Depression Severity and Impairment Scale in Spanish sample. General and clinical populations. Proceedings of European Society for Research on Internet Intervention Warsaw (2015). p. 205.
    1. Norman SB, Hami Cissell S, Means-Christensen AJ, Stein MB. Development and validation of an overall anxiety severity and impairment scale (OASIS). J Depress Anxiety (2006) 23(4):245–9. 10.1002/da.20182
    1. González-Robles A, Mira A, Miguel C, Molinari G, Garcia-Palacios A, Bretón-López J, et al. A brief online transdiagnostic measure: psychometric properties of the Overall Anxiety Severity and Impairment Scale (OASIS) among Spanish patients with emotional disorders. PLoS One (2018) 13(11):e0206516. 10.1371/journal.pone.0206516
    1. Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol (1988) 54(6):1063. 10.1037//0022-3514.54.6.1063
    1. Sandín B, Chorot P, Lostao L, Joiner TE, Santed MA, Valiente RM. Escalas PANAS de afecto positivo y negativo: validación factorial y convergencia transcultural. Psicothema (1999) 11(1):37–51.
    1. Borkovec TD, Nau SD. Credibility of analogue therapy rationales. J Behav Ther Exp Psychiatry (1972) 3(4):257–60. 10.1016/0005-7916(72)90045-6
    1. Quero S, Campos D, Mira A, Castilla D, Botella C, Bretón-López J. Exploring the relationship between the acceptability of a flying phobia treatment delivered via the Internet and clinical outcomes. Proceedings of 22th Annual CyberPsychology, Cybertherapy & Social Networking Conference England, UK:Virtual Reality Medical Institute & Interactive Media Institute (2017).
    1. Tortella-Feliu M, Botella C, Llabrés J, Bretón-López JM, del Amo AR, Baños RM, et al. Virtual reality versus computer-aided exposure treatments for fear of flying. Behav Modif (2011) 35(1):3–30. 10.1177/0145445510390801
    1. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale, NJ: Erlbaum; (1988).
    1. Sherry A, Henson RK. Conducting and interpreting canonical correlation analysis in personality research: a user-friendly primer. J Pers Assess (2005) 84(1):37–48. 10.1207/s15327752jpa8401_09
    1. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One (2010) 5(10):e13196. 10.1371/journal.pone.0013196
    1. Kaltenthaler E, Sutcliffe P, Parry G, Beverley C, Rees A, Ferriter M. The acceptability to patients of computerized cognitive behaviour therapy for depression: a systematic review. Psychol Med (2008) 38(11):1521–30. 10.1017/S0033291707002607
    1. Montero-Marín J, Carrasco JM, Roca M, Serrano-Blanco A, Gili M, Mayoral F, et al. Expectations, experiences and attitudes of patients and primary care health professionals regarding online psychotherapeutic interventions for depression: protocol for a qualitative study. BMC Psychiatry (2013) 13(1):64. 10.1186/1471-244X-13-64
    1. Titov N, Dear BF, Schwencke G, Andrews G, Johnston L, Craske MG, et al. Transdiagnostic internet treatment for anxiety and depression: a randomised controlled trial. Behav Res Ther (2011) 49(8):441–52. 10.1016/j.brat.2011.03.007
    1. Waller R, Gilbody S. Barriers to the uptake of computerized cognitive behavioural therapy: a systematic review of the quantitative and qualitative evidence. Psychol Med (2009) 39(5):705–12. 10.1017/S0033291708004224
    1. Karyotaki E, Kleiboer A, Smit F, Turner DT, Pastor AM, Andersson G, et al. Predictors of treatment dropout in self-guided web-based interventions for depression: an ‘individual patient data meta-analysis’. Psychol Med (2015) 45(13):2717–26. 10.1017/S0033291715000665
    1. Babwah F, Baksh S, Blake L, Cupid-Thuesday J, Hosein I, Sookhai A, et al. The role of gender in compliance and attendance at an outpatient clinic for type 2 diabetes mellitus in Trinidad. Revista Panamericana de SaludPública (2006) 19(2):79–84. 10.1590/S1020-49892006000200002
    1. Haro JM, Palacín C, Vilagut G, Martínez M, Bernal M, Luque I, et al. Prevalencia de los trastornos mentales y factores asociados: resultados del estudio ESEMeD-España. Med Clin (2006) 126(12):445–51. 10.1157/13086324
    1. Melville KM, Casey LM, Kavanagh DJ. Dropout from Internet-based treatment for psychological disorders. Br J Clin Psychol (2010) 49(4):455–71. 10.1348/014466509X472138
    1. Van Ballegooijen W, Cuijpers P, van Straten A, Karyotaki E, Andersson G, Smit JH, et al. Adherence to Internet-based and face-to-face cognitive behavioural therapy for depression: a meta-analysis. PLoS One (2014) 9(7):e100674. 10.1371/journal.pone.0100674
    1. Santana L, Fontenelle LF. A review of studies concerning treatment adherence of patients with anxiety disorders. Patient Prefer Adherence (2011) 5:427. 10.2147/PPA.S23439
    1. Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther (2009) 38(4):196–205. 10.1080/16506070903318960
    1. Romero-Sanchiz P, Nogueira-Arjona R, García-Ruiz A, Luciano JV, García-Campayo J, Gili M, et al. Economic evaluation of a guided and unguided internet-based CBT intervention for major depression: results from a multicenter, three-armed randomized controlled trial conducted in primary care. PLoS One (2017) 12(2):e0172741. 10.1371/journal.pone.0172741
    1. Becker EM, Jensen-Doss A. Computer-assisted therapies: examination of therapist-level barriers to their use. Behav Ther (2013) 44(4):614–24. 10.1016/j.beth.2013.05.002
    1. Campos D, Quero S, Bretón López J, Riera del Amo A, Mira A, Tortella Feliu M, et al. Concordancia entre la evaluación psicológica a través de Internet y la evaluación tradicional aplicada por el terapeuta para la fobia a volar. TesisPsicológica (2015) 10(2):52–67.
    1. Carlbring P, Brunt S, Bohman S, Austin D, Richards J, Öst LG, et al. Internet vs. Comput Human Behav (2007) 23(3):1421–34. 10.1016/j.chb.2005.05.002
    1. Hedman E, Ljótsson B, Rück C, Furmark T, Carlbring P, Lindefors N, et al. Internet administration of self-report measures commonly used in research on social anxiety disorder: a psychometric evaluation. Comput Human Behav (2010) 26(4):736–40. 10.1016/j.chb.2010.01.010
    1. Hedman E, Ljótsson B, Blom K, El Alaoui S, Kraepelien M, Rück C, et al. Telephone versus internet administration of self-report measures of social anxiety, depressive symptoms, and insomnia: psychometric evaluation of a method to reduce the impact of missing data. J Med Internet Res (2013) 15(10):e229. 10.2196/jmir.2818
    1. Fernández-Álvarez J, Díaz-García A, González-Robles A, Baños R, García-Palacios A, Botella C. Dropping out of a transdiagnostic online intervention: a qualitative analysis of client’s experiences. Internet Interv (2017) 10:29–38. 10.1016/j.invent.2017.09.001
    1. Boß L, Lehr D, Reis D, Vis C, Riper H, Berking M, et al. Reliability and validity of assessing user satisfaction with web-based health interventions. J Med Internet Res (2016) 18(8):e234. 10.2196/jmir.5952

Source: PubMed

赞助者和合作者

医疗条件

药物干预

3
订阅