The effectiveness of Web-based vs. non-Web-based interventions: a meta-analysis of behavioral change outcomes

Dean J Wantland, Carmen J Portillo, William L Holzemer, Rob Slaughter, Eva M McGhee, Dean J Wantland, Carmen J Portillo, William L Holzemer, Rob Slaughter, Eva M McGhee

Abstract

Background: A primary focus of self-care interventions for chronic illness is the encouragement of an individual's behavior change necessitating knowledge sharing, education, and understanding of the condition. The use of the Internet to deliver Web-based interventions to patients is increasing rapidly. In a 7-year period (1996 to 2003), there was a 12-fold increase in MEDLINE citations for "Web-based therapies." The use and effectiveness of Web-based interventions to encourage an individual's change in behavior compared to non-Web-based interventions have not been substantially reviewed.

Objective: This meta-analysis was undertaken to provide further information on patient/client knowledge and behavioral change outcomes after Web-based interventions as compared to outcomes seen after implementation of non-Web-based interventions.

Methods: The MEDLINE, CINAHL, Cochrane Library, EMBASE, ERIC, and PSYCHInfo databases were searched for relevant citations between the years 1996 and 2003. Identified articles were retrieved, reviewed, and assessed according to established criteria for quality and inclusion/exclusion in the study. Twenty-two articles were deemed appropriate for the study and selected for analysis. Effect sizes were calculated to ascertain a standardized difference between the intervention (Web-based) and control (non-Web-based) groups by applying the appropriate meta-analytic technique. Homogeneity analysis, forest plot review, and sensitivity analyses were performed to ascertain the comparability of the studies.

Results: Aggregation of participant data revealed a total of 11,754 participants (5,841 women and 5,729 men). The average age of participants was 41.5 years. In those studies reporting attrition rates, the average drop out rate was 21% for both the intervention and control groups. For the five Web-based studies that reported usage statistics, time spent/session/person ranged from 4.5 to 45 minutes. Session logons/person/week ranged from 2.6 logons/person over 32 weeks to 1008 logons/person over 36 weeks. The intervention designs included one-time Web-participant health outcome studies compared to non-Web participant health outcomes, self-paced interventions, and longitudinal, repeated measure intervention studies. Longitudinal studies ranged from 3 weeks to 78 weeks in duration. The effect sizes for the studied outcomes ranged from -.01 to .75. Broad variability in the focus of the studied outcomes precluded the calculation of an overall effect size for the compared outcome variables in the Web-based compared to the non-Web-based interventions. Homogeneity statistic estimation also revealed widely differing study parameters (Q(w16) = 49.993, P < or = .001). There was no significant difference between study length and effect size. Sixteen of the 17 studied effect outcomes revealed improved knowledge and/or improved behavioral outcomes for participants using the Web-based interventions. Five studies provided group information to compare the validity of Web-based vs. non-Web-based instruments using one-time cross-sectional studies. These studies revealed effect sizes ranging from -.25 to +.29. Homogeneity statistic estimation again revealed widely differing study parameters (Q(w4) = 18.238, P < or = .001).

Conclusions: The effect size comparisons in the use of Web-based interventions compared to non-Web-based interventions showed an improvement in outcomes for individuals using Web-based interventions to achieve the specified knowledge and/or behavior change for the studied outcome variables. These outcomes included increased exercise time, increased knowledge of nutritional status, increased knowledge of asthma treatment, increased participation in healthcare, slower health decline, improved body shape perception, and 18-month weight loss maintenance.

Conflict of interest statement

None declared.

Figures

Figure 1
Figure 1
Search terms “Web-based Therapy” trended by year of publication

References

    1. Fox S, Falloes D. Internet Health Resources: Health searches and e-mail have become more commonplace, but there is room for improvement in searches and overall Internet access. Washington DC: Pew Internet & American Life Project; 2003. Jul 16, .
    1. Robert Wood Johnson Foundation, authors. Health e-Technologies Initiative. 2002. Oct, [2004 Sep 22].
    1. Bell D S, Kahn C E. Health status assessment via the World Wide Web. Proc AMIA Annu Fall Symp. 1996:338–42.
    1. Locke S E, Kowaloff H B, Hoff R G, Safran C, Popovsky M A, Cotton D J, Finkelstein D M, Page P L, Slack W V. Computer-based interview for screening blood donors for risk of HIV transmission. JAMA. 1992 Sep 9;268(10):1301–5. doi: 10.1001/jama.268.10.1301. .
    1. Gerbert B, Bronstone A, Pantilat S, Mcphee S, Allerton M, Moe J. When asked, patients tell: disclosure of sensitive health-risk behaviors. Med Care. 1999 Jan;37(1):104–11. doi: 10.1097/00005650-199901000-00014.
    1. Balas E A, Austin S M, Mitchell J A, Ewigman B G, Bopp K D, Brown G D. The clinical value of computerized information services. A review of 98 randomized clinical trials. Arch Fam Med. 1996 May;5(5):271–8. doi: 10.1001/archfami.5.5.271.
    1. Lewis D. Computer-based approaches to patient education: a review of the literature. J Am Med Inform Assoc. 1999 Jul;6(4):272–82.
    1. Haynes Brian, Taylor Wayne D. Compliance in health care. Baltimore: Johns Hopkins University Press; 1979. Quality assessment for medication compliance studies; pp. 337–342.
    1. Lewis D. Computer-based approaches to patient education: a review of the literature. J Am Med Inform Assoc. 1999 Jul;6(4):272–82.
    1. Hedges Larry V, Olkin Ingram. Statistical Method for Meta-Analysis. Orlando, Fl: Academic Press; 1985.
    1. Rosenthal Robert. Meta-Analytic Procedures for Social Research (Applied Social Research Methods), Revised ed. Newbury Park: SAGE Publications; 1991. May 1,
    1. Tate D F, Wing R R, Winett R A. Using Internet technology to deliver a behavioral weight loss program. JAMA. 2001 Mar 7;285(9):1172–7. doi: 10.1001/jama.285.9.1172.joc01569
    1. Glasgow Russell E, Boles Shawn M, Mckay H Garth, Feil Edward G, Barrera Manuel. The D-Net diabetes self-management program: long-term implementation, outcomes, and generalization results. Prev Med. 2003 Apr;36(4):410–9. doi: 10.1016/S0091-7435(02)00056-7.S0091743502000567
    1. Mckay H G, King D, Eakin E G, Seeley J R, Glasgow R E. The diabetes network internet-based physical activity intervention: a randomized pilot study. Diabetes Care. 2001 Aug;24(8):1328–34. .
    1. Barrera Manuel, Glasgow Russell E, Mckay H Garth, Boles Shawn M, Feil Edward G. Do Internet-based support interventions change perceptions of social support?: An experimental trial of approaches for supporting diabetes self-management. Am J Community Psychol. 2002 Oct;30(5):637–54. doi: 10.1023/A:1016369114780.
    1. Gómez E J, Cáceres C, López D, Del Pozo F. A web-based self-monitoring system for people living with HIV/AIDS. Comput Methods Programs Biomed. 2002 Jul;69(1):75–86. doi: 10.1016/S0169-2607(01)00182-1.S0169260701001821
    1. Alcañiz Mariano, Botella Cristina, Baños Rosa, Perpiñá Concepción, Rey Beatriz, Lozano José Antonio, Guillén Verónica, Barrera Francisco, Gil José Antonio. Internet-based telehealth system for the treatment of agoraphobia. Cyberpsychol Behav. 2003 Aug;6(4):355–8. doi: 10.1089/109493103322278727.
    1. Meigs James B, Cagliero Enrico, Dubey Anil, Murphy-sheehy Patricia, Gildesgame Catharyn, Chueh Henry, Barry Michael J, Singer Daniel E, Nathan David M. A controlled trial of web-based diabetes disease management: the MGH diabetes primary care improvement project. Diabetes Care. 2003 Mar;26(3):750–7. .
    1. Takabayashi K, Tomita M, Tsumoto S, Suzuki T, Yamazaki S, Honda M, Satomura Y, Iwamoto I, Saito Y, Tomioka H. Computer-assisted instructions for patients with bronchial asthma. Patient Educ Couns. 1999 Nov;38(3):241–8. doi: 10.1016/S0738-3991(99)00015-4.S0738399199000154
    1. Nebel Istva-Tibor, Blüher Matthias, Starcke Ulrike, Müller Ulrich A, Haak Thomas, Paschke Ralf. Evaluation of a computer based interactive diabetes education program designed to train the estimation of the energy or carbohydrate contents of foods. Patient Educ Couns. 2002 Jan;46(1):55–9. doi: 10.1016/S0738-3991(01)00159-8.S0738399101001598
    1. Atherton M. Outcome measures of efficacy associated with a Web-enabled asthma self-management program: Findings from a quasi-experiment. Dis Manag Health Outcomes. 2000; 8(4):233–242.
    1. Lenert Leslie, Muñoz Ricardo F, Stoddard Jackie, Delucchi Kevin, Bansod Aditya, Skoczen Steven, Pérez-stable Eliseo J. Design and pilot evaluation of an internet smoking cessation program. J Am Med Inform Assoc. 2003 Jan;10(1):16–20. doi: 10.1197/jamia.M1128.
    1. Etter Jean-François, Le Houezec Jacques, Landfeldt Björn. Impact of messages on concomitant use of nicotine replacement therapy and cigarettes: a randomized trial on the Internet. Addiction. 2003 Jul;98(7):941–50. doi: 10.1046/j.1360-0443.2003.00406.x.406
    1. Bensen C, Stern J, Skinner E, Beutner K, Conant M, Tyring S, Reitano M, Davis G, Wald A. An interactive, computer-based program to educate patients about genital herpes. Sex Transm Dis. 1999 Jul;26(6):364–8.
    1. Brennan P F, Moore S M, Bjornsdottir G, Jones J, Visovsky C, Rogers M. HeartCare: an Internet-based information and support system for patient home recovery after coronary artery bypass graft (CABG) surgery. J Adv Nurs. 2001 Sep;35(5):699–708. doi: 10.1046/j.1365-2648.2001.01902.x.jan1902
    1. Gustafson D H, Hawkins R, Pingree S, Mctavish F, Arora N K, Mendenhall J, Cella D F, Serlin R C, Apantaku F M, Stewart J, Salner A. Effect of computer support on younger women with breast cancer. J Gen Intern Med. 2001 Jul;16(7):435–45. doi: 10.1046/j.1525-1497.2001.016007435.x.jgi00332
    1. Ojima Miki, Hanioka Takashi, Kuboniwa Masae, Nagata Hideki, Shizukuishi Satoshi. Development of Web-based intervention system for periodontal health: a pilot study in the workplace. Med Inform Internet Med. 2003 Dec;28(4):291–8. doi: 10.1080/14639230310001617823.GDF2DUH18AVMWP43
    1. Jennt NY, Fai TS. Evaluating the effectiveness of an interactive multimedia computer-based patient education program in cardiac rehabilitation. Occup Ther J Res. 2001 Dec; 21(4):260–275.
    1. Clark M, Ghandour G, Miller N H, Taylor C B, Bandura A, Debusk R F. Development and evaluation of a computer-based system for dietary management of hyperlipidemia. J Am Diet Assoc. 1997 Feb;97(2):146–50. doi: 10.1016/S0002-8223(97)00040-0.
    1. Anderson E S, Winett R A, Wojcik J R, Bowden T. A computerized social cognitive intervention for nutrition behavior: direct and mediated effects on fat, fiber, fruits, and vegetables, self-efficacy, and outcome expectations among food shoppers. Ann Behav Med. 2001 Dec;23(2):88–100. doi: 10.1207/S15324796ABM2302_3.
    1. Bangsberg D R, Bronstone A, Hofmann R. A computer-based assessment detects regimen misunderstandings and nonadherence for patients on HIV antiretroviral therapy. AIDS Care. 2002 Feb;14(1):3–15. doi: 10.1080/09540120220097892.
    1. Chou FY. Symptoms and self care strategies in HIV/AIDS: Application of a Web-based survey. San Francisco: University of California, San Francisco; 2003.
    1. Soetikno R M, Mrad R, Pao V, Lenert L A. Quality-of-life research on the Internet: feasibility and potential biases in patients with ulcerative colitis. J Am Med Inform Assoc. 1997 Nov;4(6):426–35.
    1. Wu AW, Yu-isenberg K, Mcgrath M, Jacobson D, Gilchrist K. Reliability, validity and feasability of touch-screen administration of quality of life and adherence instruments in an HIV outpatient clinic. XIII International AIDS Conference. 2000. [2004 February 13]. .
    1. Andersson Gerhard, Strömgren Tryggve, Ström Lars, Lyttkens Leif. Randomized controlled trial of internet-based cognitive behavior therapy for distress associated with tinnitus. Psychosom Med. 2002 Sep;64(5):810–6. doi: 10.1097/01.PSY.0000031577.42041.F8. .
    1. Celio A A, Winzelberg A J, Wilfley D E, Eppstein-herald D, Springer E A, Dev P, Taylor C B. Reducing risk factors for eating disorders: comparison of an Internet- and a classroom-delivered psychoeducational program. J Consult Clin Psychol. 2000 Aug;68(4):650–7. doi: 10.1037//0022-006X.68.4.650.
    1. Christensen Helen, Griffiths Kathleen M, Korten Ailsa. Web-based cognitive behavior therapy: analysis of site usage and changes in depression and anxiety scores. J Med Internet Res. 2002 Feb 15;4(1):e3. doi: 10.2196/jmir.4.1.e3.
    1. Clarke Greg, Reid Ed, Eubanks Donna, O'connor Elizabeth, Debar Lynn L, Kelleher Chris, Lynch Frances, Nunley Sonia. Overcoming depression on the Internet (ODIN): a randomized controlled trial of an Internet depression skills intervention program. J Med Internet Res. 2002 Dec 17;4(3):e14.
    1. Flatley-brennan P. Computer network home care demonstration: a randomized trial in persons living with AIDS. Comput Biol Med. 1998 Sep;28(5):489–508. doi: 10.1016/S0010-4825(98)00029-8.S0010482598000298
    1. Gustafson D H, Hawkins R, Boberg E, Pingree S, Serlin R E, Graziano F, Chan C L. Impact of a patient-centered, computer-based health information/support system. Am J Prev Med. 1999 Jan;16(1):1–9. doi: 10.1016/S0749-3797(98)00108-1.S0749379798001081
    1. Harvey-berino Jean, Pintauro Stephen J, Gold Elizabeth Casey. The feasibility of using Internet support for the maintenance of weight loss. Behav Modif. 2002 Jan;26(1):103–16. doi: 10.1177/0145445502026001006. .
    1. Harvey-berino J, Pintauro S, Buzzell P, Digiulio M, Casey Gold B, Moldovan C, Ramirez E. Does using the Internet facilitate the maintenance of weight loss? Int J Obes Relat Metab Disord. 2002 Sep;26(9):1254–60. doi: 10.1038/sj.ijo.0802051.
    1. Homer C, Susskind O, Alpert H R, Owusu M s, Schneider L, Rappaport L A, Rubin D H. An evaluation of an innovative multimedia educational software program for asthma management: report of a randomized, controlled trial. Pediatrics. 2000 Jul;106(1 Pt 2):210–5. .
    1. Krishna Santosh, Francisco Benjamin D, Balas E Andrew, König Peter, Graff Gavin R, Madsen Richard W Randomized trial, authors. Internet-enabled interactive multimedia asthma education program: a randomized trial. Pediatrics. 2003 Mar;111(3):503–10. doi: 10.1542/peds.111.3.503. .
    1. Lange Alfred, Rietdijk Deirdre, Hudcovicova Milena, Van De Ven Jean-Pierre, Schrieken Bart, Emmelkamp Paul M G. Interapy: a controlled randomized trial of the standardized treatment of posttraumatic stress through the internet. J Consult Clin Psychol. 2003 Oct;71(5):901–9. doi: 10.1037/0022-006X.71.5.901.2003-07816-007
    1. Marshall Alison L, Leslie Eva R, Bauman Adrian E, Marcus Bess H, Owen Neville. Print versus website physical activity programs: a randomized trial. Am J Prev Med. 2003 Aug;25(2):88–94. doi: 10.1016/S0749-3797(03)00111-9.S0749379703001119
    1. Oenema A, Brug J, Lechner L. Web-based tailored nutrition education: results of a randomized controlled trial. Health Educ Res. 2001 Dec;16(6):647–60. doi: 10.1093/her/16.6.647.
    1. Ritterband Lee M, Cox Daniel J, Walker Lynn S, Kovatchev Boris, Mcknight Lela, Patel Kushal, Borowitz Stephen, Sutphen James. An Internet intervention as adjunctive therapy for pediatric encopresis. J Consult Clin Psychol. 2003 Oct;71(5):910–7. doi: 10.1037/0022-006X.71.5.910.2003-07816-008
    1. Southard Barbara H, Southard Douglas R, Nuckolls James. Clinical trial of an Internet-based case management system for secondary prevention of heart disease. J Cardiopulm Rehabil. 2003 Sep;23(5):341–8. doi: 10.1097/00008483-200309000-00003.
    1. Ström L, Pettersson R, Andersson G. A controlled trial of self-help treatment of recurrent headache conducted via the Internet. J Consult Clin Psychol. 2000 Aug;68(4):722–7. doi: 10.1037//0022-006X.68.4.722.
    1. Winzelberg A J, Eppstein D, Eldredge K L, Wilfley D, Dasmahapatra R, Dev P, Taylor C B. Effectiveness of an Internet-based program for reducing risk factors for eating disorders. J Consult Clin Psychol. 2000 Apr;68(2):346–50. doi: 10.1037//0022-006X.68.2.346.
    1. Dodd MJ, Miaskowski C. The PRO-SELF Program: a self-care intervention program for patients receiving cancer treatment. Semin Oncol Nurs. 2000 Nov; 16(4):300–308. discussion 308-316.
    1. Ware J E, Sherbourne C D. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992 Jun;30(6):473–83.
    1. Hobart Jeremy C, Williams Linda S, Moran Kimberly, Thompson Alan J. Quality of life measurement after stroke: uses and abuses of the SF-36. Stroke. 2002 May;33(5):1348–56. doi: 10.1161/01.STR.0000015030.59594.B3. .

Source: PubMed

Sponsorit ja yhteistyökumppanit

Sairaudet

Huumeiden interventiot

3
Tilaa