The Hawthorne Effect: a randomised, controlled trial

Rob McCarney, James Warner, Steve Iliffe, Robbert van Haselen, Mark Griffin, Peter Fisher, Rob McCarney, James Warner, Steve Iliffe, Robbert van Haselen, Mark Griffin, Peter Fisher

Abstract

Background: The 'Hawthorne Effect' may be an important factor affecting the generalisability of clinical research to routine practice, but has been little studied. Hawthorne Effects have been reported in previous clinical trials in dementia but to our knowledge, no attempt has been made to quantify them. Our aim was to compare minimal follow-up to intensive follow-up in participants in a placebo controlled trial of Ginkgo biloba for treating mild-moderate dementia.

Methods: Participants in a dementia trial were randomised to intensive follow-up (with comprehensive assessment visits at baseline and two, four and six months post randomisation) or minimal follow-up (with an abbreviated assessment at baseline and a full assessment at six months). Our primary outcomes were cognitive functioning (ADAS-Cog) and participant and carer-rated quality of life (QOL-AD).

Results: We recruited 176 participants, mainly through general practices. The main analysis was based on Intention to treat (ITT), with available data. In the ANCOVA model with baseline score as a co-variate, follow-up group had a significant effect on outcome at six months on the ADAS-Cog score (n = 140; mean difference = -2.018; 95%CI -3.914, -0.121; p = 0.037 favouring the intensive follow-up group), and on participant-rated quality of life score (n = 142; mean difference = -1.382; 95%CI -2.642, -0.122; p = 0.032 favouring minimal follow-up group). There was no significant difference on carer quality of life.

Conclusion: We found that more intensive follow-up of individuals in a placebo-controlled clinical trial of Ginkgo biloba for treating mild-moderate dementia resulted in a better outcome than minimal follow-up, as measured by their cognitive functioning.

Trial registration: Current controlled trials: ISRCTN45577048.

Figures

Figure 1
Figure 1
Participant flowchart.

References

    1. Mayo E. The human problems of an industrial civilization. 2. Vol. 3. New York, MacMillan; 1993. pp. 53–73.
    1. Roethlisberger FJ, Dickson WJ. Management and the Worker. Cambridge, Mass., Harvard University Press; 1939.
    1. Franke RH, Kaul JD. The Hawthorne experiments: First statistical interpretation. Am Sociol Rev. 1978;43:623–643. doi: 10.2307/2094540.
    1. Braunholtz DA, Edwards SJ, Lilford RJ. Are randomized clinical trials good for us (in the short term)? Evidence for a "trial effect". [Review] [26 refs] Journal of Clinical Epidemiology. 2001;54:217–224. doi: 10.1016/S0895-4356(00)00305-X.
    1. Peppercorn JM, Weeks JC, Cook EF, Joffe S. Comparison of outcomes in cancer patients treated within and outside clinical trials: conceptual framework and structured review.[see comment]. [Review] [52 refs] Lancet. 2004;363:263–270. doi: 10.1016/S0140-6736(03)15383-4.
    1. Rosen WG, Mohs RC, Davis KL. A new rating scale for Alzheimer's disease. American Journal of Psychiatry. 1984;141:1356–1364.
    1. Logsdon RC, Gibbons LE, McCurry SM, al. Quality of life in Alzheimer's disease: patient and caregiver reports. Journal of Mental Health and Ageing. 1999;5:21–32.
    1. American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders DSM-IV-TR (Text Revision) 4. Washington, American Psychiatric Press; 2000.
    1. Folstein MF, Folstein SE, McHugh PR. 'Mini-mental state': a practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research. 1975;12:189–198. doi: 10.1016/0022-3956(75)90026-6.
    1. Rogers SL, Friedhoff LT. The efficacy and safety of donepezil in patients with Alzheimer's disease: results of a US Multicentre, Randomized, Double-Blind, Placebo-Controlled Trial. The Donepezil Study Group. Dementia. 1996;7:293–303.
    1. Tariot PN, Cummings JL, Katz IR, Mintzer J, Perdomo CA, Schwam EM, Whalen E. A randomized, double-blind, placebo-controlled study of the efficacy and safety of donepezil in patients with Alzheimer's disease in the nursing home setting.[see comment] Journal of the American Geriatrics Society. 2001;49:1590–1599. doi: 10.1111/j.1532-5415.2001.49266.x.
    1. Birks J. Cholinesterase inhibitors for Alzheimer's disease. [Review] [47 refs] Cochrane Database of Systematic Reviews. 2006. p. CD005593.
    1. O'Connor DW, Pollitt PA, Brook CP, Reiss BB, Roth M. Does early intervention reduce the number of elderly people with dementia admitted to institutions for long term care? BMJ. 1991;302:871–875.
    1. Wickstrom G, Bendix T. The "Hawthorne effect"--what did the original Hawthorne studies actually show? Scandinavian Journal of Work, Environment & Health. 2000;26:363–367.
    1. Rossi P, Freeman H. Evaluation: a systematic approach. London, Sage Publications; 1989.
    1. Jones S. Was there a Hawthorne effect? Am J Sociol. 1992;98:451–468. doi: 10.1086/230046.
    1. Rosen NA, Sales SM. Behavior in a nonexperiment: the effects of behavioral field research on the work performance of factory employees. J Appl Psychol. 1966
    1. Parsons HM. What caused the Hawthorne effect? A scientific detective story. Adm Soc. 1978;10:259–283. doi: 10.1177/009539977801000301.
    1. French J. Experiments in field settings. In: Festinger L and Katz D, editor. Research methods in behavioural sciences. New York, Holt, Rinehart and Wilson; 1953. pp. 98–135.
    1. Rogers SL, Farlow MR, Doody RS, Mohs R, Friedhoff LT, Albala B, Baumel B, Booker G, Dexter J, Farmer M, Feighner JP, Ferris S, Gordon B, Gorman DG, Hanna G, Harrell LE, Hubbard R, Kennedy J, kinney FC, McCarthy J, Scharre DW, Schaerf F, Schneider L, Seltzer B, Siegal A, Stark SR, Strauss A, Walshe TM. A 24-week, double-blind, placebo-controlled trial of donepezil in patients with Alzheimer's disease. Neurology. 1998;50:136–145.
    1. Rosler M, Anand R, Cicin-Sain A, Gauthier S, Agid Y, Dal Bianco P, Stahelin HB, Hartman R, Gharabawi M, Bayer T, Berger A. Efficacy and safety of rivastigmine in patients with Alzheimer's disease: International randomised controlled trial. British Medical Journal. 1999;318:633–640.
    1. Zec RF, Landreth ES, Vicari SK, Belman J, Feldman E, Andrise A, Robbs R, Becker R, Kumar V. Alzheimer Disease Assessment Scale: a subtest analysis. Alzheimer Disease & Associated Disorders. 1992;6:164–181. doi: 10.1097/00002093-199206030-00004.
    1. Talwalker S, Overall JE, Srirama MK, Gracon SI. Cardinal features of cognitive dysfunction in Alzheimer's disease: a factor-analytic study of the Alzheimer's Disease Assessment Scale. Journal of Geriatric Psychiatry & Neurology. 1996;9:39–46.
    1. Hrobjartsson A, Gotzsche PC. Is the Placebo Powerless? — An Analysis of Clinical Trials Comparing Placebo with No Treatment. NEJM. 2001;344:1594–1602. doi: 10.1056/NEJM200105243442106.

Source: PubMed

Patrocinadores y Colaboradores

Condiciones médicas

Intervenciones de drogas

3
Suscribir