Detecting When "Quality of Life" Has Been "Enhanced": Estimating Change in Quality of Life Ratings

Rochelle E Tractenberg, Futoshi Yumoto, Paul S Aisen, Rochelle E Tractenberg, Futoshi Yumoto, Paul S Aisen

Abstract

Objective: To demonstrate challenges in the estimation of change in quality of life (QOL).

Methods: Data were taken from a completed clinical trial with negative results. Responses to 13 QOL items were obtained 12 months apart from 258 persons with Alzheimer's disease (AD) participating in a randomized, placebo-controlled clinical trial with two treatment arms. Two analyses to estimate whether "change" in QOL occurred over 12 months are described. A simple difference (later - earlier) was calculated from total scores (standard approach). A Qualified Change algorithm (novel approach) was applied to each item: differences in ratings were classified as either: improved, worsened, stayed poor, or stayed "positive" (fair, good, excellent). The strengths of evidence supporting a claim that "QOL changed", derived from the two analyses, were compared by considering plausible alternative explanations for, and interpretations of, results obtained under each approach.

Results: Total score approach: QOL total scores decreased, on average, in the two treatment (both -1.0, p < 0.05), but not the placebo (=-0.59, p > 0.3) groups. Qualified change approach: Roughly 60% of all change in QOL items was worsening in every arm; 17% - 42% of all subjects experienced change in each item.

Conclusions: Totalling the subjective QOL item ratings collapses over items, and suggests a potentially misleading "overall" level of change (or no change, as in the placebo arm). Leaving the items as individual components of "quality" of life they were intended to capture, and qualifying the direction and amount of change in each, suggests that at least 17% of any group experienced change on every item, with 60% of all observed change being worsening.

Discussion: Summarizing QOL item ratings as a total "score" collapses over the face-valid, multi-dimensional components of the construct "quality of life". Qualified Change provides robust evidence of changes to QOL or "enhancements of" life quality.

Keywords: Data Interpretation; Longitudinal Analysis; Scale Type; Statistical Method.

References

    1. Bentham J. Deontology; or The science of Morality. London, UK: Longman, Reese, Orme, Borwne, Green & Longman; 1834.
    1. Brown MM, Brown GC. Update on value-based medicine. Current Opinion in Ophthalmology. 2013;24:183–189. .
    1. De Gruiter DN, van der Kamp LJT. Statistical test theory for the behavioral sciences. Boca Raton, FL: Chapman & Hall/CRC; 2008.
    1. de Vet HC, Terwee CB, Bouter LM. Current challenges in clinimetrics. Journal of Clinical Epidemiology. 2003;56:1137–1141. .
    1. de Vet HC, Terwee CB, Ostelo RW, Beckerman H, Knol DL, Bouter LM. Minimal changes in health status questionnaires: distinction between minimally detectable change and minimally important change. Health and Quality of Life Outcomes. 2006;22:4–54.
    1. Embretson SE, Reise S. Item response theory for psychologists. Mahwah, NJ: Lawrence Earlbaum Associates; 2000.
    1. Ettema TP, Dröes R-M, de Lange J, Mellenbergh GJ, Ribbe MW. A review of quality of life instruments used in dementia. Quality of Life Research. 2005;14:675–686. .
    1. Fava GA, Belaise C. A discussion on the role of clinimet-rics and the misleading effects of psychometric theory. Journal of Clinical Epidemiology. 2005;58:753–756. .
    1. Frei A, Svarin A, Steurer-Stey C, Puhan MA. Self-efficacy instruments for patients with chronic diseases suffer from methodological limitations—A systematic review. Health and Quality of Life Outcomes. 2009;7:86–95. .
    1. Garcia SF, Cella D, Clauser SB, Flynn KE, Lad T, Lai JS, Reeve BB, Smith AW, Stone AA, Weinfurt K. Standardizing patient-reported outcomes assessment in cancer clinical trials: A patient-reported outcomes measurement information system initiative. Journal of Clinical Oncology. 2007;25:5106–5112. .
    1. Hand DJ. Measurement theory and practice: The world through quantification. London, UK: Arnold; 2004.
    1. Howard JS, Mattacola CG, Howell DM, Lattermann C. Response shift theory: An application for health-related quality of life in rehabilitation research and practice. Journal of Allied Health. 2011;40:31–38.
    1. Kuhn TS. The structure of scientific revolutions. 3rd ed. Chicago, IL: University of Chicago Press; 1996. .
    1. Logsdon RG, Gibbons LE, McCurry SM, Teri L. Quality of life in Alzheimer’s disease: Patient and caregiver reports. Journal of Mental Health and Aging. 1999;5:21–32.
    1. Logsdon RG, Gibbons LE, McCurry SM, et al. Assessing changes in QOL in AD; 9th International Conference on Alzheimer’s Disease and Related Disorders.2004.
    1. Meyer KB, Clayton KA. Measurement and analysis of patient-reported outcomes. Methods in Molecular Biology. 2009;473:155–169. .
    1. Mislevy RJ. Substance and structure in assessment arguments. Law, Probability and Risk. 2003;2:237–258. .
    1. Nunnally JC, Bernstein IH. Psychometric Theory. 3rd ed. New York, NY: McGraw-Hill; 1994.
    1. Revicki DA, Cella DF. Health status assessment for the twenty-first century: Item response theory, item banking and computer adaptive testing. Quality of Life Research. 1997;6:595–600. .
    1. Rothman M, Burke L, Erickson P, Leidy NK, Patrick DL, Petrie CD. Use of existing patient-reported outcome (PRO) instruments and their modification: The ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report. Value in Health. 2009;12:1075–1083. .
    1. Schwartz CE. Applications of response shift theory and methods to participation measurement: A brief history of a young field. Archives of Physical Medicine and Rehabilitation. 2010;91:S38–S43. .
    1. Schwartz CE, Sprangers MA, Oort FJ, Ahmed S, Bode R, Li Y, Vollmer T. Response shift in patients with multiple sclerosis: an application of three statistical techniques. Quality of Life Research. 2011;20:1561–1572. .
    1. Sheskin DJ. Handbook of parametric and nonparametric statistical procedures. 4th ed. Boca Raton, FL: Chapman & Hall/CRC; 2004.
    1. Stevens SS. On the theory of scales and measurement. Science. 1946;103:677–680. .
    1. Streiner DL. Clinimetrics vs. psychometrics: An unnecessary distinction. Journal of Clinical Epidemiology. 2003;56:1142–1145. .
    1. Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PMM. On assessing responsiveness of health-related quality of life instruments: Guidelines for instrument evaluation. Quality of Life Research. 2003;12:349–362. .
    1. Tractenberg RE, Chaterji R, Haramati A. Assessing and analyzing change in attitudes in the classroom. Assessment and Evaluation in Higher Education. 2007;32:107–120. .
    1. Tractenberg RE, Jin S, Patterson M, Schneider LS, Gamst AG, Thomas RG, Thal LJ. Qualifying change: A method for defining “clinically-meaningful” outcomes of change score computation. Journal of the American Geriatrics Society. 2000;48:1478–1482.
    1. Tractenberg RE, Gamst A, Thomas RG, Patterson MB, Schneider LS, Thal LJ. Investigating emergent symptomatology as an outcome measure in a behavioral study of Alzheimer’s disease. Journal of Neuropsychiatry and Clinical Neuro-science. 2002;14:303–310. .
    1. Waters D, Sierpina VS. Goal-Directed Health Care and the chronic pain patient: A new vision of the healing encounter. Pain Physician. 2006;9:353–360.
    1. WHOQOL Group. Measuring Quality of Life: The development of the World Health Organization Quality of Life Instrument. Geneva: WHO; 1993.

Source: PubMed

3
订阅