Comparison of self-report and administrative data sources to capture health care resource use in people with chronic obstructive pulmonary disease following pulmonary rehabilitation

Chantal L Grimwood, Anne E Holland, Christine F McDonald, Ajay Mahal, Catherine J Hill, Annemarie L Lee, Narelle S Cox, Rosemary Moore, Caroline Nicolson, Paul O'Halloran, Aroub Lahham, Rebecca Gillies, Angela T Burge, Chantal L Grimwood, Anne E Holland, Christine F McDonald, Ajay Mahal, Catherine J Hill, Annemarie L Lee, Narelle S Cox, Rosemary Moore, Caroline Nicolson, Paul O'Halloran, Aroub Lahham, Rebecca Gillies, Angela T Burge

Abstract

Background: The optimal method to collect accurate healthcare utilisation data in people with chronic obstructive pulmonary disease (COPD) is not well established. The aim of this study was to determine feasibility and compare self-report and administrative data sources to capture health care resource use in people with COPD for 12 months following pulmonary rehabilitation.

Methods: This is a secondary analysis of a randomised controlled equivalence trial comparing centre-based and home-based pulmonary rehabilitation. Healthcare utilisation data were collected for 12 months following pulmonary rehabilitation from self-report (monthly telephone questionnaires and diaries) and administrative sources (Medicare Benefits Schedule, medical records). Feasibility was assessed by the proportion of self-reports completed and accuracy was established using month-by-month and per participant comparison of self-reports with administrative data.

Results: Data were available for 145/163 eligible study participants (89%, mean age 69 (SD 9) years, mean forced expiratory volume in 1 s 51 (SD 19) % predicted; n = 83 male). For 1725 months where data collection was possible, 1160 (67%) telephone questionnaires and 331 (19%) diaries were completed. Accuracy of recall varied according to type of health care encounter and self-report method, being higher for telephone questionnaire report of emergency department presentation (Kappa 0.656, p < 0.001; specificity 99%, sensitivity 59%) and hospital admission (Kappa 0.669, p < 0.001; specificity 97%, sensitivity 68%) and lower for general practitioner (Kappa 0.400, p < 0.001; specificity 62%, sensitivity 78%) and medical specialist appointments (Kappa 0.458, p < 0.001; specificity 88%, sensitivity 58%). A wide variety of non-medical encounters were reported (allied health and nursing) which were not captured in administrative data.

Conclusion: For self-reported methods of healthcare utilisation in people with COPD following pulmonary rehabilitation, monthly telephone questionnaires were more frequently completed and more accurate than diaries. Compared to administrative records, self-reports of emergency department presentations and inpatient admissions were more accurate than for general practitioner and medical specialist appointments.

Trial registration: NCT01423227 at clinicaltrials.gov.

Keywords: Accuracy; COPD; Diary; Health care utilisation; Hospitalisation; Medical records; Self-report.

Conflict of interest statement

CFM has directed speaker’s fees from Menarini and Astra Zeneca to her institution (unrelated work).

References

    1. Drummond M, Sculpher M, Torrance G, O’Brien J, Stoddart G. Methods for the economic evaluation of health care programmes. 4. London: Oxford University Press; 2015.
    1. Lubeck D, Hubert H. Self-report was a viable method for obtaining health care utilization data in community-dwelling seniors. J Clin Epidemiol. 2005;58:286–290. doi: 10.1016/j.jclinepi.2004.06.011.
    1. World Health Organisation, Global Health Observatory Data . Electronic health records. 2016.
    1. Heslop L. Activity-based funding for safety and quality: a policy discussion of issues and directions for nursing-focused health services outcomes research. Int J Nurs Pract. 2019;25:e12775. doi: 10.1111/ijn.12775.
    1. Menachemi N, Collum T. Benefits and drawbacks of electronic health record systems. Risk Manag Healthcare Policy. 2011;4:47–55. doi: 10.2147/RMHP.S12985.
    1. Dubois M, Raiche M, Hebert R, Rokhaya GN. Assisted self-report of health-services use showed excellent reliability in a longitudinal study of older adults. J Clin Epidemiol. 2007;60:1040–1045. doi: 10.1016/j.jclinepi.2006.12.011.
    1. Bhandari A, Wagner T. Self reported utilization of health care services: improving measurement and accuracy. Med Care. 2006;63:217–235. doi: 10.1177/1077558705285298.
    1. Ritter P, Stewart A, Kaymaz H, Sobel D, Block D, Lorig K. Self-reports of health care utilization compared to provider records. J Clin Epidemiol. 2001;54:136–141. doi: 10.1016/S0895-4356(00)00261-4.
    1. Roberts R, Bergstralh E, Schmidt L, Jacobsen S. Comparison of self-reported and medical record health care utilization measures. J Clin Epidemiol. 1996;49:989–995. doi: 10.1016/0895-4356(96)00143-6.
    1. Jordan K, Jinks C, Croft P. Health care utilization: measurement using primary care records and patient recall both showed bias. J Clin Epidemiol. 2006;59:791–797. doi: 10.1016/j.jclinepi.2005.12.008.
    1. Simon-Tuval T, Scharf S, Maimon N, Bernhard-Scharf B, Reuveni H, Tarasiuk A. Determinants of elevated healthcare utilization in patients with COPD. Respir Res. 2011;12.
    1. The World Bank . The living standards measurement survey. 2020.
    1. University of Michigan, Institute for Social Research . Health and retirement study. 2019.
    1. Goossens M, Rutten-van Molken M, Vlaeyen J, van der Linden S. The cost diary: a method to measure direct and indirect costs in cost-effectiveness research. J Clin Epidemiol. 2000;53:688–695. doi: 10.1016/S0895-4356(99)00177-8.
    1. Hassan E. Recall bias can be a threat to retrospective and prospective research designs. Internet J Epidemiol. 2005;3:1–7.
    1. Brusco N, Watts J. Empirical evidence of recall bias for primary health care visits. BMC Health Serv Res. 2015;15:381. doi: 10.1186/s12913-015-1039-1.
    1. Clarke P, Fiebig D, Gerdtham U. Optimal recall length in survey design. J Health Econ. 2008;27:1275–1284. doi: 10.1016/j.jhealeco.2008.05.012.
    1. Wallihan D, Stump T, Callahan C. Accuracy of self-reported health services use and patterns of care among urban older adults. Med Care. 1999;37:662–670. doi: 10.1097/00005650-199907000-00006.
    1. Wolinsky F, Miller T, An H, Geweke J, Wallace R, Wright K, et al. Hospital episodes and physician visits: the concordance between self-reports and Medicare claims. Med Care. 2007;45:300–307. doi: 10.1097/01.mlr.0000254576.26353.09.
    1. van Dalen M, Suijker J, MacNeil-Vroomen J, van Rijn M, Moll van Charante E, de Rooij S, Buurman B. Self-report of healthcare utilization among community-dwelling older persons: A prospective cohort study. PLOS ONE. 2014;9:e93372. doi: 10.1371/journal.pone.0093372.
    1. Icks A, Dittrich A, Brune M, Kuss O, Hoyer A, Haastert B, et al. Agreement found between self-reported and health insurance data on physician visits comparing different recall lengths. J Clin Epidemiol. 2017;82:167–172. doi: 10.1016/j.jclinepi.2016.10.009.
    1. Jiang L, Zhang B, Smith M, Lorden A, Radcliff T, Lorig K, et al. Concordance between self-reports and Medicare claims among participants in a national study of chronic disease self-management program. Front Public Health. 2015;3.
    1. Pinto D, Robertson M, Hansen P, Abbott J. Good agreement between questionnaire and adminstrative databases for health care use and costs in patients with osteoarthritis. BMC Med Res Methodol. 2011;11:45. doi: 10.1186/1471-2288-11-45.
    1. Sheehan O, Prvu-Bettger J, Huang J, Haley W, Rhodes D, Judd S, et al. Is self or caregiver report comparable to Medicare claims indicators of healthcare utilization after stroke? Top Stroke Rehabil. 2018;25:521–526. doi: 10.1080/10749357.2018.1493251.
    1. Australian Institute of Health and Welfare . Australia’s health series no. 15. Cat. no. AUS 199. Canberra: Australian Government; 2016.
    1. Medical Services Advisory Committee . What is the MBS and Medicare? Canberra: Australian Government, Department of Health; 2016.
    1. Services Australia . Statistical information and data. Canberra: Australian Government; 2020.
    1. Independent Hospital Pricing Authority, Australia. 2019. . Accessed 20 July 2020.
    1. Holland A, Mahal A, Hill C, Lee A, Burge A, Moore R, et al. Benefits and costs of home-based pulmonary rehabilitation in chronic obstructive pulmonary disease - a multi-centre randomised controlled equivalence trial. BMC Pulm Med. 2013;13:57. doi: 10.1186/1471-2466-13-57.
    1. Holland A, Mahal A, Hill C, Lee A, Burge A, Cox N, et al. Home-based rehabilitation for COPD using minimal resources: a randomised, controlled equivalence trial. Thorax. 2017;72:57–65. doi: 10.1136/thoraxjnl-2016-208514.
    1. Divo M, Cote C, de Torres J, Casanova C, Marin J, Pinto-Plata V, et al. Comorbidities and risk of mortality in patients with chronic obstructive pulmonary disease. Am J Respir Crit Care Med. 2012;186:155–161. doi: 10.1164/rccm.201201-0034OC.
    1. Hoogendoorn M, van Wetering C, Schols A, Rutten-van MM. Is INTERdisciplinary COMmunity-based COPD management (INTERCOM) cost-effective? Eur Respi J. 2010;35:79–87. doi: 10.1183/09031936.00043309.
    1. Gillespie P, O'Shea E, Smith S, Cupples M, Murphy A. A comparison of medical records and patient questionnaires as sources for the estimation of costs within research studies and the implications for economic evaluation. Fam Prac. 2016;33:733–739. doi: 10.1093/fampra/cmw088.
    1. Hoogendoorn M, van Wetering C, Schols A, Rutten-van MM. Self-report versus care provider registration of healthcare utilization: impact on cost and cost-utility. Int J Technol Assess Health Care. 2009;25:588–595. doi: 10.1017/S0266462309990432.
    1. van Boven J. Costly comorbidities of COPD: the ignored side of the coin? Eur Respir J. 2017;50:1700917. doi: 10.1183/13993003.00917-2017.

Source: PubMed

Sponsorer og samarbejdspartnere

Medicinske tilstande

Narkotikainterventioner

3
Abonner