How Reliable are Patient-Reported Rehospitalizations? Implications for the Design of Future Practical Clinical Studies

Arun Krishnamoorthy, Eric D Peterson, J David Knight, Kevin J Anstrom, Mark B Effron, Marjorie E Zettler, Linda Davidson-Ray, Brian A Baker, Patrick L McCollam, Daniel B Mark, Tracy Y Wang, Arun Krishnamoorthy, Eric D Peterson, J David Knight, Kevin J Anstrom, Mark B Effron, Marjorie E Zettler, Linda Davidson-Ray, Brian A Baker, Patrick L McCollam, Daniel B Mark, Tracy Y Wang

Abstract

Background: Longitudinal clinical investigations often rely on patient reports to screen for postdischarge adverse outcomes events, yet few studies have examined the accuracy of such patient reports.

Methods and results: Patients with acute myocardial infarction (MI) in the TRANSLATE-ACS study were asked during structured interviews at 6 weeks, 6 months, and 12 months postdischarge to report any rehospitalizations. The accuracy of patient-reported rehospitalizations within 1 year of postdischarge was determined using claims-based medical bill validation as the reference standard. The cumulative incidence of rehospitalizations was compared when identified by patient report versus medical bills. Patients were categorized by the accuracy in reporting events (accurate, under-, or over- reporters) and characteristics were compared between groups. Among 10 643 MI patients, 4565 (43%) reported 7734 rehospitalizations. The sensitivity and positive predictive value of patient-reported rehospitalizations were low at 67% and 59%, respectively. A higher cumulative incidence of rehospitalization was observed when identified by patient report versus medical bills (43% vs 37%; P<0.001). Overall, 18% of patients over-reported and 10% under-reported the number of hospitalizations. Compared with accurate reporters, under-reporters were more likely to be older, female, African American, unemployed, or a non-high-school graduate, and had greater prevalence of clinical comorbidities such as diabetes and past cardiovascular disease.

Conclusions: The accuracy of patient-reported rehospitalizations was low with patients both under- and over-reporting events. Longitudinal clinical research studies need additional mechanisms beyond patient report to accurately identify rehospitalization events.

Clinical trial registration: URL: https://ichgcp.net/clinical-trials-registry/NCT01088503" title="See in ClinicalTrials.gov">NCT01088503.

Keywords: myocardial infarction; patient outcome assessment; validation studies.

© 2016 The Authors. Published on behalf of the American Heart Association, Inc., by Wiley Blackwell.

Figures

Figure 1
Figure 1
Cumulative incidence of rehospitalizations, stratified by patient‐reported events vs medical bills.
Figure 2
Figure 2
Cumulative incidence of recurrent MI, stratified by patient‐reported MI only vs medical bill triggered, physician validated MI. MI indicates myocardial infarction.

References

    1. Schoen C, Osborn R, Squires D, Doty M, Rasmussen P, Pierson R, Applebaum S. A survey of primary care doctors in ten countries shows progress in use of health information technology, less in other areas. Health Aff (Millwood). 2012;31:2805–2816.
    1. Tu K, Mitiku TF, Ivers NM, Guo H, Lu H, Jaakkimainen L, Kavanagh DG, Lee DS, Tu JV. Evaluation of Electronic Medical Record Administrative data Linked Database (EMRALD). Am J Manag Care. 2014;20:e15–e21.
    1. Beckett M, Weinstein M, Goldman N, Yu‐Hsuan L. Do health interview surveys yield reliable data on chronic illness among older respondents? Am J Epidemiol. 2000;151:315–323.
    1. Walker MK, Whincup PH, Shaper AG, Lennon LT, Thomson AG. Validation of patient recall of doctor‐diagnosed heart attack and stroke: a postal questionnaire and record review comparison. Am J Epidemiol. 1998;148:355–361.
    1. Mahaffey KW, Harrington RA, Akkerhuis M, Kleiman NS, Berdan LG, Crenshaw BS, Tardiff BE, Granger CB, DeJong I, Bhapkar M, Widimsky P, Corbalon R, Lee KL, Deckers JW, Simoons ML, Topol EJ, Califf RM; For the PURSUIT Investigators . Systematic adjudication of myocardial infarction end‐points in an international clinical trial. Curr Control Trials Cardiovasc Med. 2001;2:180–186.
    1. Barr EL, Tonkin AM, Welborn TA, Shaw JE. Validity of self‐reported cardiovascular disease events in comparison to medical record adjudication and a statewide hospital morbidity database: the AusDiab study. Intern Med J. 2009;39:49–53.
    1. Klungel OH, de Boer A, Paes AH, Seidell JC, Bakker A. Cardiovascular diseases and risk factors in a population‐based study in The Netherlands: agreement between questionnaire information and medical records. Neth J Med. 1999;55:177–183.
    1. Oksanen T, Kivimaki M, Pentti J, Virtanen M, Klaukka T, Vahtera J. Self‐report as an indicator of incident disease. Ann Epidemiol. 2010;20:547–554.
    1. Rahman A, Gibney L, Person SD, Williams OD, Kiefe C, Jolly P, Roseman J. Validity of self‐reports of reasons for hospitalization by young adults and risk factors for discordance with medical records: the Coronary Artery Risk Development in Young Adults (CARDIA) Study. Am J Epidemiol. 2005;162:491–498.
    1. Chin CT, Wang TY, Anstrom KJ, Zhu B, Maa JF, Messenger JC, Ryan KA, Davidson‐Ray L, Zettler M, Effron MB, Mark DB, Peterson ED. Treatment with adenosine diphosphate receptor inhibitors‐longitudinal assessment of treatment patterns and events after acute coronary syndrome (TRANSLATE‐ACS) study design: expanding the paradigm of longitudinal observational research. Am Heart J. 2011;162:844–851.
    1. Calvo G, McMurray JJV, Granger CB, Alonso‐García Á, Armstrong P, Flather M, Gómez‐Outes A, Pocock S, Stockbridge N, Svensson A, Van de Werf F. Large streamlined trials in cardiovascular disease. Eur Heart J. 2014;35:544–548.
    1. Pogue J, Walter SD, Yusuf S. Evaluating the benefit of event adjudication of cardiovascular outcomes in large simple RCTs. Clin Trials. 2009;6:239–251.
    1. Sugarman J, Califf RM. Ethics and regulatory complexities for pragmatic clinical trials. JAMA. 2014;311:2381–2382.
    1. Pocock SJ, Gersh BJ. Do current clinical trials meet society's needs? A critical review of recent evidence. J Am Coll Cardiol. 2014;64:1615–1628.
    1. Ware JH, Hamel MB. Pragmatic trials–guides to better patient care? N Engl J Med. 2011;364:1685–1687.
    1. Jencks SF, Williams MV, Coleman EA. Rehospitalizations among patients in the Medicare fee‐for‐service program. N Engl J Med. 2009;360:1418–1428.
    1. Friedman GD, Cutter GR, Donahue RP, Hughes GH, Hulley SB, Jacobs DR Jr, Liu K, Savage PJ. CARDIA: study design, recruitment, and some characteristics of the examined subjects. J Clin Epidemiol. 1988;41:1105–1116.
    1. Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med. 2011;155:97–107.
    1. Fleurence RL, Curtis LH, Califf RM, Platt R, Selby JV, Brown JS. Launching PCORnet, a national patient‐centered clinical research network. J Am Med Inform Assoc. 2014;21:578–582.
    1. Joynt KE, Jha AK. A path forward on Medicare readmissions. N Engl J Med. 2013;368:1175–1177.

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe