Examining assumptions regarding valid electronic monitoring of medication therapy: development of a validation framework and its application on a European sample of kidney transplant patients

Kris Denhaerynck, Petra Schäfer-Keller, James Young, Jürg Steiger, Andreas Bock, Sabina De Geest, Kris Denhaerynck, Petra Schäfer-Keller, James Young, Jürg Steiger, Andreas Bock, Sabina De Geest

Abstract

Background: Electronic monitoring (EM) is used increasingly to measure medication non-adherence. Unbiased EM assessment requires fulfillment of assumptions. The purpose of this study was to determine assumptions needed for internal and external validity of EM measurement. To test internal validity, we examined if (1) EM equipment functioned correctly, (2) if all EM bottle openings corresponded to actual drug intake, and (3) if EM did not influence a patient's normal adherence behavior. To assess external validity, we examined if there were indications that using EM affected the sample representativeness.

Methods: We used data from the Supporting Medication Adherence in Renal Transplantation (SMART) study, which included 250 adult renal transplant patients whose adherence to immunosuppressive drugs was measured during 3 months with the Medication Event Monitoring System (MEMS). Internal validity was determined by assessing the prevalence of nonfunctioning EM systems, the prevalence of patient-reported discrepancies between cap openings and actual intakes (using contemporaneous notes and interview at the end of the study), and by exploring whether adherence was initially uncharacteristically high and decreased over time (an indication of a possible EM intervention effect). Sample representativeness was examined by screening for differences between participants and non-participants or drop outs on non-adherence.

Results: Our analysis revealed that some assumptions were not fulfilled: 1) one cap malfunctioned (0.4%), 2) self-reported mismatches between bottle openings and actual drug intake occurred in 62% of the patients (n = 155), and 3) adherence decreased over the first 5 weeks of the monitoring, indicating that EM had a waning intervention effect.

Conclusion: The validity assumptions presented in this article should be checked in future studies using EM as a measure of medication non-adherence.

Figures

Figure 1
Figure 1
Overview of possible violations of the assumptions underlying internal and external validity of EM: effects on the non-adherence estimate.
Figure 2
Figure 2
Algorithm estimating a patient's non-adherence to the EM guidelines.
Figure 3
Figure 3
Patient-sample profile.
Figure 4
Figure 4
Observed course of non-adherence over time.

References

    1. Liu H, Golin CE, Miller LG, Hays RD, Beck CK, Sanandaji S, Christian J, Maldonado T, Duran D, Kaplan AH, et al. A comparison study of multiple measures of adherence to HIV protease inhibitors. Ann Intern Med. 2001;134:968–977.
    1. Cramer JA. Microelectronic systems for monitoring and enhancing patient compliance with medication regimens. Drugs. 1995;49:321–327. doi: 10.2165/00003495-199549030-00001.
    1. Chaisson RE, Barnes GL, Hackman J, Watkinson L, Kimbrough L, Metha S, Cavalcante S, Moore RD. A randomized, controlled trial of interventions to improve adherence to isoniazid therapy to prevent tuberculosis in injection drug users. Am J Med. 2001;110:610–615. doi: 10.1016/S0002-9343(01)00695-7.
    1. Wendel CS, Mohler MJ, Kroesen K, Ampel NM, Gifford AL, Coons SJ. Barriers to use of electronic adherence monitoring in an HIV clinic. Ann Pharmacother. 2001;35:1010–1015. doi: 10.1345/aph.10349.
    1. 2007, September 28.
    1. Bova CA, Fennie KP, Knafl GJ, Dieckhaus KD, Watrous E, Williams AB. Use of electronic monitoring devices to measure antiretroviral adherence: practical considerations. AIDS Behav. 2005;9:103–110. doi: 10.1007/s10461-005-1685-0.
    1. Weng FL, Israni AK, Joffe MM, Hoy T, Gaughan CA, Newman M, Abrams JD, Kamoun M, Rosas SE, Mange KC, et al. Race and electronically measured adherence to immunosuppressive medications after deceased donor renal transplantation. J Am Soc Nephrol. 2005;16:1839–1848. doi: 10.1681/ASN.2004121059.
    1. Fennie KP, Bova CA, Williams AB. Adjusting and censoring electronic monitoring device data. Implications for study outcomes. J Acquir Immune Defic Syndr. 2006;43:S88–95.
    1. Deschamps AE, Graeve VD, van Wijngaerden E, De Saar V, Vandamme AM, Van Vaerenbergh K, Ceunen H, Bobbaers H, Peetermans WE, De Vleeschouwer PJ, et al. Prevalence and correlates of nonadherence to antiretroviral therapy in a population of HIV patients using Medication Event Monitoring System. AIDS Patient Care STDS. 2004;18:644–657. doi: 10.1089/apc.2004.18.644.
    1. Dunbar-Jacob J, Sereika S, Rohay JM, Burke LE. Electronic methods in assessing adherence to medical regimens. In: Krantz D, Baum A Mahwah, editor. Technology and methods in behavioral medicine. NJ: Lawrence Erlbaum Associates; 1998. pp. 95–113.
    1. Burke LE. Electronic measurement. In: Burke LE, Ockene IS, editor. Compliance in Healthcare and Research. Armonk: Futura Publishing Co; 2001. pp. 117–138.
    1. De Geest S, Abraham I, Moons P, Vandeputte M, Van Cleemput J, Evers G, Daenen W, Vanhaecke J. Late acute rejection and subclinical noncompliance with cyclosporine therapy in heart transplant recipients. J Heart Lung Transplant. 1998;17:854–863.
    1. Matsui D, Hermann C, Klein J, Berkovitch M, Olivieri N, Koren G. Critical comparison of novel and existing methods of compliance assessment during a clinical trial of an oral iron chelator. J Clin Pharmacol. 1994;34:944–949.
    1. Elixhauser A, Eisen SA, Romeis JC, Homan SM. The effects of monitoring and feedback on compliance. Med Care. 1990;28:882–893. doi: 10.1097/00005650-199010000-00003.
    1. Wagner GJ. Does discontinuing the use of pill boxes to facilitate electronic monitoring impede adherence? Int J STD AIDS. 2003;14:64–65. doi: 10.1258/095646203321043327.
    1. Wagner GJ, Ghosh-Dastidar B. Electronic monitoring: adherence assessment or intervention? HIV Clin Trials. 2002;3:45–51. doi: 10.1310/XGXU-FUDK-A9QT-MPTF.
    1. Reddel HK, Toelle BG, Marks GB, Ware SI, Jenkins CR, Woolcock AJ. Analysis of adherence to peak flow monitoring when recording of data is electronic. BMJ. 2002;324:146–147. doi: 10.1136/bmj.324.7330.146.
    1. Fulmer TT, Feldman PH, Kim TS, Carty B, Beers M, Molina M, Putnam M. An intervention study to enhance medication compliance in community-dwelling elderly individuals. J Gerontol Nurs. 1999;25:6–14.
    1. Bertholet N, Favrat B, Fallab-Stubi CL, Brunner HR, Burnier M. Why objective monitoring of compliance is important in the management of hypertension. J Clin Hypertens (Greenwich) 2000;2:258–262.
    1. Yeung M, O'Connor SA, Parry DT, Cochrane GM. Compliance with prescribed drug therapy in asthma. Respir Med. 1994;88:31–35. doi: 10.1016/0954-6111(94)90171-6.
    1. Cramer JA, Ouellette VL, Mattson RH. Effect of microelectronic observation on compliance. Epilepsia. 1990;21:617–618.
    1. Denhaerynck K, Steiger J, Bock A, Schafer-Keller P, Kofer S, Thannberger N, De Geest S. Prevalence and risk factors of non-adherence with immunosuppressive medication in kidney transplant patients. Am J Transplant. 2007;7:108–116. doi: 10.1111/j.1600-6143.2006.01611.x.
    1. Hastie T, Tibshirani RJ. Generalized Additive Models. London: Chapman & Hall; 1990.
    1. 2006, August 5.
    1. Vrijens B, Tousset E, Rode R, Bertz R, Mayer S, Urquhart J. Successful projection of the time course of drug concentration in plasma during a 1-year period from electronically compiled dosing-time data used as input to individually parameterized pharmacokinetic models. J Clin Pharmacol. 2005;45:461–467. doi: 10.1177/0091270004274433.
    1. Deschamps AE, Denhaerynck K, Vandamme A, Van Wijngaerden E, De Geest S. Electronic Monitoring induces a 40-day intervention effect in HIV-patients. JAIDS. 2006. p. 2.
    1. Dunbar-Jacob J, Foley S. A historical overview of medication adherence. In: Dunbar-Jacob J, Erlen J, Schlenk E, Stilley C, editor. Methodological issues in the study of adherence. Pittsburg: School of Nursing; 2005.
    1. Vrijens B, Goetghebeur E. Comparing compliance patterns between randomized treatments. Control Clin Trials. 1997;18:187–203. doi: 10.1016/S0197-2456(96)00235-8.
    1. Osterberg L, Blaschke T. Adherence to medication. N Engl J Med. 2005;353:487–497. doi: 10.1056/NEJMra050100.
    1. Glass TR, De Geest S, Weber R, Vernazza PL, Rickenbach M, Furrer H, Bernasconi E, Cavassini M, Hirschel B, Battegay M, et al. Correlates of self-reported nonadherence to antiretroviral therapy in HIV-infected patients: the Swiss HIV Cohort Study. J Acquir Immune Defic Syndr. 2006;41:385–392. doi: 10.1097/01.qai.0000186371.95301.52.

Source: PubMed

Patrocinadores e Colaboradores

Condições médicas

Intervenções de drogas

3
Se inscrever