Variability in CKD Biomarker Studies: Soluble Urokinase Plasminogen Activator Receptor (suPAR) and Kidney Disease Progression in the Chronic Kidney Disease in Children (CKiD) Study
Alison G Abraham, Yunwen Xu, Jennifer L Roem, Jason H Greenberg, Darcy K Weidemann, Venkata S Sabbisetti, Joseph V Bonventre, Michelle Denburg, Bradley A Warady, Susan L Furth, Alison G Abraham, Yunwen Xu, Jennifer L Roem, Jason H Greenberg, Darcy K Weidemann, Venkata S Sabbisetti, Joseph V Bonventre, Michelle Denburg, Bradley A Warady, Susan L Furth
Abstract
Rationale & objective: Biomarker studies are important for generating mechanistic insight and providing clinically useful predictors of chronic kidney disease (CKD) progression. However, variability across studies can often muddy the evidence waters. Here we evaluated real-world variability in biomarker studies using two published studies, independently conducted, of the novel plasma marker soluble urokinase-type plasminogen activator receptor (suPAR) for predicting CKD progression in children with CKD.
Study design: A comparison of 2 prospective cohort studies.
Setting & participants: 541 children from the Chronic Kidney Disease in Children (CKiD) study, median age 12 years, median glomerular filtration rate (GFR) of 54 mL/min/1.73m2.
Outcome: The first occurrence of either a 50% decline in GFR from baseline or incident end-stage kidney disease.
Analytical approach: The suPAR plasma marker was measured using the Quantikine ELISA immunoassay in the first study and Meso Scale Discovery (MSD) platform in the second. The analytical approaches varied. We used suPAR data from the 2 assays and mimicked each analytical approach in an overlapping subset.
Results: We found that switching assays had the greatest impact on inferences, resulting in a 38% to 66% change in the magnitude of the effect estimates. Covariate and modeling choices resulted in an additional 8% to 40% variability in the effect estimate. The cumulative variability led to different inferences despite using a similar sample of CKiD participants and addressing the same question.
Limitations: The estimated variability does not represent optimal repeatability but instead illustrates real-world variability that may be present in the CKD biomarker literature.
Conclusions: Our results highlight the importance of validation, avoiding conclusions based on P value thresholds, and providing comparable metrics. Further transparency of data and equal weighting of negative and positive findings in explorations of novel biomarkers will allow investigators to more quickly weed out less promising biomarkers.
Keywords: biomarker variability; chronic kidney disease; kidney disease progression; suPAR.
© 2021 The Authors.
Figures
References
- Selvin E., Manzi J., Stevens L.A. Calibration of serum creatinine in the National Health and Nutrition Examination Surveys (NHANES) 1988-1994, 1999-2004. Am J Kidney Dis. 2007;50(6):918–926.
- Inker L.A., Eckfeldt J., Levey A.S. Expressing the CKD-EPI (Chronic Kidney Disease Epidemiology Collaboration) cystatin C equations for estimating GFR with standardized serum cystatin C values. Am J Kidney Dis. 2011;58(4):682–684.
- Larsson A., Hansson L.-O., Flodin M. Calibration of the Siemens cystatin C immunoassay has changed over time. Clin Chem. 2011;57(5):777–778.
- Voskoboev N.V., Larson T.S., Rule A.D. Importance of cystatin C assay standardization. Clin Chem. 2011;57(8):1209–1211.
- Maahs D.M., Jalal D., McFann K. Systematic shifts in cystatin C between 2006 and 2010. Clin J Am Soc Nephrol. 2011;6(8):1952–1955.
- Garbe E., Levesque L., Suissa S. Variability of breast cancer risk in observational studies of hormone replacement therapy: a meta-regression analysis. Maturitas. 2004;47(3):175–183.
- Brambilla D., Reichelderfer P.S., Bremer J.W. The contribution of assay variation and biological variation to the total variability of plasma HIV-1 RNA measurements. The Women Infant Transmission Study Clinics. Virology Quality Assurance Program. AIDS. 1999;13(16):2269–2279.
- Waters K.M., Le Marchand L., Kolonel L.N. Generalizability of associations from prostate cancer genome-wide association studies in multiple populations. Cancer Epidemiol Biomarkers Prev. 2009;18(4):1285–1289.
- Greenberg J.H., Abraham A.G., Xu Y. Plasma biomarkers of tubular injury and inflammation are associated with CKD progression in children. J Am Soc Nephrol. 2020;31(5):1067–1077.
- Weidemann D.K., Abraham A.G., Roem J.L. Plasma soluble urokinase plasminogen activator receptor (suPAR) and CKD progression in children. Am J Kidney Dis. 2020;76(2):194–202.
- Schwartz G.J., Munoz A., Schneider M.F. New equations to estimate GFR in children with CKD. J Am Soc Nephrol. 2009;20(3):629–637.
- Flynn J.T., Kaelber D.C., Baker-Smith C.M. Subcommittee on Screening and Management of High Blood Pressure in Children. Clinical practice guideline for screening and management of high blood pressure in children and adolescents. Pediatrics. 2017;140(3) Published correction appears in Pediatrics. 2018;142(3):e20181739.
- Warady B.A., Abraham A.G., Schwartz G.J. Predictors of rapid progression of glomerular and nonglomerular kidney disease in children and adolescents: The Chronic Kidney Disease in Children (CKiD) Cohort. Am J Kidney Dis. 2015;65(6):878–888.
- Bland J.M., Altman D.G. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–310.
- Bennette C., Vickers A. Against quantiles: categorization of continuous variables in epidemiologic research, and its discontents. BMC Med Res Methodol. 2012;12:21.
- Kofoed K., Schneider U.V., Scheel T. Development and validation of a multiplex add-on assay for sepsis biomarkers using xMAP technology. Clin Chem. 2006;52(7):1284–1293.
- Greenland S., Senn S.J., Rothman K.J. Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations. Eur J Epidemiol. 2016;31(4):337–350.
Source: PubMed