A population-based risk algorithm for the development of diabetes: development and validation of the Diabetes Population Risk Tool (DPoRT)
Laura C Rosella, Douglas G Manuel, Charles Burchill, Thérèse A Stukel, PHIAT-DM team, Laura C Rosella, Douglas G Manuel, Charles Burchill, Thérèse A Stukel, PHIAT-DM team
Abstract
Background: National estimates of the upcoming diabetes epidemic are needed to understand the distribution of diabetes risk in the population and to inform health policy.
Objective: To create and validate a population-based risk prediction tool for incident diabetes using commonly collected national survey data.
Methods: With the use of a cohort design that links baseline risk factors to a validated population-based diabetes registry, a model (Diabetes Population Risk Tool (DPoRT)) was developed to predict 9-year risk for diabetes. The probability of developing diabetes was modelled using sex-specific Weibull survival functions for people > 20 years of age without diabetes (N=19,861). The model was validated in two external cohorts in Ontario (N=26,465) and Manitoba (N=9899). Predictive accuracy and model performance were assessed by comparing observed diabetes rates with predicted estimates. Discrimination and calibration were measured using a C statistic and Hosmer-Lemeshow χ² statistic (χ²(H-L)).
Results: Predictive factors included were body mass index, age, ethnicity, hypertension, immigrant status, smoking, education status and heart disease. DPoRT showed good discrimination (C=0.77-0.80) and calibration (χ²(H-L) < 20) in both external validation cohorts.
Conclusions: This algorithm can be used to estimate diabetes incidence and quantify the effect of interventions using routinely collected survey data.
Conflict of interest statement
Competing interests: None.
Figures
References
- Anderson KM, Wilson PWF, Odell PM, et al. An Updated Coronary Risk Profile - A Statement for Health-Professionals. Circulation 1991;83:356–62
- Hippisley-Cox J, Coupland C, Vinogradova Y, et al. Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study. Br Med J 2007;335:136–41
- Wild S, Roglic G, Green A, et al. Global prevalence of diabetes - Estimates for the year 2000 and projections for 2030. Diabetes Care 2004;27:1047–53
- Zimmet P, Alberti KGMM, Shaw J. Global and societal implications of the diabetes epidemic. Nature 2001;414:782–7
- Manuel DG, Kwong K, Tanuseputro P, et al. Effectiveness and efficiency of different guidelines on statin treatment for preventing deaths from coronary heart disease: modelling study. BMJ 2005;332:1419–22
- Eddy DM, Schlessinger L. Validation of the archimedes diabetes model. Diabetes Care 2003;26:3102–10
- Hanley AJG, Williams K, Gonzalez C, et al. Prediction of type 2 diabetes using simple measures of insulin resistance - combined results from the San Antonio Heart Study, the Mexico city diabetes study, and the insulin resistance atherosclerosis study. Diabetes 2003;52:463–9
- Ito C, Maeda R, Nakamura K, et al. Prediction of diabetes mellitus (NIDDM). Diabetes Res Clin Pract 1996;34 (Suppl):S7–11
- Herman WH, Smith PJ, Thompson TJ, et al. A new and simple questionnaire to identify people at increased risk for undiagnosed diabetes. Diabetes Care 1995;18:382–7
- Lindstrom J, Tuomilehto J. The diabetes risk score: a practical tool to predict type 2 diabetes risk. Diabetes Care 2007;26:725–31
- Larsson H, Lindgerde F, Berglund G, et al. Prediction of diabetes using ADA or WHO criteria in post-menopousal women: a 10-year follow-up study. Diabetologia 2000;43:279–88
- Stern MP, Williams K, Haffner SM. Identification of persons at high risk of type 2 diabetes mellitus: Do we need the oral glucose tolerance test. Ann Intern Med 2009;136:575–81
- Wilson P, Meigs JB, Sullivan LM, et al. Prediction of incident diabetes mellitus in middle-aged adults. Arch Intern Med 2007;167:1068–74
- Statistics Canada 1996-97 NPHS public use microdata documentation. Ottawa: Statistics Canada, 1999
- Statistics Canada Canadian community health survey methodological overview. Health Reports 2002;13:9–14
- Statistics Canada Canadian community health survey 2000–2001. Statistics Canada. ed. Ottawa: Statistics Canada, 2003. Ref Type: Data File.
- Hux JE, Ivis F. Diabetes in Ontario. Diabetes Care 2005;25:512–16
- Lipscombe LL, Hux JE. Trends in diabetes prevalence, incidence, and mortality in Ontario, Canada 1995-2005: a population-based study. Lancet 2007;369:750–16
- Health Canada Responding to the challenge of diabetes in Canada. Ottawa, ON, 2003
- Statistics Canada 1996-7 National population health survey. Ottawa: Derived Variable Specifications, 1999
- Odell PM, Anderson KM, Kannel WB. New models for predicting cardiovascular events. J Clin Epidemiol 1994;47:583–92
- Farewell VT, Prentice RL. A study of distributional shape in life testing. Technometrics 1977;19:69–75
- Campbell G. General methodology I: advances in statistic methodology for the evaluation of diagnostic and laboratory tests. Stat Med 2004;13:499–508
- Pencina M, D'Agostino RB. Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Stat Med 2004;23:2109–23
- Hosmer DW, Hosmer T, Cessie LE, et al. A comparison of goodness-of-ft tests for the logistic regression model. Stat Med 1997;16:965–80
- D'Agostino RB, Grundy S, Sullivan LM, et al. Validation of the framingham coronary disease prediction scores. JAMA 2001;286:180–7
- Nam BH. Discrimination and calibration in survival analysis: extension of the ROC curve for descrimination and chi-square test for calibration boston University. 2000
- Yeo D, Mantel H, Lui TP. Bootstrap variance estimation for the national population health survey. Baltimore: American Statistical Association, 1999
- Kovacevic MS, Mach L, Roberts G. Bootstrap variance estimation for predicted individual and population-average risks. Proceedings of the Survey Research Methods Section. Alexandria VA: American Statistical Association, 2008
- D'Agostino RB, Griffith JL, Schmidt CH, et al. Measures for evaluating model performance. proceedings of the biometrics section. Alexandria, VA: American Statistical Association, Biometrics Section, 1997:253–8
- Altman DG, Royston P. What do we mean by validating a prognostic model? Stat Med 2000;19:453–73
- Harrell FE, Lee KL, Mark DB. Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996;15:361–87
- Boyle JP, Honeycutt AA, Narayan KMV, et al. Projection of diabetes burden through 2050-Impact of changing demography and disease prevalence in the US. Diabetes Care 2001;24:1936–40
- King H, Aubert RE, Herman WH. Global burden of diabetes, 1995-2025-prevalence, numerical estimates, and projections. Diabetes Care 1998;21:1414–31
- World Health Organization Report of a WHO consultation on obesity, obesity: preventing and managing the global epidemic. Geneva: World Health Organization, 1998
- Narayan KMV, Boyle JP, Thompson TJ, et al. Lifetime risk for diabetes mellitus in the United States. JAMA 2003;290:1884–90
- Manuel D, Schultz S. Health-related quality of life and health-adjusted life expectancy of people with diabetes in Ontario, Canada, 1996-1997. Diabetes Care 2004;27:407–14
- Forouhi NG, Merrick D, Goyder E, et al. Diabetes prevalence in England, 2001-estimates from an epidemiological model. Diabet Med 2006;23:189–97
- Mainous AG, Baker R, Koopman RJ, et al. Impact of the population at risk of diabetes on projections of diabetes burden in the United States: an epidemic on the way. Diabetologia 2007;50:934–40
- Ford ES, Ajani UA, Croft JB, et al. Explaining the decrease in US deaths from coronary disease, 1980–2000. N Engl J Med 2007;356:2388–98
- Carmelli D, Cardon LR, Fabsitz R. Clustering of hypertension, diabetes, and obesity in adult male twins - same genes or same environments. Am J Hum Genet 1994;55:566–73
- DeFronzo RA, Ferrannini E. Insulin resistance. A multifaceted syndrome responsible for NIDDM, obesity, hypertension, dyslipidemia, and atherosclerotic cardiovascular disease. Diabetes Care 1991;41:173–94
- Lorenzo C, Okoloise M, Williams K, et al. The metabolic syndrome as predictor of type 2 diabetes - The San Antonio heart study. Diabetes Care 2003;26:3153–9
- Meigs JB, Dagostino RB, Wilson PWF, et al. Risk variable clustering in the insulin resistance syndrome - the framingham offspring study. Diabetes 1997;46:1594–600
- Schmidt MI, Watson RL, Duncan BB, et al. Clustering of dyslipidemia, hyperuricemia, diabetes, and hypertension and its association with fasting insulin and central and overall obesity in a general population. Metab Clin Exp 1996;45:699–706
- Nawaz H, Chan W, Abdulraham M, et al. Self-reported weight and height: implications for obesity research. J Prev Med 2001;20:294–8
- Rowland M. Self-reported height and weight. Am J Clin Nutr 2007;52:1125–33
- Ambler G, Brady AR, Royston P. Simplifying a prognostic model: a simulation model based on clinical data. Stat Med 2002;21:3803–22
- Mainous AG, Koopman RJ, et al. Coronary heart disease risk score based on pateint-reported information. Am J Cardiol 2007;99:1236–41
- Pepe MS, Janes H, Longton G, et al. Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. Am J Epidemiol 2004;159:882–90
Source: PubMed