A population-based risk algorithm for the development of diabetes: development and validation of the Diabetes Population Risk Tool (DPoRT)

Laura C Rosella, Douglas G Manuel, Charles Burchill, Thérèse A Stukel, PHIAT-DM team, Laura C Rosella, Douglas G Manuel, Charles Burchill, Thérèse A Stukel, PHIAT-DM team

Abstract

Background: National estimates of the upcoming diabetes epidemic are needed to understand the distribution of diabetes risk in the population and to inform health policy.

Objective: To create and validate a population-based risk prediction tool for incident diabetes using commonly collected national survey data.

Methods: With the use of a cohort design that links baseline risk factors to a validated population-based diabetes registry, a model (Diabetes Population Risk Tool (DPoRT)) was developed to predict 9-year risk for diabetes. The probability of developing diabetes was modelled using sex-specific Weibull survival functions for people > 20 years of age without diabetes (N=19,861). The model was validated in two external cohorts in Ontario (N=26,465) and Manitoba (N=9899). Predictive accuracy and model performance were assessed by comparing observed diabetes rates with predicted estimates. Discrimination and calibration were measured using a C statistic and Hosmer-Lemeshow χ² statistic (χ²(H-L)).

Results: Predictive factors included were body mass index, age, ethnicity, hypertension, immigrant status, smoking, education status and heart disease. DPoRT showed good discrimination (C=0.77-0.80) and calibration (χ²(H-L) < 20) in both external validation cohorts.

Conclusions: This algorithm can be used to estimate diabetes incidence and quantify the effect of interventions using routinely collected survey data.

Conflict of interest statement

Competing interests: None.

Figures

Figure 1
Figure 1
Example use of the Diabetes Population Risk Tool to predict the 9-year risk of diabetes for a specific high-risk man.
Figure 2
Figure 2
Predicted 10 versus observed incidence of diabetes for men and women in two validation datasets across deciles or quintiles of risk. The x axis refer to quantile (decile or quintile) of predicted Diabetes Population Risk Tool (DPoRT). The y axis refers to the observed (bars) and DPoRT-predicted (dotted line) probability of developing Diabetes Mellitus (DM) in a 5-year period for Ontario and a 9-year period for Manitoba. Observed diabetes rates are physician-diagnosed diabetes rates in the same time period. CCHS, Canadian Community Health Survey; DPoRT, Diabetes Population Risk Tool; NPHS, National Population Health Survey.

References

    1. Anderson KM, Wilson PWF, Odell PM, et al. An Updated Coronary Risk Profile - A Statement for Health-Professionals. Circulation 1991;83:356–62
    1. Hippisley-Cox J, Coupland C, Vinogradova Y, et al. Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study. Br Med J 2007;335:136–41
    1. Wild S, Roglic G, Green A, et al. Global prevalence of diabetes - Estimates for the year 2000 and projections for 2030. Diabetes Care 2004;27:1047–53
    1. Zimmet P, Alberti KGMM, Shaw J. Global and societal implications of the diabetes epidemic. Nature 2001;414:782–7
    1. Manuel DG, Kwong K, Tanuseputro P, et al. Effectiveness and efficiency of different guidelines on statin treatment for preventing deaths from coronary heart disease: modelling study. BMJ 2005;332:1419–22
    1. Eddy DM, Schlessinger L. Validation of the archimedes diabetes model. Diabetes Care 2003;26:3102–10
    1. Hanley AJG, Williams K, Gonzalez C, et al. Prediction of type 2 diabetes using simple measures of insulin resistance - combined results from the San Antonio Heart Study, the Mexico city diabetes study, and the insulin resistance atherosclerosis study. Diabetes 2003;52:463–9
    1. Ito C, Maeda R, Nakamura K, et al. Prediction of diabetes mellitus (NIDDM). Diabetes Res Clin Pract 1996;34 (Suppl):S7–11
    1. Herman WH, Smith PJ, Thompson TJ, et al. A new and simple questionnaire to identify people at increased risk for undiagnosed diabetes. Diabetes Care 1995;18:382–7
    1. Lindstrom J, Tuomilehto J. The diabetes risk score: a practical tool to predict type 2 diabetes risk. Diabetes Care 2007;26:725–31
    1. Larsson H, Lindgerde F, Berglund G, et al. Prediction of diabetes using ADA or WHO criteria in post-menopousal women: a 10-year follow-up study. Diabetologia 2000;43:279–88
    1. Stern MP, Williams K, Haffner SM. Identification of persons at high risk of type 2 diabetes mellitus: Do we need the oral glucose tolerance test. Ann Intern Med 2009;136:575–81
    1. Wilson P, Meigs JB, Sullivan LM, et al. Prediction of incident diabetes mellitus in middle-aged adults. Arch Intern Med 2007;167:1068–74
    1. Statistics Canada 1996-97 NPHS public use microdata documentation. Ottawa: Statistics Canada, 1999
    1. Statistics Canada Canadian community health survey methodological overview. Health Reports 2002;13:9–14
    1. Statistics Canada Canadian community health survey 2000–2001. Statistics Canada. ed. Ottawa: Statistics Canada, 2003. Ref Type: Data File.
    1. Hux JE, Ivis F. Diabetes in Ontario. Diabetes Care 2005;25:512–16
    1. Lipscombe LL, Hux JE. Trends in diabetes prevalence, incidence, and mortality in Ontario, Canada 1995-2005: a population-based study. Lancet 2007;369:750–16
    1. Health Canada Responding to the challenge of diabetes in Canada. Ottawa, ON, 2003
    1. Statistics Canada 1996-7 National population health survey. Ottawa: Derived Variable Specifications, 1999
    1. Odell PM, Anderson KM, Kannel WB. New models for predicting cardiovascular events. J Clin Epidemiol 1994;47:583–92
    1. Farewell VT, Prentice RL. A study of distributional shape in life testing. Technometrics 1977;19:69–75
    1. Campbell G. General methodology I: advances in statistic methodology for the evaluation of diagnostic and laboratory tests. Stat Med 2004;13:499–508
    1. Pencina M, D'Agostino RB. Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Stat Med 2004;23:2109–23
    1. Hosmer DW, Hosmer T, Cessie LE, et al. A comparison of goodness-of-ft tests for the logistic regression model. Stat Med 1997;16:965–80
    1. D'Agostino RB, Grundy S, Sullivan LM, et al. Validation of the framingham coronary disease prediction scores. JAMA 2001;286:180–7
    1. Nam BH. Discrimination and calibration in survival analysis: extension of the ROC curve for descrimination and chi-square test for calibration boston University. 2000
    1. Yeo D, Mantel H, Lui TP. Bootstrap variance estimation for the national population health survey. Baltimore: American Statistical Association, 1999
    1. Kovacevic MS, Mach L, Roberts G. Bootstrap variance estimation for predicted individual and population-average risks. Proceedings of the Survey Research Methods Section. Alexandria VA: American Statistical Association, 2008
    1. D'Agostino RB, Griffith JL, Schmidt CH, et al. Measures for evaluating model performance. proceedings of the biometrics section. Alexandria, VA: American Statistical Association, Biometrics Section, 1997:253–8
    1. Altman DG, Royston P. What do we mean by validating a prognostic model? Stat Med 2000;19:453–73
    1. Harrell FE, Lee KL, Mark DB. Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996;15:361–87
    1. Boyle JP, Honeycutt AA, Narayan KMV, et al. Projection of diabetes burden through 2050-Impact of changing demography and disease prevalence in the US. Diabetes Care 2001;24:1936–40
    1. King H, Aubert RE, Herman WH. Global burden of diabetes, 1995-2025-prevalence, numerical estimates, and projections. Diabetes Care 1998;21:1414–31
    1. World Health Organization Report of a WHO consultation on obesity, obesity: preventing and managing the global epidemic. Geneva: World Health Organization, 1998
    1. Narayan KMV, Boyle JP, Thompson TJ, et al. Lifetime risk for diabetes mellitus in the United States. JAMA 2003;290:1884–90
    1. Manuel D, Schultz S. Health-related quality of life and health-adjusted life expectancy of people with diabetes in Ontario, Canada, 1996-1997. Diabetes Care 2004;27:407–14
    1. Forouhi NG, Merrick D, Goyder E, et al. Diabetes prevalence in England, 2001-estimates from an epidemiological model. Diabet Med 2006;23:189–97
    1. Mainous AG, Baker R, Koopman RJ, et al. Impact of the population at risk of diabetes on projections of diabetes burden in the United States: an epidemic on the way. Diabetologia 2007;50:934–40
    1. Ford ES, Ajani UA, Croft JB, et al. Explaining the decrease in US deaths from coronary disease, 1980–2000. N Engl J Med 2007;356:2388–98
    1. Carmelli D, Cardon LR, Fabsitz R. Clustering of hypertension, diabetes, and obesity in adult male twins - same genes or same environments. Am J Hum Genet 1994;55:566–73
    1. DeFronzo RA, Ferrannini E. Insulin resistance. A multifaceted syndrome responsible for NIDDM, obesity, hypertension, dyslipidemia, and atherosclerotic cardiovascular disease. Diabetes Care 1991;41:173–94
    1. Lorenzo C, Okoloise M, Williams K, et al. The metabolic syndrome as predictor of type 2 diabetes - The San Antonio heart study. Diabetes Care 2003;26:3153–9
    1. Meigs JB, Dagostino RB, Wilson PWF, et al. Risk variable clustering in the insulin resistance syndrome - the framingham offspring study. Diabetes 1997;46:1594–600
    1. Schmidt MI, Watson RL, Duncan BB, et al. Clustering of dyslipidemia, hyperuricemia, diabetes, and hypertension and its association with fasting insulin and central and overall obesity in a general population. Metab Clin Exp 1996;45:699–706
    1. Nawaz H, Chan W, Abdulraham M, et al. Self-reported weight and height: implications for obesity research. J Prev Med 2001;20:294–8
    1. Rowland M. Self-reported height and weight. Am J Clin Nutr 2007;52:1125–33
    1. Ambler G, Brady AR, Royston P. Simplifying a prognostic model: a simulation model based on clinical data. Stat Med 2002;21:3803–22
    1. Mainous AG, Koopman RJ, et al. Coronary heart disease risk score based on pateint-reported information. Am J Cardiol 2007;99:1236–41
    1. Pepe MS, Janes H, Longton G, et al. Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. Am J Epidemiol 2004;159:882–90

Source: PubMed

3
購読する