The Weiss Functional Impairment Rating Scale-Parent Form for assessing ADHD: evaluating diagnostic accuracy and determining optimal thresholds using ROC analysis

Trevor Thompson, Andrew Lloyd, Alain Joseph, Margaret Weiss, Trevor Thompson, Andrew Lloyd, Alain Joseph, Margaret Weiss

Abstract

Purpose: The Weiss Functional Impairment Rating Scale-Parent Form (WFIRS-P) is a 50-item scale that assesses functional impairment on six clinically relevant domains typically affected in attention-deficit/hyperactivity disorder (ADHD). As functional impairment is central to ADHD, the WFIRS-P offers potential as a tool for assessing functional impairment in ADHD. These analyses were designed to examine the overall performance of WFIRS-P in differentiating ADHD and non-ADHD cases using receiver operating characteristics (ROC) analysis. This is the first attempt to empirically determine the level of functional impairment that differentiates ADHD children from normal controls.

Methods: This observational study comprised 5-19-year-olds with physician-diagnosed ADHD (n = 476) and non-ADHD controls (n = 202). ROC analysis evaluated the ability of WFIRS-P to discriminate between ADHD and non-ADHD, and identified a WFIRS-P cut-off score that optimises correct classification. Data were analysed for the complete sample, for males versus females and for participants in two age groups (5-12 versus 13-19 years).

Results: Area under the curve (AUC) was 0.91 (95% confidence interval 0.88-0.93) for the overall WFIRS-P score, suggesting highly accurate classification of ADHD distinct from non-ADHD. Sensitivity (0.83) and specificity (0.85) were maximal for a mean overall WFIRS-P score of 0.65, suggesting that this is an appropriate threshold for differentiation. DeLong's test found no significant differences in AUCs for males versus females or 5-12 versus 13-19 years, suggesting that WFIRS-P is an accurate classifier of ADHD across gender and age.

Conclusions: When assessing function, WFIRS-P appears to provide a simple and effective basis for differentiating between individuals with/without ADHD in terms of functional impairment.

Classification: Disease-specific applications of QOL research.

Keywords: Attention-deficit/hyperactivity disorder; Disease classification; Disease severity; Receiver operating characteristics analysis; Weiss functional impairment rating scale.

Conflict of interest statement

Conflict of interest

Trevor Thompson reports no conflicts of interest. Andrew Lloyd has received funding from Shire Development, LLC for his work on this study. Alain Joseph is an employee of Shire and owns stock/stock options. Margaret Weiss has received honoraria and research funding for consultancy from Purdue and honoraria for speakers bureaux from Eli Lilly, Janssen, Rhodes, and Shire.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Figures

Fig. 1
Fig. 1
ROC curve describing differentiation of ADHD/non-ADHD across WFIRS-P total scores. AUC area under the curve, ROC receiver operating characteristics, WFIRS-P Weiss Functional Impairment Rating Scale-Parent Form
Fig. 2
Fig. 2
Sensitivity and specificity across the range of overall WFIRS-P total scores. WFIRS-P Weiss Functional Impairment Rating Scale-Parent Form
Fig. 3
Fig. 3
ROC curves for the overall WFIRS-P total score across gender (a) and age group (b). ROC receiver operating characteristics, WFIRS-P Weiss Functional Impairment Rating Scale-Parent Form

References

    1. Polanczyk G, de Lima MS, Horta BL, Biederman J, Rohde LA. The worldwide prevalence of ADHD: A systematic review and metaregression analysis. American Journal of Psychiatry. 2007;164(6):942–948. doi: 10.1176/ajp.2007.164.6.942.
    1. Canadian Attention Deficit Hyperactivity Disorder Resource Alliance (CADDRA) Canadian ADHD practice guidelines. 3rd. Toronto: CADDRA; 2011.
    1. Biederman J, Mick E, Faraone SV. Age-dependent decline of symptoms of attention deficit hyperactivity disorder: Impact of remission definition and symptom type. American Journal of Psychiatry. 2000;157(5):816–818. doi: 10.1176/appi.ajp.157.5.816.
    1. Mick E, Faraone SV, Biederman J. Age-dependent expression of attention-deficit/hyperactivity disorder symptoms. Psychiatric Clinics of North America. 2004;27(2):215–224. doi: 10.1016/j.psc.2004.01.003.
    1. Kessler RC, Adler L, Barkley R, Biederman J, Conners CK, Demler O, et al. The prevalence and correlates of adult ADHD in the United States: Results from the National Comorbidity Survey Replication. American Journal of Psychiatry. 2006;163(4):716–723. doi: 10.1176/ajp.2006.163.4.716.
    1. Spencer TJ. ADHD and comorbidity in childhood. Journal of Clinical Psychiatry. 2006;67(Suppl 8):27–31.
    1. Algorta GP, Dodd AL, Stringaris A, Youngstrom EA. Diagnostic efficiency of the SDQ for parents to identify ADHD in the UK: a ROC analysis. European Child and Adolescent Psychiatry. 2016;25(9):949–957. doi: 10.1007/s00787-015-0815-0.
    1. European Medicines Agency. Guideline on the clinical investigation of medicinal products for the treatment of attention deficit hyperactivity disorder (ADHD). . Accessed 13 Sept 2016.
    1. Canu, W. H., Hartung, C. M., Stevens, A. E., & Lefler, E. K. (2016). Psychometric properties of the Weiss Functional Impairment Rating Scale: Evidence for utility in research, assessment, and treatment of ADHD in emerging adults. Journal of Attention Disorders(Epub ahead of print).
    1. Tarakçıoğlu M, Memik NÇ, Olgun NN, Aydemir Ö, Weiss MD. Turkish validity and reliability study of the Weiss Functional Impairment Rating Scale-Parent Report. Attention Deficit Hyperactivity Disorders. 2015;7(2):129–139. doi: 10.1007/s12402-014-0158-6.
    1. Gajria K, Kosinski M, Sikirica V, Huss M, Livote E, Reilly K, Dittmann RW, Erder MH. Psychometric validation of the Weiss Functional Impairment Rating Scale-Parent Report Form in children and adolescents with attention-deficit/hyperactivity disorder. Health Quality of Life Outcomes. 2015;13:184. doi: 10.1186/s12955-015-0379-1.
    1. Hantson J, Wang PP, Grizenko-Vida M, Ter-Stepanian M, Harvey W, Joober R, et al. Effectiveness of a therapeutic summer camp for children with ADHD: Phase I clinical intervention trial. Journal of Attention Disorders. 2012;16(7):610–617. doi: 10.1177/1087054711416800.
    1. Banaschewski T, Soutullo C, Lecendreux M, Johnson M, Zuddas A, Hodgkins P, et al. Health-related quality of life and functional outcomes from a randomized, controlled study of lisdexamfetamine dimesylate in children and adolescents with attention deficit hyperactivity disorder. CNS Drugs. 2013;27(10):829–840. doi: 10.1007/s40263-013-0095-5.
    1. Maziade M, Rouleau N, Lee B, Rogers A, Davis L, Dickson R. Atomoxetine and neuropsychological function in children with attention-deficit/hyperactivity disorder: Results of a pilot study. Journal of Child and Adolescent Psychopharmacology. 2009;19(6):709–718. doi: 10.1089/cap.2008.0166.
    1. De Bruyckere K, Bushe C, Bartel C, Berggren L, Kan CC, Dittmann RW. Relationships between functional outcomes and symptomatic improvement in atomoxetine-treated adult patients with attention-deficit/hyperactivity disorder: Post hoc analysis of an integrated database. CNS Drugs. 2016;30(6):541–558. doi: 10.1007/s40263-016-0346-3.
    1. Hodgkins P, Lloyd A, Erder MH, Setyawan J, Weiss MD, Sasané R, et al. Estimating minimal important differences for several scales assessing function and quality of life in patients with attention-deficit/hyperactivity disorder. CNS Spectrums. 2017;22(1):31–40. doi: 10.1017/S1092852916000353.
    1. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837–845. doi: 10.2307/2531595.
    1. Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3:32–35. doi: 10.1002/1097-0142(1950)3:1<32::AID-CNCR2820030106>;2-3.
    1. R Development Core Team. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. . Accessed 13 Sept 2016.
    1. Faraone SV, Sergeant J, Gillberg C, Biederman J. The worldwide prevalence of ADHD: Is it an American condition? World Psychiatry. 2003;2(2):104–113.
    1. Hosmer DW, Lemeshow S. Applied logistic regression. New York: Wiley; 2000.
    1. American Psychiatric Association . The diagnostic and statistical manual of mental disorders. 5th. Arlington: American Psychiatric Association; 2013.
    1. Alvarez AS. The application of the International Classification of Functioning, Disability, and Health in psychiatry: Possible reasons for the lack of implementation. American Journal of Physical Medicine and Rehabilitation. 2012;91:S69–S73. doi: 10.1097/PHM.0b013e31823d4f1c.

Source: PubMed

3
購読する