Validating the Patient-Reported Outcomes Measurement Information System Short Form v1.0-Anxiety 8a in a sample of young adult cancer survivors: Comparison with a structured clinical diagnostic interview

Christopher J Recklitis, Jaime E Blackmon, Lydia L Chevalier, Grace Chang, Christopher J Recklitis, Jaime E Blackmon, Lydia L Chevalier, Grace Chang

Abstract

Background: The objective of this study was to validate the Patient-Reported Outcomes Measurement Information System Short Form v1.0-Anxiety 8a (PROMIS-A-SF) against a structured diagnostic interview in order to determine its accuracy and the most appropriate cutoff score for identifying anxiety disorders in young adult cancer survivors (YACSs).

Methods: Two hundred forty-nine YACSs aged 18 to 40 years (50% male) completed the PROMIS-A-SF and the Structured Clinical Interview for the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (SCID). The SCID was used to determine whether participants met the criteria for an anxiety diagnosis. Receiving operator characteristic analyses were performed to determine the concordance of the PROMIS-A-SF and the SCID as well as cutoff scores with sensitivity (≥0.85) and specificity (≥0.75) appropriate for an anxiety screening measure.

Results: The PROMIS-A-SF was determined to have good overall discrimination in comparison with the SCID (area under the curve, 0.84). A PROMIS-A-SF t-score cutoff ≥ 53.2 (total predictive value, 67.9%) came closest to meeting the study criteria with a sensitivity of 88%, but the specificity was only 65%. In a hypothetical screening example, this cutoff led to moderate levels of missed cases (14%) and a significant proportion of clinical referrals that were unnecessary by SCID criteria (35%). Of the survivors referred for services according to these criteria, less than one-third (29%) would have a SCID anxiety diagnosis.

Conclusions: The PROMIS-A-SF demonstrated moderately strong concordance with anxiety disorders measured by the SCID, but cutoff scores did not meet study criteria for clinical screening. Although it may not be appropriate as a standalone screener, the PROMIS-A-SF may be useful for assessing anxiety in YACSs when it is incorporated into clinical practice or when it is combined with other measures.

Keywords: Patient-Reported Outcomes Measurement Information System Short Form v1.0-Anxiety 8a (PROMIS-A-SF); Structured Clinical Interview for the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (SCID); anxiety; survivors; validation.

© 2021 American Cancer Society.

References

    1. Bleyer A. Young adult oncology: the patients and their survival challenges. CA Cancer J Clin. 2007;57:242-255.
    1. Hall AE, Boyes AW, Bowman J, Walsh RA, James EL, Girgis A. Young adult cancer survivors' psychosocial well-being: a cross-sectional study assessing quality of life, unmet needs, and health behaviors. Support Care Cancer. 2012;20:1333-1341.
    1. Clinton-McHarg T, Carey M, Sanson-Fisher R, Shakeshaft A, Rainbird K. Measuring the psychosocial health of adolescent and young adult (AYA) cancer survivors: a critical review. Health Qual Life Outcomes. 2010;8:25.
    1. Evan EE, Kaufman M, Cook AB, Zeltzer LK. Sexual health and self-esteem in adolescents and young adults with cancer. Cancer. 2006;107(suppl):1672-1679.
    1. Rasic DT, Belik S-L, Bolton JM, Chochinov HM, Sareen J. Cancer, mental disorders, suicidal ideation and attempts in a large community sample. Psychooncology. 2008;17:660-667.
    1. Kazak AE, Derosa BW, Schwartz LA, et al. Psychological outcomes and health beliefs in adolescent and young adult survivors of childhood cancer and controls. J Clin Oncol. 2010;28:2002-2007.
    1. Yi JC, Syrjala KL. Anxiety and depression in cancer survivors. Med Clin North Am. 2017;101:1099-1113.
    1. Michel G, François C, Harju E, Dehler S, Roser K. The long-term impact of cancer: evaluating psychological distress in adolescent and young adult cancer survivors in Switzerland. Psychooncology. 2019;28:577-585.
    1. Lang MJ, Giese-Davis J, Patton SB, Campbell DJT. Does age matter? Comparing post-treatment psychosocial outcomes in young adult and older adult cancer survivors with their cancer-free peers. Psychooncology. 2018;27:1404-1411.
    1. Grassi L, Spiegel D, Riba M. Advancing psychosocial care in cancer patients. F1000Res. 2017;6:2083.
    1. Wagner LI, Spiegel D, Pearman T. Using the science of psychosocial care to implement the new American College of Surgeons Commission on Cancer distress screening standard. J Natl Compr Canc Netw. 2013;11:214-221.
    1. Sanft T, Denlinger CS, Armenian S, et al. NCCN Guidelines Insights: Survivorship, Version 2.2019. J Natl Compr Canc Netw. 2019;17:784-794.
    1. Bitsko MJ, Cohen D, Dillon R, Harvey J, Krull K, Klosky JL. Psychosocial late effects in pediatric cancer survivors: a report from the Children's Oncology Group. Pediatr Blood Cancer. 2016;63:337-343.
    1. Institute of Medicine and National Research Council. From Cancer Patient to Cancer Survivor: Lost in Transition. National Academies Press; 2006.
    1. Long-Term Follow-Up Guidelines for Survivors of Childhood, Adolescent, and Young Adult Cancers. Children’s Oncology Group. Published October 2018. Accessed 2020.
    1. Recklitis CJ, Blackmon JE, Chang G. Screening young adult cancer survivors for distress with the Distress Thermometer: comparisons with a structured clinical diagnostic interview. Cancer. 2016;122:296-303.
    1. Recklitis CJ, Blackmon JE, Chang G. Screening young adult cancer survivors with the PROMIS Depression Short Form (PROMIS-D-SF): comparison with a structured clinical diagnostic interview. Cancer. 2020;126:1568-1575.
    1. Teresi JA, Ocepek-Welikson K, Kleinman M, Ramirez M, Kim G. Measurement equivalence of the Patient Reported Outcomes Measurement Information System® (PROMIS®) Anxiety Short Forms in ethnically diverse groups. Psychol Test Assess Model. 2016;58:183-219.
    1. Crane TE, Badger TA, Sikorskii A, Segrin C, Hsu CH, Rosenfeld AG. Trajectories of depression and anxiety in Latina breast cancer survivors. Oncol Nurs Forum. 2019;46:217-227.
    1. Quach CW, Langer MM, Chen RC, et al. Reliability and validity of PROMIS measures administered by telephone interview in a longitudinal localized prostate cancer study. Qual Life Res. 2016;25:2811-2823.
    1. PROMIS Anxiety Scoring Manual. HealthMeasures. Published 2019. Updated March 1, 2019. Accessed April 2019.
    1. Pilkonis PA, Choi SW, Salsman JM, et al. Assessment of self-reported negative affect in the NIH Toolbox. Psychiatry Res. 2013;206:88-97.
    1. Yount SE, Cella D, Blozis S. PROMIS®: standardizing the patient voice in health psychology research and practice. Health Psychol. 2019;38:343-346.
    1. Cook KF, Jensen SE, Schalet BD, et al. PROMIS measures of pain, fatigue, negative affect, physical function, and social function demonstrated clinical validity across a range of chronic conditions. J Clin Epidemiol. 2016;73:89-102.
    1. Reeve BB, Pinheiro LC, Jensen RE, et al. Psychometric evaluation of the PROMIS® fatigue measure in an ethnically and racially diverse population-based sample of cancer patients. Psychol Test Assess Model. 2016;58:119.
    1. Cella D, Riley W, Stone A, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. J Clin Epidemiol. 2010;63:1179-1194.
    1. Khanna D, Maranian P, Rothrock N, et al. Feasibility and construct validity of PROMIS and "legacy" instruments in an academic scleroderma clinic. Value Health. 2012;15:128-134.
    1. Tang E, Ekundayo O, Peipert JD, et al. Validation of the Patient-Reported Outcomes Measurement Information System (PROMIS)-57 and -29 item short forms among kidney transplant recipients. Qual Life Res. 2019;28:815-827.
    1. Victorson D, Schalet BD, Kundu S, et al. Establishing a common metric for self-reported anxiety in patients with prostate cancer: linking the Memorial Anxiety Scale for Prostate Cancer with PROMIS Anxiety. Cancer. 2019;125:3249-3258.
    1. Wilford J, Osann K, Hsieh S, Monk B, Nelson E, Wenzel L. Validation of PROMIS emotional distress short form scales for cervical cancer. Gynecol Oncol. 2018;151:111-116.
    1. Vilagut G, Forero CG, Adroher ND, Olariu E, Cella D, Alonso J. Testing the PROMIS® depression measures for monitoring depression in a clinical sample outside the US. J Psychiatr Res. 2015;68:140-150.
    1. Marrie RA, Zhang L, Lix LM, et al. The validity and reliability of screening measures for depression and anxiety disorders in multiple sclerosis. Mult Scler Relat Disord. 2018;20:9-15.
    1. Cella D, Choi S, Garcia S, et al. Setting standards for severity of common symptoms in oncology using the PROMIS item banks and expert judgment. Qual Life Res. 2014;23:2651-2661.
    1. Recklitis CJ, Blackmon JE, Chang G. Validity of the Brief Symptom Inventory-18 (BSI-18) for identifying depression and anxiety in young adult cancer survivors: comparison with a structured clinical diagnostic interview. Psychol Assess. 2017;29:1189.
    1. Aubin S, Barr R, Rogers P, et al. What should the age range be for AYA oncology? J Adolesc Young Adult Oncol. 2011;1:3-10.
    1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 4th ed. American Psychiatric Association; 1994.
    1. First MB, Gibbon M. The Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I) and the Structured Clinical Interview for DSM-IV Axis II Disorders (SCID-II). In: Hilsenroth MJ, Segal DL, eds. Comprehensive Handbook of Psychological Assessment. Vol 2. Wiley; 2003:134.
    1. Williams JB, Gibbon M, First MB, et al. The Structured Clinical Interview for DSM-III-R (SCID). II. Multisite test-retest reliability. Arch Gen Psychiatry. 1992;49:630-636.
    1. Fan J, Upadhye S, Worster A. Understanding receiver operating characteristic (ROC) curves. CJEM. 2006;8:19-20.
    1. Streiner DL, Cairney J. What's under the ROC? An introduction to receiver operating characteristics curves. Can J Psychiatry. 2007;52:121-128.
    1. Metz CE. Basic principles of ROC analysis. Semin Nucl Med. 1978;8:283-298.
    1. Morrison AS. Screening for Chronic Disease. 2nd ed. University of Nebraska Press; 1992.
    1. Sox JHC. Diagnostic decision: probability theory in the use of diagnostic tests: an introduction to critical study of the literature. Ann Intern Med. 1986;104:60-66.
    1. Murphy JM, Berwick DM, Weinstein MC, Borus JF, Budman SH, Klerman GL. Performance of screening and diagnostic tests. Application of receiver operating characteristic analysis. Arch Gen Psychiatry. 1987;44:550-555.
    1. Hong JS, Tian J. Sensitivity and specificity of the Distress Thermometer in screening for distress in long-term nasopharyngeal cancer survivors. Curr Oncol. 2013;20:e570-e576.
    1. Lee SA, Mathis AA, Jobe MC, Pappalardo EA. Clinically significant fear and anxiety of COVID-19: a psychometric examination of the Coronavirus Anxiety Scale. Psychiatry Res. 2020;290:113112.
    1. Yardeni M, Abebe Campino G, Bursztyn S, et al. A three-tier process for screening depression and anxiety among children and adolescents with cancer. Psychooncology. 2020;29:2019-2027.
    1. Plummer F, Manea L, Trepel D, McMillan D. Screening for anxiety disorders with the GAD-7 and GAD-2: a systematic review and diagnostic metaanalysis. Gen Hosp Psychiatry. 2016;39:24-31.
    1. Matcham F, Norton S, Steer S, Hotopf M. Usefulness of the SF-36 Health Survey in screening for depressive and anxiety disorders in rheumatoid arthritis. BMC Musculoskelet Disord. 2016;17:224.
    1. Pilkonis PA, Choi SW, Reise SP, Stover AM, Riley WT, Cella D. Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): depression, anxiety, and anger. Assessment. 2011;18:263-283.
    1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 5th ed. American Psychiatric Association; 2013.
    1. Mitchell AJ, Ferguson DW, Gill J, Paul J, Symonds P. Depression and anxiety in long-term cancer survivors compared with spouses and healthy controls: a systematic review and meta-analysis. Lancet Oncol. 2013;14:721-732.

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe