Social Cognition Psychometric Evaluation: Results of the Final Validation Study

Amy E Pinkham, Philip D Harvey, David L Penn, Amy E Pinkham, Philip D Harvey, David L Penn

Abstract

Social cognition is increasingly recognized as an important treatment target in schizophrenia; however, the dearth of well-validated measures that are suitable for use in clinical trials remains a significant limitation. The Social Cognition Psychometric Evaluation (SCOPE) study addresses this need by systematically evaluating the psychometric properties of promising measures. In this final phase of SCOPE, eight new or modified tasks were evaluated. Stable outpatients with schizophrenia (n = 218) and healthy controls (n = 154) completed the battery at baseline and 2-4 weeks later across three sites. Tasks included the Bell Lysaker Emotion Recognition Task (BLERT), Penn Emotion Recognition Task (ER-40), Reading the Mind in the Eyes Task (Eyes), The Awareness of Social Inferences Test (TASIT), Hinting Task, Mini Profile of Nonverbal Sensitivity (MiniPONS), Social Attribution Task-Multiple Choice (SAT-MC), and Intentionality Bias Task (IBT). BLERT and ER-40 modifications included response time and confidence ratings. The Eyes task was modified to include definitions of terms and TASIT to include response time. Hinting was scored with more stringent criteria. MiniPONS, SAT-MC, and IBT were new to this phase. Tasks were evaluated on (1) test-retest reliability, (2) utility as a repeated measure, (3) relationship to functional outcome, (4) practicality and tolerability, (5) sensitivity to group differences, and (6) internal consistency. Hinting, BLERT, and ER-40 showed the strongest psychometric properties and are recommended for use in clinical trials. Eyes, TASIT, and IBT showed somewhat weaker psychometric properties and require further study. MiniPONS and SAT-MC showed poorer psychometric properties that suggest caution for their use in clinical trials.

References

    1. Pinkham AE, Penn DL, Green MF, Buck B, Healey K, Harvey PD. The social cognition psychometric evaluation study: Results of the expert survey and RAND panel. Schizophr Bull. 2014;40:813–823.
    1. Pinkham AE, Penn DL, Green MF, Harvey PD. Social cognition psychometric evaluation: Results of the initial psychometric study. Schizophr Bull. 2016;42:494–504.
    1. Buck B, Iwanski C, Healey KM, et al. . Improving measurement of attributional style in schizophrenia; A psychometric evaluation of the Ambiguous Intentions Hostility Questionnaire (AIHQ). J Psychiatr Res. 2017;89:48–54.
    1. Buck BE, Pinkham AE, Harvey PD, Penn DL. Revisiting the validity of measures of social cognitive bias in schizophrenia: Additional results from the Social Cognition Psychometric Evaluation (SCOPE) study. Br J Clin Psychol. 2016;55:441–454.
    1. Cornacchio D, Pinkham AE, Penn DL, Harvey PD. Self-assessment of social cognitive ability in individuals with schizophrenia: Appraising task difficulty and allocation of effort. Schizophr Res. 2017;179:85–90.
    1. Pinkham AE, Penn DL. Neurocognitive and social cognitive predictors of interpersonal skill in schizophrenia. Psychiatry Res. 2006;143:167–178.
    1. Gould F, McGuire LS, Durand D, et al. . Self-assessment in schizophrenia: Accuracy of evaluation of cognition and everyday functioning. Neuropsychology. 2015;29:675.
    1. Harvey PD, Pinkham A. Impaired self-assessment in schizophrenia: Why patients misjudge their cognition and functioning: Observations from caregivers and clinicians seem to have the most validity. Current Psychiatry. 2015;14:53.
    1. Lysaker PH, Dimaggio G. Metacognitive capacities for reflection in schizophrenia: Implications for developing treatments. Schizophr Bull. 2014;40:487–491.
    1. Rosset E. It’s no accident: Our bias for intentional explanations. Cognition. 2008;108:771–780.
    1. Peyroux E, Strickland B, Tapiero I, Franck N. The intentionality bias in schizophrenia. Psychiatry Res. 2014;219:426–430.
    1. Bänziger T, Scherer KR, Hall JA, Rosenthal R. Introducing the MiniPONS: A short multichannel version of the Profile of Nonverbal Sensitivity (PONS). Journal of Nonverbal Behavior. 2011;35:189–204.
    1. Bell MD, Fiszdon JM, Greig TC, Wexler BE. Social attribution test–multiple choice (SAT-MC) in schizophrenia: Comparison with community sample and relationship to neurocognitive, social cognitive and symptom measures. Schizophr Res. 2010;122:164–171.
    1. Ambady N, Hallahan M, Rosenthal R. On judging and being judged accurately in zero-acquaintance situations. J Pers Soc Psychol. 1995;69:518.
    1. Walther S, Stegmayer K, Sulzbacher J, et al. . Nonverbal social communication and gesture control in schizophrenia. Schizophr Bull. 2015;41:338–345.
    1. Johannesen JK, Lurie JB, Fiszdon JM, Bell MD. The Social Attribution Task-Multiple Choice (SAT-MC): A Psychometric and equivalence study of an alternate form. ISRN Psychiatry. 2013;2013:830825.
    1. Klin A. Attributing social meaning to ambiguous visual stimuli in higher-functioning autism and Asperger syndrome: The Social Attribution Task. J Child Psychol Psychiatry. 2000;41:831–846.
    1. Green MF, Penn DL. Going from social neuroscience to schizophrenia clinical trials. Schizophr Bull. 2013;39:1189–1191.
    1. Kern RS, Penn DL, Lee J, et al. . Adapting social neuroscience measures for schizophrenia clinical trials, Part 2: Trolling the depths of psychometric properties. Schizophr Bull. 2013;39:1201–1210.
    1. Nuechterlein KH, Green MF, Kern RS, et al. . The MATRICS Consensus Cognitive Battery, part 1: Test selection, reliability, and validity. Am J Psychiatry. 2008;165:203–213.
    1. Olbert CM, Penn DL, Kern RS, et al. . Adapting social neuroscience measures for schizophrenia clinical trials, part 3: Fathoming external validity. Schizophr Bull. 2013;39:1211–1218.
    1. Green MF, Nuechterlein KH, Gold JM, et al. . Approaching a consensus cognitive battery for clinical trials in schizophrenia: The NIMH-MATRICS conference to select cognitive domains and test criteria. Biol Psychiatry. 2004;56:301–307.
    1. Kraemer HC. Toward sound objective evaluation of clinical measures. Am J Geriatr Psychiatry. 2013;21:589–595.
    1. Kohler CG, Turner TH, Bilker WB, et al. . Facial emotion recognition in schizophrenia: Intensity effects and error pattern. Am J Psychiatry. 2003;160:1768–1774.
    1. Bryson G, Bell M, Lysaker P. Affect recognition in schizophrenia: A function of global impairment or a specific cognitive deficit. Psychiatry Res. 1997;71:105–113.
    1. Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I. The “Reading the Mind in the Eyes” Test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. J Child Psychol Psychiatry. 2001;42:241–251.
    1. McDonald S, Flanagan S, Rollins J, Kinch J. TASIT: A new clinical tool for assessing social perception after traumatic brain injury. J Head Trauma Rehabil. 2003;18:219–238.
    1. Corcoran R, Mercer G, Frith CD. Schizophrenia, symptomatology and social inference: Investigating “theory of mind” in people with schizophrenia. Schizophr Res. 1995;17:5–13.
    1. Weickert TW, Goldberg TE, Gold JM, Bigelow LB, Egan MF, Weinberger DR. Cognitive impairments in patients with schizophrenia displaying preserved and compromised intellect. Arch Gen Psychiatry. 2000;57:907–913.
    1. Wechsler D. Wechsler Abbreviated Scale of Intelligence. Agra, Uttar Pradesh, India: Psychological Corporation; 1999.
    1. Mausbach BT, Harvey PD, Goldman SR, Jeste DV, Patterson TL. Development of a brief scale of everyday functioning in persons with serious mental illness. Schizophr Bull. 2007;33:1364–1372.
    1. Patterson TL, Moscona S, McKibbin CL, Davidson K, Jeste DV. Social skills performance assessment among older patients with schizophrenia. Schizophr Res. 2001;48:351–360.
    1. Schneider LC, Struening EL. SLOF: A behavioral rating scale for assessing the mentally ill. Soc Work Res Abstr. 1983;19:9–21.
    1. Kay SR, Opler LA, Fiszbein A.. Positive and Negative Syndrome Scale: Manual. North Tonawanda, NY: Multi-Health Systems, Inc; 1992.
    1. Kraemer HC, Kupfer DJ, Clarke DE, Narrow WE, Regier DA. DSM-5: How reliable is reliable enough?Am J Psychiatry. 2012;169:13–15.
    1. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174.
    1. Nunnally JC. Psychometric theory. New York, NY: McGraw-Hill; 1967.
    1. Sabbag S, Twamley EM, Vella L, Heaton RK, Patterson TL, Harvey PD. Assessing everyday functioning in schizophrenia: Not all informants seem equally informative. Schizophr Res. 2011;131:250–255.
    1. Marjoram D, Miller P, McIntosh AM, Cunningham Owens DG, Johnstone EC, Lawrie S. A neuropsychological investigation into ‘Theory of Mind’ and enhanced risk of schizophrenia. Psychiatry Res. 2006;144:29–37.
    1. Roberts DL, Penn DL. Social cognition and interaction training (SCIT) for outpatients with schizophrenia: A preliminary study. Psychiatry Res. 2009;166:141–147.
    1. Versmissen D, Janssen I, Myin-Germeys I, et al. . Evidence for a relationship between mentalising deficits and paranoia over the psychosis continuum. Schizophr Res. 2008;99:103–110.
    1. Peterson E, Miller SF. The eyes test as a measure of individual differences: How much of the variance reflects verbal IQ?Front Psychol. 2012;3:220.
    1. Ludwig KA, Pinkham AE, Harvey PD, Kelsven S, Penn DL. Social cognition psychometric evaluation (SCOPE) in people with early psychosis: A preliminary study. Schizophr Res. 2017.
    1. Pinkham AE, Kelsven S, Kouros C, Harvey PD, Penn DL. The effect of age, race, and sex on social cognitive performance in individuals with schizophrenia. J Nerv Ment Dis. 2017;205:346–352.
    1. Buck BE, Healey KM, Gagen EC, Roberts DL, Penn DL. Social cognition in schizophrenia: Factor structure, clinical and functional correlates. J Ment Health. 2016;25:330–337.
    1. Mancuso F, Horan WP, Kern RS, Green MF. Social cognition in psychosis: Multidimensional structure, clinical correlates, and relationship with functional outcome. Schizophr Res. 2011;125:143–151.

Source: PubMed

Patrocinadores e Colaboradores

Condições médicas

Intervenções de drogas

3
Se inscrever