Revising the BIS/BAS Scale to study development: Measurement invariance and normative effects of age and sex from childhood through adulthood

David Pagliaccio, Katherine R Luking, Andrey P Anokhin, Ian H Gotlib, Elizabeth P Hayden, Thomas M Olino, Chun-Zi Peng, Greg Hajcak, Deanna M Barch, David Pagliaccio, Katherine R Luking, Andrey P Anokhin, Ian H Gotlib, Elizabeth P Hayden, Thomas M Olino, Chun-Zi Peng, Greg Hajcak, Deanna M Barch

Abstract

Carver and White's (1994) Behavioral Inhibition System/Behavioral Activation System (BIS/BAS) Scales have been useful tools for studying individual differences in reward-punishment sensitivity; however, their factor structure and invariance across development have not been well tested. In the current study, we examined the factor structure of the BIS/BAS Scales across 5 age groups: 6- to 10-year-old children (N = 229), 11- to 13-year-old early adolescents (N = 311), 14- to 16-year-old late adolescents (N = 353), 18- to 22-year-old young adults (N = 844), and 30- to 45-year-old adults (N = 471). Given poor fit of the standard 4-factor model (BIS, Reward Responsivity, Drive, Fun Seeking) in the literature, we conducted exploratory factor analyses in half of the participants and identified problematic items across age groups. The 4-factor model showed poor fit in our sample, whereas removing the BAS Fun Seeking subscale and problematic items from the remaining subscales improved fit in confirmatory factor analyses conducted with the second half of the participants. The revised model showed strict invariance across age groups and by sex, indicating consistent factor structure, item loadings, thresholds, and unique or residual variances. Additionally, in our cross-sectional data, we observed nonlinear relations between age and subscale scores, where scores tended to be higher in young adulthood than in childhood and later adulthood. Furthermore, sex differences emerged across development; adolescent and adult females had higher BIS scores than males in this age range, whereas sex differences were not observed in childhood. These differences may help us to understand the rise in internalizing psychopathology in adolescence, particularly in females. Future developmental studies are warranted to examine the impact of rewording problematic items.

(c) 2016 APA, all rights reserved.

Figures

Figure 1. Revised Subscale Scores By Age…
Figure 1. Revised Subscale Scores By Age and Sex
The first three panels present scatter plots of participant age against revised subscale mean scores: (A) REWARD (RWD1, RWD2, RWD4, RWD5), (B) DRIVE (DRIVE1, DRIVE2, DRIVE3, DRIVE4), (C) BIS (BIS2, BIS3, BIS4, BIS6). Loess fit lines with 95% confidence intervals are plotted by sex for these panels. Panel (D) displays the regression fit lines for all three subscales (cubic function for BIS, quadratic function for REWARD and DRIVE). The gray shaded regions on all panels mark the age groups used in the EFA and CFA analyses (from left to right: children, early adolescents, late adolescents, young adults, adults).

References

    1. Angold A, Costello EJ, Worthman CM. Puberty and depression: the roles of age, pubertal status and pubertal timing. Psychol Med. 1998;28(1):51–61.
    1. Barkley-Levenson EE, Van Leijenhorst L, Galvan A. Behavioral and neural correlates of loss aversion and risk avoidance in adolescents and adults. Dev Cogn Neurosci. 2013;3:72–83. doi: 10.1016/j.dcn.2012.09.007.
    1. Beck I, Smits DJM, Claes L, Vandereycken W, Bijttebier P. Psychometric evaluation of the behavioral inhibition/behavioral activation system scales and the sensitivity to punishment and sensitivity to reward questionnaire in a sample of eating disordered patients. Personality and Individual Differences. 2009;47(5):407–412.
    1. Bollen KA. Structural equations with latent variables. New York: Wiley; 1989.
    1. Brannick MT. Critical comments on applying covariance structure modeling. Journal of Organizational Behavior. 1995;16:201–214.
    1. Bress JN, Foti D, Kotov R, Klein DN, Hajcak G. Blunted neural response to rewards prospectively predicts depression in adolescent girls. Psychophysiology. 2013;50(1):74–81. doi: 10.1111/j.1469-8986.2012.01485.x.
    1. Bress JN, Smith E, Foti D, Klein DN, Hajcak G. Neural response to reward and depressive symptoms in late childhood to early adolescence. Biol Psychol. 2012;89(1):156–162. doi: 10.1016/j.biopsycho.2011.10.004.
    1. Campbell-Sills L, Liverant GI, Brown TA. Psychometric evaluation of the behavioral inhibition/behavioral activation scales in a large sample of outpatients with anxiety and mood disorders. Psychol Assess. 2004;16(3):244–254. doi: 10.1037/1040-3590.16.3.244.
    1. Canivez GL. Bifactor modeling in construct validation of multifactored tests: Implications for understanding multidimensional constructs and test interpretation. In: Schweizer K, DiStefano C, editors. Principles and methods of test construction: Standards and recent advancements. Gottingen, Germany: Hogrefe Publishers; in press.
    1. Carver CS, White TL. Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: the BIS/BAS scales. Journal of Personality and Social Psychology. 1994;67(2):319–333.
    1. Chen FF. Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Structural Equation Modeling: a Multidisciplinary Journal. 2007;14(3):464–504.
    1. Cheung GW, Rensvold RB. Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Structural Equation Modeling: a Multidisciplinary Journal. 2002;9(2):233–255. doi: 10.1207/S15328007SEM0902_5.
    1. Cogswell A, Alloy LB, van Dulmen MHM, Fresco DM. A psychometric evaluation of behavioral inhibition and approach self-report measures. Personality and Individual Differences. 2006;40(8):1649–1658.
    1. Colder CR, O'Connor RM. Gray's reinforcement sensitivity model and child psychopathology: laboratory and questionnaire assessment of the BAS and BIS. J Abnorm Child Psychol. 2004;32(4):435–451.
    1. Cooper A, Gomez R, Aucote H. The Behavioural Inhibition System and Behavioural Approach System (BIS/BAS) Scales: Measurement and structural invariance across adults and adolescents. Personality and Individual Differences. 2007;43(2):295–305.
    1. Cooper JA, Perkins AM, Corr PJ. A Confirmatory Factor Analytic Study of Anxiety, Fear, and Behavioral Inhibition System Measures. Journal of Individual Differences. 2007;28(4):179–187.
    1. Costello AB, Osborne JW. Best Practices in Exploratory Factor Analysis: Four Recommendations for Getting the Most From Your Analysis. Practical Assessment, Research, & Evaluation. 2005:1–9.
    1. Demianczyk AC, Jenkins AL, Henson JM, Conner BT. Psychometric Evaluation and Revision of Carver and White's BIS/BAS Scales in a Diverse Sample of Young Adults. J Pers Assess. 2014 doi: 10.1080/00223891.2013.870570.
    1. Dowd EC, Barch DM. Anhedonia and emotional experience in schizophrenia: neural and behavioral indicators. Biol Psychiatry. 2010;67(10):902–911.
    1. Epskamp A. semPlot: Path diagrams and visual analysis of various SEM packages' output 2013
    1. Eshel N, Roiser JP. Reward and punishment processing in depression. Biol Psychiatry. 2010;68(2):118–124. doi: 10.1016/j.biopsych.2010.01.027.
    1. Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods. 1999;4(3):272.
    1. Feingold A. Gender differences in personality: a meta-analysis. [Meta-Analysis] Psychol Bull. 1994;116(3):429–456.
    1. Forbes EE, Shaw DS, Dahl RE. Alterations in reward-related decision making in boys with recent and future depression. Biol Psychiatry. 2007;61(5):633–639. doi: 10.1016/j.biopsych.2006.05.026.
    1. Foti D, Kotov R, Klein DN, Hajcak G. Abnormal neural sensitivity to monetary gains versus losses among adolescents at risk for depression. J Abnorm Child Psychol. 2011;39(7):913–924. doi: 10.1007/s10802-011-9503-9.
    1. Franken IHA, Muris P, Rassin E. Psychometric Properties of the Dutch BIS/BAS Scales. Journal of Psychopathology and Behavioral Assessment. 2005;27(1):25–30.
    1. Galvan A. Adolescent development of the reward system. Front Hum Neurosci. 2010;4:6. doi: 10.3389/neuro.09.006.2010.
    1. Galvan A, McGlennen KM. Enhanced striatal sensitivity to aversive reinforcement in adolescents versus adults. J Cogn Neurosci. 2013;25(2):284–296. doi: 10.1162/jocn_a_00326.
    1. Galvan A, Van Leijenhorst L, McGlennen KM. Considerations for imaging the adolescent brain. Dev Cogn Neurosci. 2012;2(3):293–302. doi: 10.1016/j.dcn.2012.02.002.
    1. Garrido LE, Abad FJ, Ponsoda V. Performance of Velicer's minimum average partial factor retention method with categorical variables. Educational and Psychological Measurement 2011
    1. Garrido LE, Abad FJ, Ponsoda V. A new look at Horn's parallel analysis with ordinal variables. Psychological methods. 2013;18(4):454.
    1. Gotlib IH, Hamilton JP, Cooney RE, Singh MK, Henry ML, Joormann J. Neural processing of reward and loss in girls at risk for major depression. Arch Gen Psychiatry. 2010;67(4):380–387.
    1. Gray JA. The psychophysiological basis of introversion-extraversion. Behav Res Ther. 1970;8(3):249–266.
    1. Gray JA. A critique of Eysenck's theory of personality. Berlin: Springer-Verlag; 1981.
    1. Gray JA. The neuropsychology of anxiety: An enquiry into the functions of the septo-hippocampal system. New York: Oxford University Press; 1982.
    1. Gray JA. The psychology of fear and stress. Cambridge: Cambridge University Press; 1987.
    1. Gray JA. Framework for a taxonomy of psychiatric disorder. Hove: Lawrence Erlbaum; 1994.
    1. Hasking PA. Reinforcement sensitivity, coping, and delinquent behaviour in adolescents. J Adolesc. 2007;30(5):739–749. doi: 10.1016/j.adolescence.2006.11.006.
    1. Hayden EP, Klein DN, Dougherty LR, Olino TM, Laptook RS, Dyson MW, et al. Singh SM. The dopamine D2 receptor gene and depressive and anxious symptoms in childhood: associations and evidence for gene-environment correlation and gene-environment interaction. Psychiatr Genet. 2010;20(6):304–310. doi: 10.1097/YPG.0b013e32833adccb.
    1. Heym N, Ferguson E, Lawrence C. An evaluation of the relationship between Gray's revised RST and Eysenck's PEN: Distinguishing BIS and FFFS in Carver and White's BIS/BAS scales. Personality and Individual Differences. 2008;45(8):709–715.
    1. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: a Multidisciplinary Journal. 1999;6(1):1–55.
    1. Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, Quinn K, et al. Wang P. Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am J Psychiatry. 2010;167(7):748–751. doi: 10.1176/appi.ajp.2010.09091379.
    1. Institute of Medicine (US) and National Research Council (US) Committee on the Science of Adolescence. The Science of Adolescent Risk-Taking: Workshop Report. Washington (DC): National Academies Press (US); 2011.
    1. Johnson SL, Turner RJ, Iwata N. BIS/BAS levels and psychiatric disorder: An epidemiological study. Journal of Psychopathology and Behavioral Assessment. 2003;25:25–36.
    1. Johnson SL, Turner RJ, Iwata N. BIS/BAS Levels and Psychiatric Disorder: An Epidemiological Study. Journal of Psychopathology and behavioral assessment. 2003;25(1):1–12.
    1. Jonker NC, Ostafin BD, Glashouwer KA, van Hemel-Ruiter ME, de Jong PJ. Reward and punishment sensitivity and alcohol use: the moderating role of executive control. Addict Behav. 2014;39(5):945–948. doi: 10.1016/j.addbeh.2013.12.011.
    1. Jorm AF, Christensen H, Henderson AS, Jacomb PA, Korten AE, Rodgers B. Using the BIS/BAS scales to measure behavioural inhibition and behavioural activation: Factor structure, validity and norms in a large community sample. Personality and Individual Differences. 1998;26(1):49–58.
    1. Kingsbury A, Coplan RJ, Weeks M, Rose-Krasnor L. Covering all the BAS's: A closer look at the links between BIS, BAS, and socio-emotional functioning in childhood. Personality and Individual Differences. 2013;55(5):521–526.
    1. Lebel C, Beaulieu C. Longitudinal development of human brain wiring continues from childhood into adulthood. J Neurosci. 2011;31(30):10937–10947. doi: 10.1523/JNEUROSCI.5302-10.2011.
    1. Lebel C, Walker L, Leemans A, Phillips L, Beaulieu C. Microstructural maturation of the human brain from childhood to adulthood. Neuroimage. 2008;40(3):1044–1055. doi: 10.1016/j.neuroimage.2007.12.053.
    1. Loxton NJ, Dawe S. Alcohol abuse and dysfunctional eating in adolescent girls: the influence of individual differences in sensitivity to reward and punishment. Int J Eat Disord. 2001;29(4):455–462.
    1. Luking KR, Luby JL, Barch DM. Kids, candy, brain and behavior: Age differences in responses to candy gains and losses. Dev Cogn Neurosci. 2014;9C:82–92. doi: 10.1016/j.dcn.2014.01.005.
    1. Luna B, Velanova K, Geier CF. Methodological approaches in developmental neuroimaging studies. Hum Brain Mapp. 2010;31(6):863–871. doi: 10.1002/hbm.21073.
    1. McCrae RR. A contemplated revision of the NEO Five-Factor Inventory. Personality and Individual Differences. 2004;36(3):587–596.
    1. McCrae RR, Allik J. The Five-Factor Model of Personality Across Cultures. Springer Science & Business Media; 2002.
    1. Millsap RE, Yun-Tein J. Assessing factorial invariance in ordered-categorical measures. Multivariate Behavioral Research. 2004;39(3):479–515.
    1. Morean ME, DeMartini KS, Leeman RF, Pearlson GD, Anticevic A, Krishnan-Sarin S, et al. O'Malley SS. Psychometrically Improved, Abbreviated Versions of Three Classic Measures of Impulsivity and Self-Control. Psychol Assess. 2014 doi: 10.1037/pas0000003.
    1. Morgan JK, Olino TM, McMakin DL, Ryan ND, Forbes EE. Neural response to reward as a predictor of increases in depressive symptoms in adolescence. Neurobiol Dis. 2013;52:66–74. doi: 10.1016/j.nbd.2012.03.039.
    1. Muris P, Meesters C, de Kanter E, Timmerman PE. Behavioural inhibition and behavioural activation system scales for children: relationships with Eysencks personality traits and psychopathological symptoms. Personality and Individual Differences. 2005;38:831–841.
    1. Muthen B, Kaplan D. A comparison of some methodologies for the factor analysis of non - normal Likert variables. British Journal of Mathematical and Statistical Psychology. 1985;38(2):171–189.
    1. Muthen B, Kaplan D. A comparison of some methodologies for the factor analysis of non - normal Likert variables: A note on the size of the model. British Journal of Mathematical and Statistical Psychology. 1992;45(1):19–30.
    1. Olino TM, McMakin DL, Morgan JK, Silk JS, Birmaher B, Axelson DA, et al. Forbes EE. Reduced reward anticipation in youth at high-risk for unipolar depression: a preliminary study. Dev Cogn Neurosci. 2014;8:55–64. doi: 10.1016/j.dcn.2013.11.005.
    1. Pettersson E, Turkheimer E, Horn EE, Menatti AR. The General Factor of Personality and Evaluation. European Journal of Personality. 2011;26(3):292–302. doi: 10.1002/per.839.
    1. Pornprasertmanit S, Miller P, Schoemann A, Rosseel Y. semTools: Useful tools for structural equation modeling 2013
    1. Poythress NG, Skeem JL, Weir J, Lilienfeld SO, Douglas KS, Edens JF, Kennealy PJ. Psychometric Properties of Carver and White's (1994) BIS/BAS Scales in a Large Sample of Offenders. Pers Individ Dif. 2008;45(8):732–737. doi: 10.1016/j.paid.2008.07.021.
    1. Reise SP. The rediscovery of bifactor measurement models. Multivariate Behavioral Research. 2012;47:667–696. doi: 10.1080/00273171.2012.715555.
    1. Richards JM, Plate RC, Ernst M. A systematic review of fMRI reward paradigms in adolescents vs. adults: The impact of task design and implications for understanding neurodevelopment. Neurosci Biobehav Rev. 2013 doi: 10.1016/j.neubiorev.2013.03.004.
    1. Rosseel Y. lavaan: An R package for structural equation modeling 2012
    1. Schmid J, Leiman JM. The development of hierarchical factor solutions. Psychometrika. 1957;22(1):53–61.
    1. Spear LP. The adolescent brain and age-related behavioral manifestations. Neurosci Biobehav Rev. 2000;24(4):417–463.
    1. Spear LP. Rewards, aversions and affect in adolescence: emerging convergences across laboratory animal and human data. Dev Cogn Neurosci. 2011;1(4):392–400. doi: 10.1016/j.dcn.2011.08.001.
    1. Team, R. C. R: A language and environment for statistical computing 2012
    1. Tucker LR, Lewis C. A reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973;38(1-10)
    1. Urosevic S, Abramson LY, Harmon-Jones E, Alloy LB. Dysregulation of the behavioral approach system (BAS) in bipolar spectrum disorders: review of theory and evidence. Clin Psychol Rev. 2008;28(7):1188–1205. doi: 10.1016/j.cpr.2008.04.004.
    1. Urosevic S, Collins P, Muetzel R, Lim K, Luciana M. Longitudinal changes in behavioral approach system sensitivity and brain structures involved in reward processing during adolescence. Dev Psychol. 2012;48(5):1488–1500. doi: 10.1037/a0027502.
    1. Volkow ND, Wang GJ, Kollins SH, Wigal TL, Newcorn JH, Telang F, et al. Swanson JM. Evaluating dopamine reward pathway in ADHD: clinical implications. JAMA. 2009;302(10):1084–1091. doi: 10.1001/jama.2009.1308.
    1. Yu S, Branje SJT, Keusers L, Meeus WHJ. Psychometric Characteristics of Carver and White's BIS/BAS Scales in Dutch Adolescents and Their Mothers. Journal of Personality Assessment. 2011;93(5):500–507.

Source: PubMed

3
Abonner