Characterizing a psychiatric symptom dimension related to deficits in goal-directed control

Claire M Gillan, Michal Kosinski, Robert Whelan, Elizabeth A Phelps, Nathaniel D Daw, Claire M Gillan, Michal Kosinski, Robert Whelan, Elizabeth A Phelps, Nathaniel D Daw

Abstract

Prominent theories suggest that compulsive behaviors, characteristic of obsessive-compulsive disorder and addiction, are driven by shared deficits in goal-directed control, which confers vulnerability for developing rigid habits. However, recent studies have shown that deficient goal-directed control accompanies several disorders, including those without an obvious compulsive element. Reasoning that this lack of clinical specificity might reflect broader issues with psychiatric diagnostic categories, we investigated whether a dimensional approach would better delineate the clinical manifestations of goal-directed deficits. Using large-scale online assessment of psychiatric symptoms and neurocognitive performance in two independent general-population samples, we found that deficits in goal-directed control were most strongly associated with a symptom dimension comprising compulsive behavior and intrusive thought. This association was highly specific when compared to other non-compulsive aspects of psychopathology. These data showcase a powerful new methodology and highlight the potential of a dimensional, biologically-grounded approach to psychiatry research.

Keywords: compulsive; computational; dimensional; goal-directed; habit; human; human biology; medicine; neuroscience; psychiatry.

Conflict of interest statement

The authors declare that no competing interests exist.

Figures

Figure 1.. Two-step reinforcement learning task used…
Figure 1.. Two-step reinforcement learning task used to assess goal-directed (model-based) learning.
(a) Subjects chose between two fractals, which probabilistically determined whether they would transition to the orange or blue second stage state. For example, the fractal on the left had a 70% chance of leading to the blue second stage state (‘common’ transition) and a 30% chance of leading to the orange state (‘rare’ transition). These transition probabilities were fixed and could be learned over time. In the second stage state, subjects chose between two fractals, each of which was associated with a distinct probability of being rewarded with a 25 cents coin. The probability of receiving a reward associated with each second stage fractal could also be learned, but (unlike the transition structure) these drifted slowly over time (0.25 < P <0.75, panel b). This meant that in order to earn the most rewards possible, subjects had to track which second stage fractals were currently best as they changed over time. Reward probabilities depicted (34%, 68%, 72%, 67%) refer to example trial 50, denoted by the vertical dashed line in (b). (b) Drifting reward probabilities determined by Gaussian Random Walks for 200 trials with grey horizontal lines indicating boundaries at 0.25 and 0.75. (c) Schematic representing the performance of a purely ‘model-free’ learner, who only exhibits sensitivity to whether or not the previous trial was rewarded vs. unrewarded, and does not modify their behavior in light of the transition that preceded reward. (d) Schematic representing the performance of a purely ‘model-based’ learner, who is more likely to repeat an action (i.e. ‘stay’) following a rewarded trial, only if the transition was common. If the transition to that rewarded state was rare, they are more likely to switch on the next trial. DOI:http://dx.doi.org/10.7554/eLife.11305.003
Figure 2.. Associations between Goal-directed (model-based) deficits…
Figure 2.. Associations between Goal-directed (model-based) deficits and self-reported psychopathology.
The y-axes indicate the% change in model-based learning for each change of 1 standard deviation (SD) of clinical symptoms. Error bars denote standard error. (a) In Experiment 1, total scores on a self-report questionnaire assessing OCD symptoms in a general population sample were associated with deficits in goal-directed (model-based) learning. Specifically, for each increase of 1 SD in OCD symptoms reported, model-based learning was 14% lower than the group mean. No effects were observed in depression or trait anxiety. (b) In Experiment 2, the results from Experiment 1 were replicated: OCD symptoms were associated with deficits in goal-directed learning, while total scores on questionnaires assessing depression and trait anxiety were not. We found that the association between compulsive behavior and goal-directed deficits generalized to symptoms associated with other disorders that are similarly characterized by a loss of control over behavior, alcohol addiction, eating disorders and impulsivity. No significant effects were observed for scores on questionnaires assessing schizotypy, depression, trait anxiety, apathy or social anxiety. DOI:http://dx.doi.org/10.7554/eLife.11305.005
Figure 3.. Trans-diagnostic factors.
Figure 3.. Trans-diagnostic factors.
(a) Factor analysis on the correlation matrix of 209 questionnaire items suggested that 3-factor solution best explained these data. Factors were ‘Anxious-Depression’, ‘Compulsive Behavior and Intrusive Thought’ and ‘Social Withdrawal’. Item loadings for each factor are presented on the top, left and bottom sides of the correlation matrix, color-codes indicate the questionnaire from which each item was drawn. (b) These factors were entered into mixed-effects models, revealing that only the Factor 2 ‘Compulsive Behavior and Intrusive Thought’ was associated with goal-directed deficits, the effect size (17% reduction in model-based learning for every 1 SD increase in ‘Compulsive Behavior and Intrusive Thought’) was larger than for any individual questionnaire, and pairwise contrasts revealed that these deficits were specific to this factor, compared to Factor 1 ‘Anxious-Depression’ and Factor 3 ‘Social Withdrawal’. The y-axes indicate the% change in model-based learning for each change of 1 standard deviation (SD) of clinical symptomatology. Error bars denote standard error. DOI:http://dx.doi.org/10.7554/eLife.11305.007
Figure 4.. Behavioral data from experiments 1…
Figure 4.. Behavioral data from experiments 1 (N=548) and 2 (N=1413).
Error bars denote standard error. Data illustrate that consistent with previous studies (Daw et al., 2011), participants use a mixture of model-based and model-free learning to guide choice. Associated statistics are presented in Supplementary file 1B. *pDOI: http://dx.doi.org/10.7554/eLife.11305.009
Figure 5.. Scree plot of eigenvalues.
Figure 5.. Scree plot of eigenvalues.
The outer frame shows the eigenvalues for every possible factor solution, N=209. Inset is data for the first 20 potential factor solutions only. An empirically defined elbow, where Eigenvalues begin to level out, was identified at factor 4 using the nFactors package in R, provideing evidence for a 3-factor solution (Cattell, 1966), indicated in orange.*pDOI: http://dx.doi.org/10.7554/eLife.11305.010
Author response image 1.. Plotted are the…
Author response image 1.. Plotted are the regression lines for 18 different analyses, where the population was split into the top 25% and bottom 75% for each of the nine clinical questionnaires.
DOI:http://dx.doi.org/10.7554/eLife.11305.016

References

    1. Alvares GA, Balleine BW, Guastella AJ. Impairments in goal-directed actions predict treatment response to cognitive-behavioral therapy in social anxiety disorder. PLoS ONE. 2014;9:e11305. doi: 10.1371/journal.pone.0094778.
    1. American Psychiatric Association . (5 edn) American Psychiatric Publishing; 2013. Diagnostic and Statistical Manual of Mental Disorders.
    1. Arffa S. The relationship of intelligence to executive function and non-executive function measures in a sample of average, above average, and gifted youth. Archives of Clinical Neuropsychology. 2007;22:969–978. doi: 10.1016/j.acn.2007.08.001.
    1. Baker F. Marcel Dekker; 1992. Item Response Theory: Parameter Estimation Techniques.
    1. Bezanson J, Karpinski S, Shah VB, Edelman A. Julia: a fast dynamic language for technical computing. MIT 2012
    1. Bickel WK, Jarmolowicz DP, Mueller ET, Koffarnus MN, Gatchalian KM. Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: emerging evidence. Pharmacology & Therapeutics. 2012;134:287–297. doi: 10.1016/j.pharmthera.2012.02.004.
    1. Birnbaum A. Statistical theory for logistic mental test models with a prior distribution of ability. Journal of Mathematical Psychology. 1969;6:258–276. doi: 10.1016/0022-2496(69)90005-4.
    1. Brodersen KH, Deserno L, Schlagenhauf F, Lin Z, Penny WD, Buhmann JM, Stephan KE. Dissecting psychiatric spectrum disorders by generative embedding. NeuroImage: Clinical. 2014;4:98–111. doi: 10.1016/j.nicl.2013.11.002.
    1. Cattell RB. The scree test for the number of factors. Multivariate Behavioral Research. 1966;1:245–276. doi: 10.1207/s15327906mbr0102_10.
    1. Chamberlain SR, Fineberg NA, Blackwell AD, Clark L, Robbins TW, Sahakian BJ. A neuropsychological comparison of obsessive–compulsive disorder and trichotillomania. Neuropsychologia. 2007;45:654–662. doi: 10.1016/j.neuropsychologia.2006.07.016.
    1. Crump MJC, McDonnell JV, Gureckis TM. Evaluating amazon's mechanical turk as a tool for experimental behavioral research. PLoS One. 2013;8:e11305. doi: 10.1371/journal.pone.0057410.
    1. Cushman F, Morris A. Habitual control of goal selection in humans. Proceedings of the National Academy of Sciences of the United States of America. 2015;112:13817–13822. doi: 10.1073/pnas.1506367112.
    1. Cuthbert BN, Kozak MJ. Constructing constructs for psychopathology: the NIMH research domain criteria. Journal of Abnormal Psychology. 2013;122:928–937. doi: 10.1037/a0034028.
    1. Dalley JW, Everitt BJ, Robbins TW. Impulsivity, compulsivity, and top-down cognitive control. Neuron. 2011;69:680–694. doi: 10.1016/j.neuron.2011.01.020.
    1. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ. Model-based influences on humans' choices and striatal prediction errors. Neuron. 2011;69:1204–1215. doi: 10.1016/j.neuron.2011.02.027.
    1. Dickinson A. Actions and habits: the development of behavioural autonomy. Philosophical Transactions of the Royal Society B: Biological Sciences. 1985;308:67–78. doi: 10.1098/rstb.1985.0010.
    1. Dickinson A, Balleine B. Motivational control of goal-directed action. Animal Learning & Behavior. 1994;22:1–18. doi: 10.3758/BF03199951.
    1. Dolan RJ, Dayan P. Goals and habits in the brain. Neuron. 2013;80:312–325. doi: 10.1016/j.neuron.2013.09.007.
    1. Drasgow F, Lissak RI. Modified parallel analysis: a procedure for examining the latent dimensionality of dichotomously scored item responses. Journal of Applied Psychology. 1983;68:363–373. doi: 10.1037/0021-9010.68.3.363.
    1. Eppinger B, Walter M, Heekeren HR, Li S-C. Of goals and habits: age-related and individual differences in goal-directed decision-making. Frontiers in Neuroscience. 2013;7 doi: 10.3389/fnins.2013.00253.
    1. Everitt BJ, Robbins TW. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nature Neuroscience. 2005;8:1481–1489. doi: 10.1038/nn1579.
    1. Fair DA, Bathula D, Nikolas MA, Nigg JT. Distinct neuropsychological subgroups in typically developing youth inform heterogeneity in children with ADHD. Proceedings of the National Academy of Sciences of the United States of America. 2012;109:6769–6774. doi: 10.1073/pnas.1115365109.
    1. Foa EB, Huppert JD, Leiberg S, Langner R, Kichic R, Hajcak G, Salkovskis PM. The obsessive-compulsive inventory: development and validation of a short version. Psychological Assessment. 2002;14:485–496. doi: 10.1037/1040-3590.14.4.485.
    1. Friedel E, Koch SP, Wendt J, Heinz A, Deserno L, Schlagenhauf F. Devaluation and sequential decisions: linking goal-directed and model-based behavior. Frontiers in Human Neuroscience. 2014;8:587. doi: 10.3389/fnhum.2014.00587.
    1. Furlong TM, Jayaweera HK, Balleine BW, Corbit LH. Binge-like consumption of a palatable food accelerates habitual control of behavior and is dependent on activation of the dorsolateral striatum. Journal of Neuroscience. 2014;34:5012–5022. doi: 10.1523/JNEUROSCI.3707-13.2014.
    1. Garner DM, Olmsted MP, Bohr Y, Garfinkel PE. The eating attitudes test: psychometric features and clinical correlates. Psychological Medicine. 1982;12:871–878. doi: 10.1017/S0033291700049163.
    1. Gillan CM, Papmeyer M, Morein-Zamir S, Sahakian BJ, Fineberg NA, Robbins TW, de Wit S. Disruption in the balance between goal-directed behavior and habit learning in obsessive-compulsive disorder. American Journal of Psychiatry. 2011;168:718–726. doi: 10.1176/appi.ajp.2011.10071062.
    1. Gillan CM, Robbins TW. Goal-directed learning and obsessive-compulsive disorder. Philosophical Transactions of the Royal Society B: Biological Sciences. 2014;369:20130475. doi: 10.1098/rstb.2013.0475.
    1. Gillan CM, Morein-Zamir S, Kaser M, Fineberg NA, Sule A, Sahakian BJ, Cardinal RN, Robbins TW. Counterfactual processing of economic action-outcome alternatives in obsessive-compulsive disorder: further evidence of impaired goal-directed behavior. Biological Psychiatry. 2014a;75:639–646. doi: 10.1016/j.biopsych.2013.01.018.
    1. Gillan CM, Morein-Zamir S, Urcelay GP, Sule A, Voon V, Apergis-Schoute AM, Fineberg NA, Sahakian BJ, Robbins TW. Enhanced avoidance habits in obsessive-compulsive disorder. Biological Psychiatry. 2014b;75:631–638. doi: 10.1016/j.biopsych.2013.02.002.
    1. Gillan CM, Apergis-Schoute A, Morein-Zamir S, Urcelay GP, Sule A, Fineberg NA, Sahakian BJ, Robbins TW. Functional neuroimaging of avoidance habits in obsessive-compulsive disorder. American Journal of Psychiatry. 2015a;172:284–293. doi: 10.1176/appi.ajp.2014.14040525.
    1. Gillan CM, Robbins TW, Sahakian BJ, van den Heuvel OA, van Wingen G. The role of habit in compulsivity. European Neuropsychopharmacology. 2015b doi: 10.1016/j.euroneuro.2015.12.033.
    1. Gillan CM, Otto AR, Phelps EA, Daw ND. Model-based learning protects against forming habits. Cognitive, Affective, & Behavioral Neuroscience. 2015c;15:523–536. doi: 10.3758/s13415-015-0347-6.
    1. Godier LR, Park RJ. Compulsivity in anorexia nervosa: a transdiagnostic concept. Frontiers in Psychology. 2014;5:778. doi: 10.3389/fpsyg.2014.00778.
    1. Gorsuch R, Nelson J. CNG screen test: an objective procedure for determining the number of factors 1981.
    1. Graybiel AM, Rauch SL. Toward a neurobiology of obsessive-compulsive disorder. Neuron. 2000;28:343–347. doi: 10.1016/S0896-6273(00)00113-6.
    1. Hajcak G, Huppert JD, Simons RF, Foa EB. Psychometric properties of the OCI-r in a college sample. Behaviour Research and Therapy. 2004;42:115–123. doi: 10.1016/j.brat.2003.08.002.
    1. Hoerl AE, Kennard RW. Ridge regression: biased estimation for nonorthogonal problems. Technometrics. 1970;12:55–67. doi: 10.1080/00401706.1970.10488634.
    1. Huys QJM, Cools R, Gölzer M, Friedel E, Heinz A, Dolan RJ, Dayan P. Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. PLoS Computational Biology. 2011;7:e11305. doi: 10.1371/journal.pcbi.1002028.
    1. Hyman SE. Can neuroscience be integrated into the DSM-v? Nature Reviews Neuroscience. 2007;8:725–732. doi: 10.1038/nrn2218.
    1. Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, Quinn K, Sanislow C, Wang P. Research domain criteria (rDoC): toward a new classification framework for research on mental disorders. American Journal of Psychiatry. 2010;167:748–751. doi: 10.1176/appi.ajp.2010.09091379.
    1. Kessler RC, Chiu WT, Demler O, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the national comorbidity survey replication. Archives of General Psychiatry. 2005;62:617–389. doi: 10.1001/archpsyc.62.6.617.
    1. Kingsbury GG, Zara AR. Procedures for selecting items for computerized adaptive tests. Applied Measurement in Education. 1989;2:359–375. doi: 10.1207/s15324818ame0204_6.
    1. Liebowitz MR. Social phobia. Modern Problems of Pharmacopsychiatry. 1987;22:141–173. doi: 10.1159/000414022.
    1. Lipszyc J, Schachar R. Inhibitory control and psychopathology: a meta-analysis of studies using the stop signal task. Journal of the International Neuropsychological Society. 2010;16:1064–1076. doi: 10.1017/S1355617710000895.
    1. Lysaker PH, Bell MD, Bryson G, Kaplan E. Neurocognitive function and insight in schizophrenia: support for an association with impairments in executive function but not with impairments in global function. Acta Psychiatrica Scandinavica. 1998;97:297–301. doi: 10.1111/j.1600-0447.1998.tb10003.x.
    1. Lysaker PH, Bryson GJ, Lancaster RS, Evans JD, Bell MD. Insight in schizophrenia: associations with executive function and coping style. Schizophrenia Research. 2003;59:41–47. doi: 10.1016/S0920-9964(01)00383-8.
    1. Marin RS, Biedrzycki RC, Firinciogullari S. Reliability and validity of the apathy evaluation scale. Psychiatry Research. 1991;38:143–162. doi: 10.1016/0165-1781(91)90040-V.
    1. Mason O, Linney Y, Claridge G. Short scales for measuring schizotypy. Schizophrenia Research. 2005;78:293–296. doi: 10.1016/j.schres.2005.06.020.
    1. Miyake A, Friedman NP, Emerson MJ, Witzki AH, Howerter A, Wager TD. The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: a latent variable analysis. Cognitive Psychology. 2000;41:49–100. doi: 10.1006/cogp.1999.0734.
    1. Montague PR, Dolan RJ, Friston KJ, Dayan P. Computational psychiatry. Trends in Cognitive Sciences. 2012;16:72–80. doi: 10.1016/j.tics.2011.11.018.
    1. Morris RW, Quail S, Griffiths KR, Green MJ, Balleine BW. Corticostriatal control of goal-directed action is impaired in schizophrenia. Biological Psychiatry. 2015;77:187–195. doi: 10.1016/j.biopsych.2014.06.005.
    1. Otto AR, Raio CM, Chiang A, Phelps EA, Daw ND. Working-memory capacity protects model-based learning from stress. Proceedings of the National Academy of Sciences of the United States of America. 2013;110:20941–20946. doi: 10.1073/pnas.1312011110.
    1. Patton JH, Stanford MS, Barratt ES. Factor structure of the barratt impulsiveness scale. Journal of Clinical Psychology. 1995;51:768–774. doi: 10.1002/1097-4679(199511)51:6<768::AID-JCLP2270510607>;2-1.
    1. Potenza MN. Review. the neurobiology of pathological gambling and drug addiction: an overview and new findings. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences. 2008;363:3181–3189. doi: 10.1098/rstb.2008.0100.
    1. Poyurovsky M, Koran LM. Obsessive–compulsive disorder (oCD) with schizotypy vs. schizophrenia with OCD: diagnostic dilemmas and therapeutic implications. Journal of Psychiatric Research. 2005;39:399–408. doi: 10.1016/j.jpsychires.2004.09.004.
    1. Raven J. The raven's progressive matrices: change and stability over culture and time. Cognitive Psychology. 2000;41:1–48. doi: 10.1006/cogp.1999.0735.
    1. Robbins TW, Gillan CM, Smith DG, de Wit S, Ersche KD. Neurocognitive endophenotypes of impulsivity and compulsivity: towards dimensional psychiatry. Trends in Cognitive Sciences. 2012;16:81–91. doi: 10.1016/j.tics.2011.11.009.
    1. Ruscio AM, Stein DJ, Chiu WT, Kessler RC. The epidemiology of obsessive-compulsive disorder in the national comorbidity survey replication. Molecular Psychiatry. 2010;15:53–63. doi: 10.1038/mp.2008.94.
    1. Sandstrom NJ, Kaufman J, A. Huettel S. Males and females use different distal cues in a virtual environment navigation task. Cognitive Brain Research. 1998;6:351–360. doi: 10.1016/S0926-6410(98)00002-0.
    1. Saunders JB, Aasland OG, Babor TF, De La Fuente JR, Grant M. Development of the alcohol use disorders identification test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption-II. Addiction. 1993;88:791–804. doi: 10.1111/j.1360-0443.1993.tb02093.x.
    1. Schad DJ, Jünger E, Sebold M, Garbusow M, Bernhardt N, Javadi A-H, Zimmermann US, Smolka MN, Heinz A, Rapp MA, Huys QJM. Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning. Frontiers in Psychology. 2014;5:1450. doi: 10.3389/fpsyg.2014.01450.
    1. Schwabe L, Wolf OT. Stress prompts habit behavior in humans. Journal of Neuroscience. 2009;29:7191–7198. doi: 10.1523/JNEUROSCI.0979-09.2009.
    1. Sjoerds Z, de Wit S, van den Brink W, Robbins TW, Beekman ATF, Penninx BWJH, Veltman DJ. Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients. Translational Psychiatry. 2013;3:e11305. doi: 10.1038/tp.2013.107.
    1. Skatova A, Chan PA, Daw ND. Extraversion differentiates between model-based and model-free strategies in a reinforcement learning task. Frontiers in Human Neuroscience. 2013;7 doi: 10.3389/fnhum.2013.00525.
    1. Spielberger CD, Gorsuch RL, Lushene R, Vagg PR, Jacobs GA. Manual for the State-Trait Anxiety Inventory. Consulting Psychologists Press; 1983.
    1. Tibshirani R. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society Series B-Methodological. 1996;58:267–288.
    1. va der Linden W, Pashley P. Computerized adaptive testing. In: van der Linden WJ, Glas C A W, editors. Theory and Practice. Kluwer; pp. 1–25.
    1. Voon V, Derbyshire K, Rück C, Irvine MA, Worbe Y, Enander J, Schreiber LRN, Gillan C, Fineberg NA, Sahakian BJ, Robbins TW, Harrison NA, Wood J, Daw ND, Dayan P, Grant JE, Bullmore ET. Disorders of compulsivity: a common bias towards learning habits. Molecular Psychiatry. 2015;20:345–352. doi: 10.1038/mp.2014.44.
    1. Zung WWK. A self-rating depression scale. Archives of General Psychiatry. 1965;12:63–70. doi: 10.1001/archpsyc.1965.01720310065008.
    1. Zou H, Hastie T. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 2005;67:301–320. doi: 10.1111/j.1467-9868.2005.00503.x.

Source: PubMed

3
Iratkozz fel