Differential Effects of Psychotic Illness on Directed and Random Exploration
References
- Andreasen, N. C. (1984). The Scale for the Assessment of Negative Symptoms (SANS). Iowa City, IA: University of Iowa.
- Badre, D. , Doll, B. B. , Long, N. , & Frank, M. J. (2012). Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration. Neuron, 73, 595–607. https://doi.org/10.1016/j.neuron.2011.12.025
- Baker, S. C. , Konova, A. B. , Daw, N. D. , & Horga, G. (2019). A distinct inferential mechanism for delusions in schizophrenia. Brain, 142, 1797–1812.
- Bell, V. , Halligan, P. W. , & Ellis, H. D. (2006). The Cardiff Anomalous Perceptions Scale (CAPS): A new validated measure of anomalous perceptual experience. Schizophrenia Bulletin, 32, 366–377. https://doi.org/10.1093/schbul/sbj014
- Brown, E. C. , Hack, S. M. , Gold, J. M. , Carpenter, W. T. , Fischer, B. A. , Prentice, K. P. , & Waltz, J. A. (2015). Integrating frequency and magnitude information in decision-making in schizophrenia: An account of patient performance on the Iowa Gambling Task. Journal of Psychiatric Research, 66–67, 16–23. https://doi.org/10.1016/j.jpsychires.2015.04.007
- Brown, J. K. , Waltz, J. A. , Strauss, G. P. , McMahon, R. P. , Frank, M. J. , & Gold, J. M. (2013). Hypothetical decision making in schizophrenia: The role of expected value computation and “irrational” biases. Psychiatry Research, 209, 142–149. https://doi.org/10.1016/j.psychres.2013.02.034
- Cheng, G. L. , Tang, J. C. , Li, F. W. , Lau, E. Y. , & Lee, T. M. (2012). Schizophrenia and risk-taking: Impaired reward but preserved punishment processing. Schizophrenia Research, 136, 122–127. https://doi.org/10.1016/j.schres.2012.01.002
- Collins, A. G. , Brown, J. K. , Gold, J. M. , Waltz, J. A. , & Frank, M. J. (2014). Working memory contributions to reinforcement learning impairments in schizophrenia. Journal of Neuroscience, 34, 13747–13756. https://doi.org/10.1523/JNEUROSCI.0989-14.2014
-
Corlett, P. R.
,
Horga, G.
,
Fletcher, P. C.
,
Alderson-Day, B.
,
Schmack, K.
, &
Powers, A. R.,
3rd . (2019). Hallucinations and strong priors. Trends in Cognitive Sciences, 23, 114–127. https://doi.org/10.1016/j.tics.2018.12.001 - Daw, N. D. , O’Doherty, J. P. , Dayan, P. , Seymour, B. , & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441, 876–879. https://doi.org/10.1038/nature04766
- First, M. B. , Spitzer, R. L. , Gibbon, M. , & Williams, J. B. W. (1997). Structured Clinical Interview for DSM–IV–Axis I Disorders (SCID-I). Washington, DC: American Psychiatric Press.
- Fletcher, P. C. , & Frith, C. D. (2009). Perceiving is believing: A Bayesian approach to explaining the positive symptoms of schizophrenia. Nature Reviews Neuroscience, 10(1), 48–58. https://doi.org/10.1038/nrn2536
- Gershman, S. J. (2019). Uncertainty and exploration. Decision, 6, 277. https://doi.org/10.1037/dec0000101
- Gittins, J. C. (1979). Bandit processes and dynamic allocation indices. Journal of the Royal Statistical Society, Series B, 41, 148–177. https://doi.org/10.1111/j.2517-6161.1979.tb01068.x
- Gittins, J. C. , & Jones, D. M. (1979). A dynamic allocation index for the discounted multiarmed bandit problem. Biometrika, 66, 561–565. https://doi.org/10.1093/biomet/66.3.561
- Gold, J. M. , Strauss, G. P. , Waltz, J. A. , Robinson, B. M. , Brown, J. K. , & Frank, M. J. (2013). Negative symptoms of schizophrenia are associated with abnormal effort-cost computations. Biological Psychiatry, 74, 130–136. https://doi.org/10.1016/j.biopsych.2012.12.022
- Green, M. F. , Nuechterlein, K. H. , Gold, J. M. , Barch, D. M. , Cohen, J. , Essock, S. , … Marder, S. R. (2004). Approaching a consensus cognitive battery for clinical trials in schizophrenia: The NIMH-MATRICS conference to select cognitive domains and test criteria. Biological Psychiatry, 56, 301–307. https://doi.org/10.1016/j.biopsych.2004.06.023
- Hernaus, D. , Xu, Z. , Brown, E. C. , Ruiz, R. , Frank, M. J. , Gold, J. M. , & Waltz, J. A. (2018). Motivational deficits in schizophrenia relate to abnormalities in cortical learning rate signals. Cognitive, Affective, and Behavioral Neuroscience, 18, 1338–1351. https://doi.org/10.3758/s13415-018-0643-z
- Jardri, R. , & Deneve, S. (2013). Circular inferences in schizophrenia. Brain, 136(Pt 11), 3227–3241. https://doi.org/10.1093/brain/awt257
- Kalman, R. E. (1960). A new approach to linear filtering and prediction problems. Journal of Basic Engineering, 82(1), 35–45. https://doi.org/10.1115/1.3662552
- Krug, A. , Cabanis, M. , Pyka, M. , Pauly, K. , Kellermann, T. , Walter, H. , … Kircher, T. (2014). Attenuated prefrontal activation during decision-making under uncertainty in schizophrenia: A multi-center fMRI study. Schizophrenia Research, 152(1), 176–183. https://doi.org/10.1016/j.schres.2013.11.007
- Lancaster, T. M. , Ihssen, N. , Brindley, L. M. , Tansey, K. E. , Mantripragada, K. , O’Donovan, M. C. , … Linden, D. E. (2016). Associations between polygenic risk for schizophrenia and brain function during probabilistic learning in healthy individuals. Human Brain Mapping, 37, 491–500. https://doi.org/10.1002/hbm.23044
- Lee, S. , Gold, J. I. , & Kable, J. W. (2020). The human as delta-rule learner. Decision, 7, 55.
- McMahon, R. P. , Kelly, D. L. , Kreyenbuhl, J. , Kirkpatrick, B. , Love, R. C. , & Conley, R. R. (2002). Novel factor-based symptom scores in treatment resistant schizophrenia: Implications for clinical trials. Neuropsychopharmacology, 26, 537–545.
- Overall, J. E. , & Gorman, D. R. (1962). The brief psychiatric rating scale. Psychological Reports, 10, 799–812. https://doi.org/10.2466/pr0.1962.10.3.799
- Peters, E. , Joseph, S. , Day, S. , & Garety, P. (2004). Measuring delusional ideation: The 21-item Peters et al. Delusions Inventory (PDI). Schizophrenia Bulletin, 30, 1005–1022. New York, NY: Appleton-Century-Crofts.
- Powers, A. R. , Mathys, C. , & Corlett, P. R. (2017). Pavlovian conditioning–induced hallucinations result from overweighting of perceptual priors. Science, 357, 596–600. https://doi.org/10.1126/science.aan3458
- Rescorla, R. A. , & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II (pp. 64–99). New York, NY: Appleton-Century-Crofts.
- Schultz, W. , Dayan, P. , & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593–1599. https://doi.org/10.1126/science.275.5306.1593
- Somerville, L. H. , Sasse, S. F. , Garrad, M. C. , Drysdale, A. T. , Abi Akar, N. , Insel, C. , & Wilson, R. C. (2017). Charting the expansion of strategic exploratory behavior during adolescence. Journal of Experimental Psychology: General, 146, 155. https://doi.org/10.1037/xge0000250
- Strauss, G. P. , Frank, M. J. , Waltz, J. A. , Kasanova, Z. , Herbener, E. S. , & Gold, J. M. (2011). Deficits in positive reinforcement learning and uncertainty-driven exploration are associated with distinct aspects of negative symptoms in schizophrenia. Biological Psychiatry, 69, 424–431. https://doi.org/10.1016/j.biopsych.2010.10.015
- Strauss, G. P. , Lee, B. G. , Waltz, J. A. , Robinson, B. M. , Brown, J. K. , & Gold, J. M. (2012). Cognition–emotion interactions are modulated by working memory capacity in individuals with schizophrenia. Schizophrenia Research, 141, 257–261. https://doi.org/10.1016/j.schres.2012.08.010
- Strauss, G. P. , Thaler, N. S. , Matveeva, T. M. , Vogel, S. J. , Sutton, G. P. , Lee, B. G. , & Allen, D. N. (2015). Predicting psychosis across diagnostic boundaries: Behavioral and computational modeling evidence for impaired reinforcement learning in schizophrenia and bipolar disorder with a history of psychosis. Journal of Abnormal Psychology, 124, 697–708. https://doi.org/10.1037/abn0000039
- Strauss, G. P. , Waltz, J. A. , & Gold, J. M. (2014). A review of reward processing and motivational impairment in schizophrenia. Schizophrenia Bulletin, 40(Suppl. 2), S107–S116. https://doi.org/10.1093/schbul/sbt197
- Waltz, J. A. , & Gold, J. M. (2016). Motivational deficits in schizophrenia and the representation of expected value. Current Topics in Behavioral Neurosciences, 27, 375–410. https://doi.org/10.1007/7854_2015_385
- Warren, C. M. , Wilson, R. C. , van der Wee, N. J. , Giltay, E. J. , van Noorden, M. S. , Cohen, J. D. , & Nieuwenhuis, S. (2017). The effect of atomoxetine on random and directed exploration in humans. PLoS One, 12(4), e0176034. https://doi.org/10.1371/journal.pone.0176034
- Wechsler, D. (1999). Wechsler Abbreviated Scale of Intelligence (WASI). San Antonio, TX: Psychological Corporation. https://doi.org/10.1037/t15170-000
- Wechsler, D. (2001). Wechsler Test of Adult Reading (WTAR). San Antonio, TX: Psychological Corporation.
- Wilson, R. C. , Geana, A. , White, J. M. , Ludvig, E. A. , & Cohen, J. D. (2014). Humans use directed and random exploration to solve the explore–exploit dilemma. Journal of Experimental Psychology: General, 143, 2074–2081. https://doi.org/10.1037/a0038199
- Zajkowski, W. K. , Kossut, M. , & Wilson, R. C. (2017). A causal role for right frontopolar cortex in directed, but not random, exploration. Elife, 6. https://doi.org/10.7554/eLife.27430.016
DOI: https://doi.org/10.1162/CPSY_a_00027 | Journal eISSN: 2379-6227
Language: English
Submitted on: Aug 13, 2019
Accepted on: Apr 27, 2020
Published on: Aug 1, 2020
Published by: MIT Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year
© 2020 James A. Waltz, Robert C. Wilson, Matthew A. Albrecht, Michael J. Frank, James M. Gold, published by MIT Press
This work is licensed under the Creative Commons Attribution 4.0 License.