Have a personal or library account? Click to login
Improving the Reliability of the Pavlovian Go/No-Go Task for Computational Psychiatry Research Cover

Improving the Reliability of the Pavlovian Go/No-Go Task for Computational Psychiatry Research

Open Access
|Dec 2025

References

  1. 1Albrecht, M. A., Waltz, J. A., Cavanagh, J. F., Frank, M. J., & Gold, J. M. (2016). Reduction of Pavlovian bias in schizophrenia: Enhanced effects in clozapine-administered patients. PLoS One, 11, e0152781. 10.1371/journal.pone.0152781
  2. 2Algermissen, J., Swart, J. C., Scheeringa, R., Cools, R., & den Ouden, H. E. (2022). Striatal BOLD and midfrontal theta power express motivation for action. Cerebral Cortex, 32, 29242942. 10.1093/cercor/bhab391
  3. 3Ambekar, A., Ward, C., Mohammed, J., Male, S., & Skiena, S. (2009). Name-ethnicity classification from open sources in Proceedings of the 15th ACM SIGKDD international conference on Knowledge Discovery and Data Mining, 4958. 10.1145/1557019.1557032
  4. 4Anokhin, A. P, Luciana, M., Banich, M., Barch, D., Bjork, J. M., Gonzalez, M. R., Gonzalez, R., Haist, F., Jacobus, J., Lisdahl, K., McGlade, E., McCandliss, B., Nagel, B., Nixon, S. J., Tapert, S., Kennedy, J. T., & Thompson, W. (2022). Age-related changes and longitudinal stability of individual differences in ABCD Neurocognition measures. Developmental Cognitive Neuroscience, 54, 101078. 10.1016/j.dcn.2022.101078
  5. 5Arnon, I. (2020). Do current statistical learning tasks capture stable individual differences in children? An investigation of task reliability across modality. Behavior Research Methods, 52, 6881. 10.3758/s13428-019-01205-5
  6. 6Ballard, I. C., & McClure, S. M. (2019). Joint modeling of reaction times and choice improves parameter identifiability in reinforcement learning models. Journal of Neuroscience Methods, 317, 3744. 10.1016/j.jneumeth.2019.01.006
  7. 7Bertolero, M. A., Dworkin, J. D., David, S. U., Lloreda, C. L., Srivastava, P., Stiso, J., Zhou, D., Dzirasa, K., Fair, D. A., Kaczkurkin, A. N., Marlin, B. J., Shohamy, D., Uddin, L. Q., Zurn, P., & Bassett, D. S. (2020). Racial and ethnic imbalance in neuroscience reference lists and intersections with gender. BioRxiv. 10.1101/2020.10.12.336230
  8. 8Betella, A., & Verschure, P. F. (2016). The affective slider: A digital self-assessment scale for the measurement of human emotions. PloS One, 11, e0148037. 10.1371/journal.pone.0148037
  9. 9Betts, M. J., Richter, A., de Boer, L., Tegelbeckers, J., Perosa, V., Baumann, V., Chowdhury, R., Dolan, R. J., Seidenbecher, C., Schott, B. H., Düzel, E., Guitart-Masip, M., & Krauel, K. (2020). Learning in anticipation of reward and punishment: Perspectives across the human lifespan. Neurobiology of Aging, 96, 4957. 10.1016/j.neurobiolaging.2020.08.011
  10. 10Brown, V. M., Chen, J., Gillan, C. M., & Price, R. B. (2020). Improving the reliability of computational analyses: Model-based planning and its relationship with compulsivity. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 5, 601609. 10.1016/j.bpsc.2019.12.019
  11. 11Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017). Stan: A probabilistic programming language. Journal of Statistical Software, 76, 132. 10.18637/jss.v076.i01
  12. 12Carver, C. S., & White, T. L. (1994). Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/BAS scales. Journal of Personality and Social Psychology, 67, 319. 10.1037/0022-3514.67.2.319
  13. 13Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284. 10.1037/1040-3590.6.4.284
  14. 14Cooper, S. R., Gonthier, C., Barch, D. M., & Braver, T. S. (2017). The role of psychometrics in individual differences research in cognition: A case study of the AX-CPT. Frontiers in Psychology, 8, 1482. 10.3389/fpsyg.2017.01482
  15. 15De Berker, A. O., Tirole, M., Rutledge, R. B., Cross, G. F., Dolan, R. J., & Bestmann, S. (2016). Acute stress selectively impairs learning to act. Scientific Reports, 6, 112. 10.1038/srep29816
  16. 16De Leeuw, J. R. (2015). jsPsych: A JavaScript library for creating behavioral experiments in a Web browser. Behavior Research Methods, 47, 112. 10.3758/s13428-014-0458-y
  17. 17Dworkin, J. D., Linn, K. A., Teich, E. G., Zurn, P., Shinohara, R. T., & Bassett, D. S. (2020). The extent and drivers of gender imbalance in neuroscience reference lists. Nature Neuroscience, 23, 918926. 10.1038/s41593-020-0658-y
  18. 18Eisinger, R. S., Scott, B. M., Le, A., Ponce, E. M. T., Lanese, J., Hundley, C., Nelson, B., Ravy, T., Lopes, J., Thompson, S., Sathish, S., O’Connell, R. L., Okun, M. S., Bowers, D., & Gunduz, A. (2020). Pavlovian bias in Parkinson’s disease: An objective marker of impulsivity that modulates with deep brain stimulation. Scientific Reports, 10, 13448. 10.1038/s41598-020-69760-y
  19. 19Elliot, A. J., & Maier, M. A. (2012). Color-in-context theory. In Advances in Experimental Social Psychology (pp. 61125). Elsevier. 10.1016/B978-0-12-394286-9.00002-0
  20. 20Geurts, D. E., den Ouden, H. E., Janssen, L., Swart, J. C., Froböse, M. I., Cools, R., & Speckens, A. E. (2022). Aversive Pavlovian inhibition in adult attention-deficit/hyperactivity disorder and its restoration by mindfulness-based cognitive therapy. Frontiers in Behavioral Neuroscience, 289. 10.3389/fnbeh.2022.938082
  21. 21Guitart-Masip, M., Duzel, E., Dolan, R., & Dayan, P. (2014). Action versus valence in decision making. Trends in Cognitive Sciences, 18, 194202. 10.1016/j.tics.2014.01.003
  22. 22Guitart-Masip, M., Huys, Q. J., Fuentemilla, L., Dayan, P., Duzel, E., & Dolan, R. J. (2012). Go and no-go learning in reward and punishment: Interactions between affect and effect. Neuroimage, 62, 154166. 10.1016/j.neuroimage.2012.04.024
  23. 23Haines, N., Sullivan-Toole, H., & Olino, T. (2023). From classical methods to generative models: Tackling the unreliability of neuroscientific measures in mental health research. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging. 10.31234/osf.io/ax34v
  24. 24Hausknecht, J. P., Halpert, J. A., Di Paolo, N. T., & Moriarty Gerrard, M. O. (2007). Retesting in selection: A meta-analysis of coaching and practice effects for tests of cognitive ability. Journal of Applied Psychology, 92, 373. 10.1037/0021-9010.92.2.373
  25. 25Henry, J. D., & Crawford, J. R. (2005). The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 44, 227239. 10.1348/014466505X29657
  26. 26Huys, Q. J., Gölzer, M., Friedel, E., Heinz, A., Cools, R., Dayan, P., & Dolan, R. J. (2016). The specificity of Pavlovian regulation is associated with recovery from depression. Psychological Medicine, 46, 10271035. 10.1017/S0033291715002597
  27. 27Kim, D. S., McCabe, C. J., Yamasaki, B. L., Louie, K. A., & King, K. M. (2018). Detecting random responders with infrequency scales using an error-balancing threshold. Behavior Research Methods, 50, 19601970. 10.3758/s13428-017-0964-9
  28. 28Kucina, T., Wells, L., Lewis, I., de Salas, K., Kohl, A., Palmer, M. A., Sauer, J. D., Matzke, D., Aidman, E., & Heathcote, A. (2023). Calibration of cognitive tests to address the reliability paradox for decision-conflict tasks. Nature Communications, 14, 2234. 10.1038/s41467-023-37777-2
  29. 29Litman, L., Robinson, J., & Abberbock, T. (2017). TurkPrime.com: A versatile crowdsourcing data acquisition platform for the behavioral sciences. Behavior Research Methods, 49, 433442. 10.3758/s13428-016-0727-z
  30. 30McLean, B. F., Mattiske, J. K., & Balzan, R. P. (2018). Towards a reliable repeated-measures beads task for assessing the jumping to conclusions bias. Psychiatry Research, 265, 200207. 10.1016/j.psychres.2018.04.043
  31. 31Mehta, R., & Zhu, R. (2009). Blue or red? Exploring the effect of color on cognitive task performances. Science, 323, 12261229. 10.1126/science.1169144
  32. 32Millner, A. J., den Ouden, H. E., Gershman, S. J., Glenn, C. R., Kearns, J. C., Bornstein, A. M., Marx, B. P., Keane, T. M., & Nock, M. K. (2019). Suicidal thoughts and behaviors are associated with an increased decision-making bias for active responses to escape aversive states. Journal of Abnormal Psychology, 128, 106. 10.1037/abn0000395
  33. 33Millner, A. J., Gershman, S. J., Nock, M. K., & den Ouden, H. E. (2018). Pavlovian control of escape and avoidance. Journal of Cognitive Neuroscience, 30, 13791390. 10.1162/jocn_a_01224
  34. 34Mkrtchian, A., Aylward, J., Dayan, P., Roiser, J. P., & Robinson, O. J. (2017). Modeling avoidance in mood and anxiety disorders using reinforcement learning. Biological Psychiatry, 82, 532539. 10.1016/j.biopsych.2017.01.017
  35. 35Mkrtchian, A., Roiser, J. P., & Robinson, O. J. (2017). Threat of shock and aversive inhibition: Induced anxiety modulates Pavlovian-instrumental interactions. Journal of Experimental Psychology: General, 146, 1694. 10.1037/xge0000363
  36. 36Moutoussis, M., Bullmore, E. T., Goodyer, I. M., Fonagy, P., Jones, P. B., Dolan, R. J., Dayan, P., & Neuroscience in Psychiatry Network Research Consortium. (2018). Change, stability, and instability in the Pavlovian guidance of behaviour from adolescence to young adulthood. PLoS Computational Biology, 14, e1006679. 10.1371/journal.pcbi.1006679
  37. 37Montagnese, M., Knolle, F., Haarsma, J., Griffin, J. D., Richards, A., Vertes, P. E., Kiddle, B., Fletcher, P. C., Jones, P. B., Owen, M. J., Fonagy, P., Bullmore, E. T., Dolan, R. J., NSPN Consortium, Moutoussis, M., Goodyer, I. M., & Murray, G. K. (2020). Reinforcement learning as an intermediate phenotype in psychosis? Deficits sensitive to illness stage but not associated with polygenic risk of schizophrenia in the general population. Schizophrenia Research, 222, 389396. 10.1016/j.schres.2020.04.022
  38. 38Ousdal, O. T., Huys, Q., Mildë, A. M., Craven, A. R., Ersland, L., Endestad, T., Melinder, A., Hugdahl, K., & Dolan, R. J. (2018). The impact of traumatic stress on Pavlovian biases. Psychological Medicine, 48, 327336. 10.1017/S003329171700174X
  39. 39Pagliaccio, D., Luking, K. R., Anokhin, A. P., Gotlib, I. H., Hayden, E. P., Olino, T. M., Peng, C.-Z., Hajcak, G., & Barch, D. M. (2016). Revising the BIS/BAS Scale to study development: Measurement invariance and normative effects of age and sex from childhood through adulthood. Psychological Assessment, 28, 429. 10.1037/pas0000186
  40. 40Peterburs, J., Albrecht, C., & Bellebaum, C. (2021). The impact of social anxiety on feedback-based go and nogo learning. Psychological Research, 115. 10.1007/s00426-021-01479-5
  41. 41Pike, A. C., Tan, K., Ansari, H. J., Wing, M., & Robinson, O. J. (2022). Test-retest reliability of affective bias tasks. PsyArXiv. 10.31234/osf.io/n2fkh
  42. 42Raab, H. A., & Hartley, C. A. (2020). Adolescents exhibit reduced Pavlovian biases on instrumental learning. Scientific Reports, 10, 111. 10.1038/s41598-020-72628-w
  43. 43Richter, A., Guitart-Masip, M., Barman, A., Libeau, C., Behnisch, G., Czerney, S., Schanze, D., Assmann, A., Klein, M., Düzel, E., Zenker, M., Seidenbecher, C. I., & Schott, B. H. (2014). Valenced action/inhibition learning in humans is modulated by a genetic variant linked to dopamine D2 receptor expression. Frontiers in Systems Neuroscience, 8, 140. 10.3389/fnsys.2014.00140
  44. 44Richter, A., de Boer, L., Guitart-Masip, M., Behnisch, G., Seidenbecher, C. I., & Schott, B. H. (2021). Motivational learning biases are differentially modulated by genetic determinants of striatal and prefrontal dopamine function. Journal of Neural Transmission, 128, 17051720. 10.1007/s00702-021-02382-4
  45. 45Robinson, J., Rosenzweig, C., Moss, A. J., & Litman, L. (2019). Tapped out or barely tapped? Recommendations for how to harness the vast and largely unused potential of the Mechanical Turk participant pool. PloS One, 14, e0226394. 10.1371/journal.pone.0226394
  46. 46Rouder, J. N., & Haaf, J. M. (2019). A psychometrics of individual differences in experimental tasks. Psychonomic Bulletin & Review, 26, 452467. 10.3758/s13423-018-1558-y
  47. 47Rubin, M. (2021). When to adjust alpha during multiple testing: A consideration of disjunction, conjunction, and individual testing. Synthese, 199, 1096911000. 10.1007/s11229-021-03276-4
  48. 48Saeedpour, S., Hossein, M. M., Deroy, O., & Bahrami, B. (2023). Interindividual differences in Pavlovian influence on learning are consistent. Royal Society Open Science, 10, 230447. 10.1098/rsos.230447
  49. 49Sailer, M., Hense, J. U., Mayr, S. K., & Mandl, H. (2017). How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction. Computers in Human Behavior, 69, 371380. 10.1016/j.chb.2016.12.033
  50. 50Scharfen, J., Peters, J. M., & Holling, H. (2018). Retest effects in cognitive ability tests: A meta-analysis. Intelligence, 67, 4466. 10.1016/j.intell.2018.01.003
  51. 51Scholz, V., Kandroodi, M. R., Algermissen, J., & den Ouden, H. (2020). Dissociable effects of mood-anxiety and compulsive symptom dimensions on motivational biases in decision-making. Biological Psychiatry, 87, S382S383. 10.1016/j.biopsych.2020.02.979
  52. 52Shahar, N., Hauser, T. U., Moutoussis, M., Moran, R., Keramati, M., Nspn Consortium, & Dolan, R. J. (2019). Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling. PLoS Computational Biology, 15, e1006803. 10.1371/journal.pcbi.1006803
  53. 53Sood, G., & Laohaprapanon, S. (2018). Predicting race and ethnicity from the sequence of characters in a name. arXiv preprint arXiv:1805.02109.
  54. 54Spitzer, R. L., Kroenke, K., Williams, J. B., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166, 10921097. 10.1001/archinte.166.10.1092
  55. 55Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009). Bayesian model selection for group studies. Neuroimage, 46, 10041017. 10.1016/j.neuroimage.2009.03.025
  56. 56Sullivan-Toole, H., Haines, N., Dale, K., & Olino, T. (2022). Enhancing the psychometric properties of the Iowa Gambling Task using full generative modeling. Faculty/Researcher Works. 10.5334/cpsy.89
  57. 57Swart, J. C., Froböse, M. I., Cook, J. L., Geurts, D. E., Frank, M. J., Cools, R., & Den Ouden, H. E. (2017). Catecholaminergic challenge uncovers distinct Pavlovian and instrumental mechanisms of motivated (in)action. Elife, 6, e22169. 10.7554/eLife.22169.034
  58. 58Vehtari, A. (2023). Cross-validation FAQ. Accessed February 2, 2023 from https://mc-stan.org/loo/articles/online-only/faq.html.
  59. 59Vehtari, A., Gelman, A., & Gabry, J. (2017). Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Statistics and Computing, 27, 14131432. 10.1007/s11222-016-9696-4
  60. 60Verdejo-Garcia, A., Tiego, J., Kakoschke, N., Moskovsky, N., Voigt, K., Anderson, A., Koutoulogenis, J., Lubman, D. I., & Bellgrove, M. A. (2021). A unified online test battery for cognitive impulsivity reveals relationships with real-world impulsive behaviours. Nature Human Behaviour, 5, 15621577. 10.1038/s41562-021-01127-3
  61. 61Vidal, C., Content, A., & Chetail, F. (2017). BACS: The Brussels Artificial Character Sets for studies in cognitive psychology and neuroscience. Behavior Research Methods, 49, 20932112. 10.3758/s13428-016-0844-8
  62. 62Waltmann, M., Schlagenhauf, F., & Deserno, L. (2022). Sufficient reliability of the behavioral and computational readouts of a probabilistic reversal learning task. Behavior Research Methods, 122. 10.3758/s13428-021-01739-7
  63. 63Weber, I., Zorowitz, S., Niv, Y., & Bennett, D. (2022). The effects of induced positive and negative affect on Pavlovian-instrumental interactions. Cognition and Emotion, 118. 10.1080/02699931.2022.2109600
  64. 64Winkler, A. M., Ridgway, G. R., Webster, M. A., Smith, S. M., & Nichols, T. E. (2014). Permutation inference for the general linear model. Neuroimage, 92, 381397. 10.1016/j.neuroimage.2014.01.060
  65. 65Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008). Striatal activity underlies novelty-based choice in humans. Neuron, 58, 967973. 10.1016/j.neuron.2008.04.027
  66. 66Wonderlich, J. A. (2020). Anger and Pavlovian Bias: Integrating laboratory task performance and ecological momentary assessment (PhD thesis, George Mason University).
  67. 67Xia, T., Song, L., Wang, T. T., Tan, L., & Mo, L. (2016). Exploring the effect of red and blue on cognitive task performances. Frontiers in Psychology, 7, 784. 10.3389/fpsyg.2016.00784
  68. 68Youngstrom, E. A., Murray, G., Johnson, S. L., & Findling, R. L. (2013). The 7 up 7 down inventory: A 14-item measure of manic and depressive tendencies carved from the General Behavior Inventory. Psychological Assessment, 25, 1377. 10.1037/a0033975
  69. 69Zorowitz, S., & Niv, Y. (2023). Improving the reliability of cognitive task measures: A narrative review. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging. 10.31234/osf.io/phzrb
  70. 70Zorowitz, S., Solis, J., Niv, Y., & Bennett, D. (2023). Inattentive responding can induce spurious associations between task behaviour and symptom measures. Nature Human Behaviour, 7, 16671681. 10.1038/s41562-023-01640-7
DOI: https://doi.org/10.5334/cpsy.127 | Journal eISSN: 2379-6227
Language: English
Submitted on: Sep 2, 2024
Accepted on: Nov 4, 2025
Published on: Dec 18, 2025
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2025 Samuel Zorowitz, Gili Karni, Natalie Paredes, Nathaniel Daw, Yael Niv, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.