Have a personal or library account? Click to login
Components of Behavioral Activation Therapy for Depression Engage Specific Reinforcement Learning Mechanisms in a Pilot Study Cover

Components of Behavioral Activation Therapy for Depression Engage Specific Reinforcement Learning Mechanisms in a Pilot Study

Computational Psychiatry
Volume 6 (2022): Issue 1
By: Quentin J. M. Huys,  Evan M. Russek,  George Abitante,  Thorsten Kahnt and  Jacqueline K. Gollan  
Open Access
|Oct 2022

References

  1. 1Arch, J. J., Wolitzky-Taylor, K. B., Eifert, G. H., & Craske, M. G. (2012). Longitudinal treatment mediation of traditional cognitive behavioral therapy and acceptance and commitment therapy for anxiety disorders. Behaviour research and therapy, 50, 469–478. DOI: 10.1016/j.brat.2012.04.007
    Back to article
  2. 2Bates, D., Alday, P., Kleinschmidt, D., José Bayoán Santiago Calderón, P., Likan Zhan, Noack, A., Arslan, A., Bouchet-Valat, M., Kelman, T., Baldassari, A., Ehinger, B., Karrasch, D., Saba, E., Quinn, J., Hatherly, M., Piibeleht, M., Mogensen, P. K., Babayan, S., & Gagnon, Y. L. (2021). Juliastats/mixedmodels.jl: v4.0.0.
    Back to article
  3. 3Beck, A. T. (1976). Cognitive therapy and the emotional disorders. New York, NY: International Universities Press.
    Back to article
  4. 4Beevers, C. G., Worthy, D. A., Gorlick, M. A., Nix, B., Chotibut, T., & Maddox., W. T. (2013). Influence of depression symptoms on history-independent reward and punishment processing. Psychiatry research, 207, 53–60. DOI: 10.1016/j.psychres.2012.09.054
    Back to article
  5. 5Berwian, I. M., Wenzel, J. G., Collins, A. G. E., Seifritz, E., Stephan, K. E., Walter, H., & Huys, Q. J. M. (2020). Computational mechanisms of effort and reward decisions in patients with depression and their association with relapse after antidepressant discontinuation. JAMA Psychiatry, 77(5), 513–522. DOI: 10.1001/jamapsychiatry.2019.4971
    Back to article
  6. 6Blanco, N. J., Otto, A. R., Maddox, W. T., Beevers, C. G., & Love, B. C. (2013). The influence of depression symptoms on exploratory decision-making. Cognition, 129, 563–568. DOI: 10.1016/j.cognition.2013.08.018
    Back to article
  7. 7Brown, V. M., Zhu, L., Solway, A., Wang, J. M., McCurry, K. L., King-Casas, B., & Chiu, P. H. (2021). Reinforcement learning disruptions in individuals with depression and sensitivity to symptom change following cognitive behavioral therapy. JAMA psychiatry. DOI: 10.1001/jamapsychiatry.2021.1844
    Back to article
  8. 8Chase, H. W., Michael, A., Bullmore, E. T., Sahakian, B. J., & Robbins, T. W. (2010). Paradoxical enhancement of choice reaction time performance in patients with major depression. J Psychopharmacol, 24(4), 471–479. DOI: 10.1177/0269881109104883
    Back to article
  9. 9Daw, N. D., & Dayan, P. (2014). The algorithmic anatomy of model-based evaluation. Philos Trans R Soc Lond B Biol Sci, 369(1655). DOI: 10.1098/rstb.2013.0478
    Back to article
  10. 10Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011). Model-based influences on humans’ choices and striatal prediction errors. Neuron, 69(6), 1204–1215. DOI: 10.1016/j.neuron.2011.02.027
    Back to article
  11. 11Daw, N. D., Niv, Y., & Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci, 8(12), 1704–1711. DOI: 10.1038/nn1560
    Back to article
  12. 12DeBattista, C., Kinrys, G., Hoffman, D., Goldstein, C., Zajecka, J., Kocsis, J., Teicher, M., Potkin, S., Preda, A., Multani, G., Brandt, L., Schiller, M., Iosifescu, D., & Fava, M. (2011). The use of referenced-eeg (reeg) in assisting medication selection for the treatment of depression. J Psychiatr Res, 45(1), 64–75. DOI: 10.1016/j.jpsychires.2010.05.009
    Back to article
  13. 13DeRubeis, R. J., Cohen, Z. D., Forand, N. R., Fournier, J. C., Gelfand, L. A., & Lorenzo-Luaces, L. (2014). The personalized advantage index: translating research on prediction into individualized treatment recommendations. a demonstration. PLoS One, 9(1), e83875. DOI: 10.1371/journal.pone.0083875
    Back to article
  14. 14Dichter, G. S., Felder, J. N., & Smoski, M. J. (2010). The effects of brief behavioral activation therapy for depression on cognitive control in affective contexts: An fmri investigation. J Affect Disord, 126(1–2), 236–244. DOI: 10.1016/j.jad.2010.03.022
    Back to article
  15. 15Dimidjian, S., Goodman, S. H., Sherwood, N. E., Simon, G. E., Ludman, E., Gallop, R., Welch, S. S., Boggs, J. M., Metcalf, C. A., Hubley, S., Powers, J. D., & Beck, A. (2017). A pragmatic randomized clinical trial of behavioral activation for depressed pregnant women. J Consult Clin Psychol, 85(1), 26–36. DOI: 10.1037/ccp0000151
    Back to article
  16. 16Dimidjian, S., Hollon, S. D., Dobson, K. S., Schmaling, K. B., Kohlenberg, R. J., Addis, M. E., Gallop, R., McGlinchey, J. B., Markley, D. K., Gollan, J. K., Atkins, D. C., Dunner, D. L., & Jacobson, N. S. (2006). Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the acute treatment of adults with major depression. J Consult Clin Psychol, 74(4), 658–670. DOI: 10.1037/0022-006X.74.4.658
    Back to article
  17. 17Eckstrand, K. L., Forbes, E. E., Bertocci, M. A., Chase, H. W., Greenberg, T., Lockovich, J., Stiffler, R., Aslam, H. A., Graur, S., Bebko, G., & Phillips, M. L. (2019). Anhedonia reduction and the association between left ventral striatal reward response and 6-month improvement in life satisfaction among young adults. JAMA Psychiatry, 76, 958–965. DOI: 10.1001/jamapsychiatry.2019.0864
    Back to article
  18. 18Eldar, E., Roth, C., Dayan, P., & Dolan, R. J. (2018). Decodability of reward learning signals predicts mood fluctuations. Current biology: CB, 28, 1433–1439.e7. DOI: 10.1016/j.cub.2018.03.038
    Back to article
  19. 19Eshel, N., Bukwich, M., Rao, V., Hemmelder, V., Tian, J., & Uchida, N. (2015). Arithmetic and local circuitry underlying dopamine prediction errors. Nature, 525(7568), 243–246. DOI: 10.1038/nature14855
    Back to article
  20. 20Geugies, H., Mocking, R. J. T., Figueroa, C. A., Groot, P. F. C., Marsman, J.-B. C., Servaas, M. N., Steele, J. D., Schene, A. H., & Ruhé, H. G. (2019). Impaired reward-related learning signals in remitted unmedicated patients with recurrent depression. Brain: a journal of neurology, 142, 2510–2522. DOI: 10.1093/brain/awz167
    Back to article
  21. 21Greenberg, T., Chase, H. W., Almeida, J. R., Stiffler, R., Zevallos, C. R., Aslam, H. A., Deckersbach, T., Weyandt, S., Cooper, C., Toups, M., Carmody, T., Kurian, B., Peltier, S., Adams, P., McInnis, M. G., Oquendo, M. A., McGrath, P. J., Fava, M., Weissman, M., Parsey, R., Trivedi, M. H., & Phillips, M. L. (2015). Moderation of the relationship between reward expectancy and prediction error-related ventral striatal reactivity by anhedonia in unmedicated major depressive disorder: Findings from the embarc study. American Journal of Psychiatry, 172, 881–891. DOI: 10.1176/appi.ajp.2015.14050594
    Back to article
  22. 22Greenberg, T., Fournier, J. C., Stiffler, R., Chase, H.W., Almeida, J. R., Aslam, H., Deckersbach, T., Cooper, C., Toups, M. S., Carmody, T., Kurian, B., Peltier, S., Adams, P., McInnis, M. G., Oquendo, M. A., Fava, M., Parsey, R., McGrath, P. J., Weissman, M., Trivedi, M., & Phillips, M. L. (2019). Reward related ventral striatal activity and differential response to sertraline versus placebo in depressed individuals. Molecular Psychiatry, 25(7), 1526–1536. DOI: 10.1038/s41380-019-0490-5
    Back to article
  23. 23Guitart-Masip, M., Huys, Q. J. M., Fuentemilla, L., Dayan, P., Duzel, E., & Dolan, R. J. (2012). Go and no-go learning in reward and punishment: interactions between affect and effect. Neuroimage, 62(1), 154–166. DOI: 10.1016/j.neuroimage.2012.04.024
    Back to article
  24. 24Herzallah, M. M., Moustafa, A. A., Natsheh, J. Y., Abdellatif, S. M., Taha, M. B., Tayem, Y. I., Sehwail, M. A., Amleh, I., Petrides, G., Myers, C. E., & Gluck, M. A. (2013). Learning from negative feedback in patients with major depressive disorder is attenuated by SSRI antidepressants. Frontiers in Integrative Neuroscience, 7. DOI: 10.3389/fnint.2013.00067
    Back to article
  25. 25Huys, Q. J. M., Dayan, P., & Daw (2015). Depression: A Decision-Theoretic Account. Ann. Rev. Neurosci., 38, 1–23. DOI: 10.1146/annurev-neuro-071714-033928
    Back to article
  26. 26Huys, Q. J. M., Maia, T. V., & Frank, M. J. (2016). Computational psychiatry as a bridge from neuroscience to clinical applications. Nat Neurosci, 19(3), 404–413. DOI: 10.1038/nn.4238
    Back to article
  27. 27Huys, Q. J. M., Pizzagalli, D. A., Bogdan, R., & Dayan, P. (2013). Mapping anhedonia onto reinforcement learning: A behavioural meta-analysis. Biol Mood Anx Dis, 3(1), 12. DOI: 10.1186/2045-5380-3-12
    Back to article
  28. 28Kalsi, N., Altavilla, D., Tambelli, R., Aceto, P., Trentini, C., Di Giorgio, C., & Lai, C. (2017). Neural correlates of outcome of the psychotherapy compared to antidepressant therapy in anxiety and depression disorders: A meta-analysis. Frontiers in psychology, 8, 927. DOI: 10.3389/fpsyg.2017.00927
    Back to article
  29. 29Kumar, P., Waiter, G., Ahearn, T., Milders, M., Reid, I., & Steele, J. D. (2008). Abnormal temporal difference reward-learning signals in major depression. Brain, 131(Pt 8), 2084–2093. DOI: 10.1093/brain/awn136
    Back to article
  30. 30Kunisato, Y., Okamoto, Y., Ueda, K., Onoda, K., Okada, G., Yoshimura, S., Suzuki, S.-i., Samejima, K., & Yamawaki, S. (2012). Effects of depression on reward-based decision making and variability of action in probabilistic learning. Journal of behavior therapy and experimental psychiatry, 43, 1088–1094. DOI: 10.1016/j.jbtep.2012.05.007
    Back to article
  31. 31Lau, B., & Glimcher, P. W. (2005). Dynamic response-by-response models of matching behavior in rhesus monkeys. J Exp Anal Behav, 84(3), 555–579. DOI: 10.1901/jeab.2005.110-04
    Back to article
  32. 32Lewinsohn, P., Youngren, M., & Grosscup, S. (1979). Reinforcement and depression. In Depue, R. A., editor, The psychobiology of depressive disorders, 291–316. New York: Academic Press.
    Back to article
  33. 33Liu, Y., Mattar, M. G., Behrens, T. E. J., Daw, N. D., & Dolan, R. J. (2021). Experience replay is associated with efficient nonlocal learning. Science (New York, N.Y.), 372. DOI: 10.1126/science.abf1357
    Back to article
  34. 34Longmore, R. J., & Worrell, M. (2007). Do we need to challenge thoughts in cognitive behavior therapy? Clinical psychology review, 27, 173–187. DOI: 10.1016/j.cpr.2006.08.001
    Back to article
  35. 35Martell, C. R., Dimidjian, S., & Herman-Dunn, R. (2010). Behavioral Activation for Depression. New York, USA: The Guilford Press.
    Back to article
  36. 36Mattar, M. G., & Daw, N. D. (2018). Prioritized memory access explains planning and hippocampal replay. Nature Neuroscience, 21, 1609–1617. DOI: 10.1038/s41593-018-0232-z
    Back to article
  37. 37McGrath, C. L., Kelley, M. E., Holtzheimer, P. E., Dunlop, B. W., Craighead, W. E., Franco, A. R., Craddock, R. C., & Mayberg, H. S. (2013). Toward a neuroimaging treatment selection biomarker for major depressive disorder. JAMA Psychiatry, 70(8), 821–829. DOI: 10.1001/jamapsychiatry.2013.143
    Back to article
  38. 38Meehl, P. E. (1975). Hedonic capacity: some conjectures. Bull Menninger Clin, 39(4), 295–307.
    Back to article
  39. 39Nagy, G. A., Cernasov, P., Pisoni, A., Walsh, E., Dichter, G. S., & Smoski, M. J. (2020). Reward network modulation as a mechanism of change in behavioral activation. Behav Mod, 44(2), 186–213. DOI: 10.1177/0145445518805682
    Back to article
  40. 40Paulus, M. P., Huys, Q. J. M., & Maia, T. V. (2016). A roadmap for the development of applied computational psychiatry. Biological psychiatry: CNNI, 1, 386–392. DOI: 10.1016/j.bpsc.2016.05.001
    Back to article
  41. 41Reiter, A. M., Atiya, N. A., Berwian, I. M., & Huys, Q. J. (2021). Neuro-cognitive processes as mediators of psychological treatment effects. Current Opinion in Behavioral Sciences, 38, 103–109. DOI: 10.1016/j.cobeha.2021.02.007
    Back to article
  42. 42Robinson, O. J., & Chase, H. W. (2017). Learning and choice in mood disorders: Searching for the computational parameters of anhedonia. Computational psychiatry (Cambridge, Mass.), 1, 208–233. DOI: 10.1162/CPSY_a_00009
    Back to article
  43. 43Rush, A. J., Carmody, T., & Reimitz, P.-E. (2000). The inventory of depressive symptomatology (ids): Clinician (ids-c) and self-report (ids-sr) ratings of depressive symptoms. International Journal of Methods in Psychiatric Research, 9(2), 45–59. DOI: 10.1002/mpr.79
    Back to article
  44. 44Rush, A. J., Trivedi, M. H., Wisniewski, S. R., Nierenberg, A. A., Stewart, J. W., Warden, D., Niederehe, G., Thase, M. E., Lavori, P. W., Lebowitz, B. D., McGrath, P. J., Rosenbaum, J. F., Sackeim, H. A., Kupfer, D. J., Luther, J., & Fava, M. (2006). Acute and longer-term outcomes in depressed outpatients requiring one or several treatment steps: a STAR*D report. Am J Psychiatry, 163(11), 1905–1917. DOI: 10.1176/ajp.2006.163.11.1905
    Back to article
  45. 45Russek, E. M., Momennejad, I., Botvinick, M. M., Gershman, S. J., & Daw, N. D. (2017). Predictive representations can link model-based reinforcement learning to model-free mechanisms. PLoS computational biology, 13, e1005768. DOI: 10.1371/journal.pcbi.1005768
    Back to article
  46. 46Rutledge, R. B., Moutoussis, M., Smittenaar, P., Zeidman, P., Taylor, T., Hrynkiewicz, L., Lam, J., Skandali, N., Siegel, J. Z., Ousdal, O. T., Prabhu, G., Dayan, P., Fonagy, P., & Dolan, R. J. (2017). Association of neural and emotional impacts of reward prediction errors with major depression. JAMA Psychiatry, 74, 790–797. DOI: 10.1001/jamapsychiatry.2017.1713
    Back to article
  47. 47Rutledge, R. B., Skandali, N., Dayan, P., & Dolan, R. J. (2015). Dopaminergic modulation of decision making and subjective well-being. Journal of Neuroscience, 35(27), 9811–9822. DOI: 10.1523/JNEUROSCI.0702-15.2015
    Back to article
  48. 48Schmaal, L., Marquand, A. F., Rhebergen, D., van Tol, M.-J., Ruhé, H. G., van der Wee, N. J. A., Veltman, D. J., & Penninx, B. W. J. H. (2015). Predicting the naturalistic course of major depressive disorder using clinical and multimodal neuroimaging information: A multivariate pattern recognition study. Biol Psychiatry, 78(4), 278–286. DOI: 10.1016/j.biopsych.2014.11.018
    Back to article
  49. 49Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275(5306), 1593–1599. DOI: 10.1126/science.275.5306.1593
    Back to article
  50. 50Schweizer, S., Cohen, Z. D., DeRubeis, R., Hayes, R., Watkins, E. R., Lewis, G., Byng, R., Byford, S., Crane, C., Kuyken, W., & Dalgleish, T. (2020). For whom does mindfulness-based cognitive therapy offer superior relapse prevention for recurrent depression than maintenance antidepressant medication: A precision medicine analysis. psyArxiv, 10.31234/osf.io/nxth5.
    Back to article
  51. 51Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., Weiller, E., Hergueta, T., Baker, R., & Dunbar, G. C. (1998). The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry, 59(Suppl 20), 22–33; quiz 34–57.
    Back to article
  52. 52Steele, J. D., Kumar, P., & Ebmeier, K. P. (2007). Blunted response to feedback information in depressive illness. Brain, 130(Pt 9), 2367–2374. DOI: 10.1093/brain/awm150
    Back to article
  53. 53Vrieze, E., Demyttenaere, K., Bruffaerts, R., Hermans, D., Pizzagalli, D. A., Sienaert, P., Hompes, T., de Boer, P., Schmidt, M., & Claes, S. (2014). Dimensions in major depressive disorder and their relevance for treatment outcome. Journal of affective disorders, 155, 35–41. DOI: 10.1016/j.jad.2013.10.020
    Back to article
  54. 54Vrieze, E., Pizzagalli, D. A., Demyttenaere, K., Hompes, T., Sienaert, P., de Boer, P., Schmidt, M., & Claes, S. (2013). Reduced reward learning predicts outcome in major depressive disorder. Biological psychiatry, 73, 639–645. DOI: 10.1016/j.biopsych.2012.10.014
    Back to article
  55. 55Webb, C. A., Trivedi, M. H., Cohen, Z. D., Dillon, D. G., Fournier, J. C., Goer, F., Fava, M., McGrath, P. J., Weissman, M., Parsey, R., Adams, P., Trombello, J. M., Cooper, C., Deldin, P., Oquendo, M. A., McInnis, M. G., Huys, Q., Bruder, G., Kurian, B. T., Jha, M., DeRubeis, R. J., & Pizzagalli, D. A. (2019). Personalized prediction of antidepressant v. placebo response: evidence from the embarc study. Psychol Med, 49, 1118–1127. DOI: 10.1017/S0033291718001708
    Back to article
  56. 56Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., Burstein, R., Murray, C. J. L., & Vos, T. (2013). Global burden of disease attributable to mental and substance use disorders: findings from the global burden of disease study 2010. Lancet, 382(9904), 1575–1586. DOI: 10.1016/S0140-6736(13)61611-6
    Back to article
DOI: https://doi.org/10.5334/cpsy.81 | Journal eISSN: 2379-6227
Journal RSS Feed
Language: English
Submitted on: Sep 10, 2021
Accepted on: Sep 28, 2022
Published on: Oct 13, 2022
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year
Keywords:
decision-making,
learning,
Pavlovian reflexes,
instrumental learning,
Orthogonalized Go/No learning,
Behavioral Activation treatment,
reward learning

© 2022 Quentin J. M. Huys, Evan M. Russek, George Abitante, Thorsten Kahnt, Jacqueline K. Gollan, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.

Previous articleVolume 6 (2022): Issue 1Next article