References
- Allen, R. J., Baddeley, A. D., & Hitch, G. J. (2006). Is the binding of visual features in working memory resource-demanding? Journal of Experimental Psychology: General, 135(2), Article 2. 10.1037/0096-3445.135.2.298
- Allen, R. J., Havelka, J., Falcon, T., Evans, S., & Darling, S. (2015). Modality specificity and integration in working memory: Insights from visuospatial bootstrapping. Journal of Experimental Psychology: Learning, Memory, and Cognition, 41(3), 820–830. 10.1037/xlm0000058
- Allen, R. J., Hitch, G. J., & Baddeley, A. D. (2009). Cross-modal binding and working memory. Visual Cognition, 17(1–2), Article 1–2. 10.1080/13506280802281386
- Allen, R. J., Hitch, G. J., Mate, J., & Baddeley, A. D. (2012). Feature binding and attention in working memory: A resolution of previous contradictory findings. Quarterly Journal of Experimental Psychology, 65(12), 2369–2383. 10.1080/17470218.2012.687384
- Allen, R. J., Waterman, A. H., Yang, T., & Graham, A. J. (2023).
Working memory in action: Remembering and following instructions . In R. Logie, N. Cowan, S. Gathercole, R. Engle, & Z. Wen (Eds.), Memory in Science for Society (1st ed., pp. 241–272). Oxford University Press. 10.1093/oso/9780192849069.003.0010 - Alunni-Menichini, K., Guimond, S., Bermudez, P., Nolden, S., Lefebvre, C., & Jolicoeur, P. (2014). Saturation of auditory short-term memory causes a plateau in the sustained anterior negativity event-related potential. Brain Research, 1592, 55–64. 10.1016/j.brainres.2014.09.047
- Audacity Team. (2020). Audacity (version 2.4.2) [Computer Software].
https://www.audacityteam.org/ - Baddeley, A. D. (2000). The episodic buffer: A new component of working memory? Trends in Cognitive Sciences, 4, 417–423. 10.1016/S1364-6613(00)01538-2
- Baddeley, A. D., Allen, R., & Vargha-Khadem, F. (2010). Is the hippocampus necessary for visual and verbal binding in working memory? Neuropsychologia, 48(4), 1089–1095. 10.1016/j.neuropsychologia.2009.12.009
- Baddeley, A. D., Allen, R. J., & Hitch, G. J. (2011). Binding in visual working memory: The role of the episodic buffer. Neuropsychologia, 49(6), Article 6. 10.1016/j.neuropsychologia.2010.12.042
- Baddeley, A. D., & Hitch, G. (1974).
Working Memory . In G. H. Bower (Ed.), Psychology of Learning and Motivation (Vol. 8, pp. 47–89). Academic Press. 10.1016/S0079-7421(08)60452-1 - Baddeley, A. D., Thomson, N., & Buchanan, M. (1975). Word Length and the Structure of Short-Term Memory. Journal of Verbal Learning and Verbal Behavior, 14, 575–589. 10.1016/S0022-5371(75)80045-4
- Bae, G. Y., & Chen, K. W. (2024). EEG decoding reveals task-dependent recoding of sensory information in working memory. NeuroImage, 297, 120710. 10.1016/j.neuroimage.2024.120710
- Broadbent, D. E. (1956). Successive responses to simultaneous stimuli. Quarterly Journal of Experimental Psychology, 8(4), 145–152. 10.1080/17470215608416814
- Broadbent, H. J., White, H., Mareschal, D., & Kirkham, N. Z. (2018). Incidental learning in a multisensory environment across childhood. Developmental Science, 21(2),
e12554 . 10.1111/desc.12554 - Brown, G. D., Preece, T., & Hulme, C. (2000). Oscillator-based memory for serial order. Psychological review, 107(1), 127–181. 10.1037/0033-295x.107.1.127
- Brunyé, T. T., Taylor, H. A., & Rapp, D. N. (2008). Repetition and dual coding in procedural multimedia presentations. Applied Cognitive Psychology, 22(7), 877–895. 10.1002/acp.1396
- Calvert, G., Spence, C., & Stein, B. E. (2004). The handbook of multisensory processes. MIT press. 10.7551/mitpress/3422.001.0001
- Chung, Y. H., Brady, T. F., & Störmer, V. S. (2023). No Fixed Limit for Storing Simple Visual Features: Realistic Objects Provide an Efficient Scaffold for Holding Features in Mind. Psychological Science, 34(7), 784–793. 10.1177/09567976231171339
- Cinar, H., Atkinson, A. L., Waterman, A., & Allen, R. J. (2024). Prioritizing feature bindings across space and modality in working memory. PsyArxiv. 10.31234/osf.io/59fnw
- Cinar, H., Atkinson, A. L., Waterman, A. H., & Allen, R. J. (2025). Prioritizing feature bindings across space and modality in working memory. Memory & cognition. Advance online publication. 10.3758/s13421-025-01804-y
- Cinar, H., Waterman, A. H., Atkinson, A. L., & Allen, R. J. (
2023, September, 6–9 ). Exploring prioritisation effects across different forms of binding in working memory [Poster presentation]. The 23rd Conference of the European Society for Cognitive Psychology (ESCOP), Porto, Portugal. - Cohen, M. A., Horowitz, T. S., & Wolfe, J. M. (2009). Auditory recognition memory is inferior to visual recognition memory. Proceedings of the National Academy of Sciences, 106(14), 6008–6010. 10.1073/pnas.0811884106
- Conrad, R. (1964). Acoustic confusions in immediate memory. British journal of Psychology, 55(1), 75–84. 10.1111/j.2044-8295.1964.tb00899.x
- Cowan, N. (1998). Attention and memory: An integrated framework. Oxford University Press. 10.1093/acprof:oso/9780195119107.001.0001
- Crowder, R. G., & Morton, J. (1969). Precategorical acoustic storage (PAS). Perception & Psychophysics, 5(6), Article 6. 10.3758/BF03210660
- Darling, S., Allen, R. J., & Havelka, J. (2017). Visuospatial Bootstrapping: When Visuospatial and Verbal Memory Work Together. Current Directions in Psychological Science, 26(1), 3–9. 10.1177/0963721416665342
- Delogu, F., Raffone, A., & Belardinelli, M. O. (2009). Semantic encoding in working memory: Is there a (multi) modality effect? Memory, 17(6), 655–663. 10.1080/09658210902998054
- Doyle, M. C., & Snowden, R. J. (2001). Identification of visual stimuli is improved by accompanying auditory stimuli: The role of eye movements and sound location. Perception, 30(7), 795–810. 10.1068/p3126
- Farrell, S., & Lewandowsky, S. (2002). An endogenous distributed model of ordering in serial recall. Psychonomic bulletin & review, 9(1), 59–79. 10.3758/bf03196257
- Fawcett, J. M. (2013). The production effect benefits performance in between-subject designs: a meta-analysis. Acta psychologica, 142(1), 1–5. 10.1016/j.actpsy.2012.10.001
- Forsberg, A., Guitard, D., Greene, N. R., Naveh-Benjamin, M., & Cowan, N. (2025). Differential information transfer and loss between working memory and long-term memory across serial positions. Journal of experimental psychology. Learning, memory, and cognition, 51(8), 1191–1212. 10.1037/xlm0001437
- Fort, A., Delpuech, C., Pernier, J., & Giard, M. H. (2002). Early auditory-visual interactions in human cortex during nonredundant target identification. Cognitive brain research, 14(1), 20–30. 10.1016/s0926-6410(02)00058-7
- Fukuda, K., Awh, E., & Vogel, E. K. (2010). Discrete capacity limits in visual working memory. Current Opinion in Neurobiology, 20(2), Article 2. 10.1016/j.conb.2010.03.005
- Giard, M. H., & Peronnet, F. (1999). Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study. Journal of Cognitive Neuroscience, 11(5), Article 5. 10.1162/089892999563544
- Gionet, S., Guitard, D., & Saint-Aubin, J. (2022). The Production Effect Interacts With Serial Positions. Experimental psychology, 69(1), 12–22. 10.1027/1618-3169/a000540
- Glanzer, M. (1972).
Storage mechanisms in recall . In Psychology of learning and motivation (Vol. 5, pp. 129–193). Academic Press. 10.1016/S0079-7421(08)60441-7 - Goolkasian, P., & Foos, P. W. (2005). Bimodal format effects in working memory. The American Journal of Psychology, 61–78. 10.2307/30039043
- Guazzo, F., Allen, R. J., Baddeley, A. D., & Della Sala, S. (2020). Unimodal and crossmodal working memory binding is not differentially affected by age or Alzheimer’s disease. Neuropsychology, 34(4), 420–436. 10.1037/neu0000622
- Guitard, D., & Cowan, N. (2020). Do we use visual codes when information is not presented visually? Memory & Cognition, 48, 1522–1536. 10.3758/s13421-020-01054-0
- Hede, A. J. (1980). Dichotic and bisensory grouping effects. The Quarterly Journal of Experimental Psychology, 32(2), 295–306. 10.1080/14640748008401165
- Heikkilä, J., Alho, K., Hyvönen, H., & Tiippana, K. (2015). Audiovisual Semantic Congruency During Encoding Enhances Memory Performance. Experimental Psychology, 62(2), Article 2. 10.1027/1618-3169/a000279
- Heikkilä, J., Alho, K., & Tiippana, K. (2017). Semantically Congruent Visual Stimuli Can Improve Auditory Memory. Multisensory Research, 30(7–8), Article 7–8. 10.1163/22134808-00002584
- Henderson, M. M., Rademaker, R. L., & Serences, J. T. (2022). Flexible utilization of spatial- and motor-based codes for the storage of visuo-spatial information. eLife, 11,
e75688 . 10.7554/eLife.75688 - Hitch, G. J., Allen, R. J., & Baddeley, A. D. (2025). The multicomponent model of working memory fifty years on. Quarterly Journal of Experimental Psychology, 78(2), 222–239. 10.1177/17470218241290909
- JASP Team (2024a). JASP (Version 0.18.3)[Computer software].
- JASP Team (2024b). JASP (Version 0.19.3)[Computer software].
- Johnson, C. J., Paivio, A., & Clark, J. M. (1996). Cognitive Components of Picture Naming. Psychological Bulletin, 120, Article 120. 10.1037/0033-2909.120.1.113
- Jones, T., & Oberauer, K. (2013). Serial-position effects for items and relations in short-term memory. Memory, 21(3), 347–365. 10.1080/09658211.2012.726629
- Karlsen, P. J., Allen, R. J., Baddeley, A. D., & Hitch, G. J. (2010). Binding across space and time in visual working memory. Memory & Cognition, 38(3), Article 3. 10.3758/MC.38.3.292
- Kwak, Y., & Curtis, C. E. (2022). Unveiling the abstract format of mnemonic representations. Neuron, 110(11), 1822–1828.e5. 10.1016/j.neuron.2022.03.016
- Lee, D. Y., & Shin, D.-H. (2012). An empirical evaluation of multi-media based learning of a procedural task. Computers in Human Behavior, 28(3), 1072–1081. 10.1016/j.chb.2012.01.014
- Lehmann, S., & Murray, M. M. (2005). The role of multisensory memories in unisensory object discrimination. Cognitive Brain Research, 24(2), 326–334. 10.1016/j.cogbrainres.2005.02.005
- Lewandowski, L. J., & Kobus, D. A. (1993). The Effects of Redundancy in Bimodal Word Processing. Human Performance, 6(3), 229–239. 10.1207/s15327043hup0603_3
- Lewandowsky, S., & Murdock, B. B. (1989). Memory for Serial Order. Psychological Review, 96(1), 25–57. 10.1037/0033-295X.96.1.25
- Li, D., Cowan, N., & Saults, J. S. (2013). Estimating working memory capacity for lists of nonverbal sounds. Attention, Perception, & Psychophysics, 75(1), 145–160. 10.3758/s13414-012-0383-z
- Logie, R. H., Della Sala, S., Wynn, V., & Baddeley, A. D. (2000). Visual similarity effects in immediate verbal serial recall. The Quarterly Journal of Experimental Psychology: Section A, 53(3), 626–646. 10.1080/713755916
- Luck, S. J., & Vogel, E. K. (1997). The capacity of visual working memory for features and conjunctions. Nature, 390(6657), Article 6657. 10.1038/36846
- MacLeod, C. M., Gopie, N., Hourihan, K. L., Neary, K. R., & Ozubko, J. D. (2010). The production effect: delineation of a phenomenon. Journal of experimental psychology: Learning, memory, and cognition, 36(3), 671–685. 10.1037/a0018785
- MacLeod, C. M., Ozubko, J. D., Hourihan, K. L., & Major, J. C. (2022).
The production effect is consistent over material variations: support for the distinctiveness account . Memory (Hove, England), 30(8), 1000–1007. 10.1080/09658211.2022.2069270 - Martin, M. (1980). Attention to words in different modalities: Four-channel presentation with physical and semantic selection. Acta Psychologica, 44(2), 99–115. 10.1016/0001-6918(80)90061-X
- Mastroberardino, S., Santangelo, V., Botta, F., Marucci, F. S., & Olivetti Belardinelli, M. (2008). How the bimodal format of presentation affects working memory: An overview. Cognitive Processing, 9(1), Article 1. 10.1007/s10339-007-0195-6
- Matusz, P. J., Broadbent, H., Ferrari, J., Forrest, B., Merkley, R., & Scerif, G. (2015). Multi-modal distraction: Insights from children’s limited attention. Cognition, 136, 156–165. 10.1016/j.cognition.2014.11.031
- McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Rocks & Minerals, 264(23/30), 746–748. 10.1038/264746a0
- McMaster, J. M. V., Tomić, I., Schneegans, S., & Bays, P. M. (2022). Swap errors in visual working memory are fully explained by cue-feature variability. Cognitive psychology, 137, 101493. 10.1016/j.cogpsych.2022.101493
- Meredith, M. A., Nemitz, J., & Stein, B. (1987). Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. The Journal of Neuroscience, 7(10), 3215–3229. 10.1523/JNEUROSCI.07-10-03215.1987
- Meredith, M. A., & Stein, B. E. (1983). Interactions among converging sensory inputs in the superior colliculus. Science, 221(4608), 389–391. 10.1126/science.6867718
- Meredith, M. A., & Stein, B. E. (1986). Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Research, 365(2), 350–354. 10.1016/0006-8993(86)91648-3
- Miller, G. (1956). Human memory and the storage of information. IRE Transactions on Information Theory, 2(3), 129–137. 10.1109/TIT.1956.1056815
- Morey, C. C., & Cowan, N. (2005). When Do Visual and Verbal Memories Conflict? The Importance of Working-Memory Load and Retrieval. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31(4), 703–713. 10.1037/0278-7393.31.4.703
- Morrison, A. B., Conway, A. R., & Chein, J. M. (2014). Primacy and recency effects as indices of the focus of attention. Frontiers in human neuroscience, 8, 6. 10.3389/fnhum.2014.00006
- Murdock, B. B.,
Jr. (1962). The serial position effect of free recall. Journal of Experimental Psychology, 64(5), 482. 10.1037/h0045106 - Murray, M. M., Michel, C. M., Grave de Peralta, R., Ortigue, S., Brunet, D., Gonzalez Andino, S., & Schnider, A. (2004). Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging. NeuroImage, 21(1), 125–135. 10.1016/j.neuroimage.2003.09.035
- Murray, M. M., Molholm, S., Michel, C. M., Heslenfeld, D. J., Ritter, W., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2005). Grabbing Your Ear: Rapid Auditory–Somatosensory Multisensory Interactions in Low-level Sensory Cortices Are Not Constrained by Stimulus Alignment. Cerebral Cortex, 15(7), 963–974. 10.1093/cercor/bhh197
- Murray, M. M., & Wallace, M. T. (2011). The neural bases of multisensory processes. 10.1201/9781439812174
- Nairne, J. S. (1990). A feature model of immediate memory. Memory & Cognition, 18(3), Article 3. 10.3758/BF03213879
- Neath, I. (2000). Modeling the effects of irrelevant speech on memory. Psychonomic Bulletin & Review, 7(3), 403–423. 10.3758/BF03214356
- Nyberg, L., Habib, R., McIntosh, A. R., & Tulving, E. (2000). Reactivation of encoding-related brain activity during memory retrieval. Proceedings of the National Academy of Sciences, 97(20), Article 20. 10.1073/pnas.97.20.11120
- Oberauer, K. (2003). Understanding serial position curves in short-term recognition and recall. Journal of Memory and Language, 49(4), 469–483. 10.1016/S0749-596X(03)00080-9
- Overkott, C., Souza, A. S., & Morey, C. C. (2023). The developing impact of verbal labels on visual memories in children. Journal of experimental psychology: General, 152(3), 825–838. 10.1037/xge0001305
- Page, M. P., & Norris, D. (1998). The primacy model: a new model of immediate serial recall. Psychological review, 105(4), 761–781. 10.1037/0033-295X.105.4.761-781
- Pecher, D., & Zeelenberg, R. (2022). Does multisensory study benefit memory for pictures and sounds? Cognition, 226, 105181. 10.1016/j.cognition.2022.105181
- Penney, C. G. (1975). Modality effects in short-term verbal memory. Psychological Bulletin, 82(1), Article 1. 10.1037/h0076166
- Penney, C. G. (1989). Modality effects and the structure of short-term verbal memory. Memory & Cognition, 17(4), 398–422. 10.3758/BF03202613
- Pleisch, G., Karipidis, I. I., Brauchli, C., Röthlisberger, M., Hofstetter, C., Stämpfli, P., Walitza, S., & Brem, S. (2019). Emerging neural specialization of the ventral occipitotemporal cortex to characters through phonological association learning in preschool children. NeuroImage, 189, 813–831. 10.1016/j.neuroimage.2019.01.046
- R Core Team. (2023). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria.
https://www.R-project.org/ - RStudio Team. (2020). RStudio: Integrated Development for R. RStudio, PBC, Boston, MA.
http://www.rstudio.com/ - Saint-Aubin, J., Yearsley, J. M., Poirier, M., Cyr, V., & Guitard, D. (2021). A model of the production effect over the short-term: The cost of relative distinctiveness. Journal of Memory and Language, 118, 104219. 10.1016/j.jml.2021.104219
- Saito, S. (1997). When articulatory suppression does not suppress the activity of the phonological loop. British Journal of Psychology, 88(4), 565–578. 10.1111/j.2044-8295.1997.tb02658.x
- Schauberger, P., & Walker, A. (2022). openxlsx: Read, Write and Edit xlsx Files. https://ycphs.github.io/openxlsx/index.html,
https://github.com/ycphs/openxlsx - Schneegans, S., McMaster, J. M. V., & Bays, P. M. (2023). Role of time in binding features in visual working memory. Psychological Review, 130(1), 137–154. 10.1037/rev0000331
- Schnupp, J. W., Dawe, K. L., & Pollack, G. L. (2005). The detection of multisensory stimuli in an orthogonal sensory space. Experimental Brain Research, 162(2), 181–190. 10.1007/s00221-004-2136-2
- Schönbrodt, F. D., Wagenmakers, E. J., Zehetleitner, M., & Perugini, M. (2017). Sequential hypothesis testing with Bayes factors: Efficiently testing mean differences. Psychological methods, 22(2), 322–339. 10.1037/met0000061
- Stein, B. E. (2012). The new handbook of multisensory processing. Mit Press. 10.7551/mitpress/8466.001.0001
- Stein, B. E., & Stanford, T. R. (2008). Multisensory integration: Current issues from the perspective of the single neuron. Nature Reviews Neuroscience, 9(4), 255–266. 10.1038/nrn2331
- Talsma, D., & Woldorff, M. G. (2005). Selective Attention and Multisensory Integration: Multiple Phases of Effects on the Evoked Brain Activity. Journal of Cognitive Neuroscience, 17(7), Article 7. 10.1162/0898929054475172
- Thelen, A., Cappe, C., & Murray, M. M. (2012). Electrical neuroimaging of memory discrimination based on single-trial multisensory learning. NeuroImage, 62(3), 1478–1488. 10.1016/j.neuroimage.2012.05.027
- Thelen, A., Matusz, P. J., & Murray, M. M. (2014). Multisensory context portends object memory. Current Biology, 24(16), R734–R735. 10.1016/j.cub.2014.06.040
- Thelen, A., Talsma, D., & Murray, M. M. (2015). Single-trial multisensory memories affect later auditory and visual object discrimination. Cognition, 138, 148–160. 10.1016/j.cognition.2015.02.003
- Thompson, V. A., & Paivio, A. (1994). Memory for pictures and sounds: Independence of auditory and visual codes. Canadian Journal of Experimental Psychology/Revue Canadienne de Psychologie Expérimentale, 48(3), 380. 10.1037/1196-1961.48.3.380
- Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., & Theeuwes, J. (2008). Pip and pop: Nonspatial auditory signals improve spatial visual search. Journal of Experimental Psychology: Human Perception and Performance, 34(5), 1053–1065. 10.1037/0096-1523.34.5.1053
- Waugh, N. C., & Norman, D. A. (1965). Primary memory. Psychological Review, 72(2), 89–104. 10.1037/h0021797
- Whitridge, J. W., Clark, C. A., Hourihan, K. L., & Fawcett, J. M. (2025). Generation (not production) improves the fidelity of visual representations in picture naming. Psychonomic bulletin & review, 32(1), 482–491. 10.3758/s13423-024-02566-5
- Wickham, H. (2023). stringr: Simple, Consistent Wrappers for Common String Operations. R package version 1.5.1, https://github.com/tidyverse/stringr,
https://stringr.tidyverse.org - Wickham, H., & Bryan, J. (2023). readxl: Read Excel Files. https://readxl.tidyverse.org,
https://github.com/tidyverse/readxl - Wickham, H., François, R., Henry, L., & Müller, K. (2022). dplyr: A Grammar of Data Manipulation. https://dplyr.tidyverse.org,
https://github.com/tidyverse/dplyr - Xie, Y., Li, Y., Guan, M., Duan, H., Xu, X., & Fang, P. (2021). Audiovisual working memory and association with resting-state regional homogeneity. Behavioural Brain Research, 411, 113382. 10.1016/j.bbr.2021.113382
- Xie, Y., Li, Y. Y., Xie, B., Xu, Y. Y., & Peng, L. (2019). The neural basis of complex audiovisual objects maintenances in working memory. Neuropsychologia, 133, 107189. 10.1016/j.neuropsychologia.2019.107189
- Xie, Y., Xu, Y., Bian, C., & Li, M. (2017). Semantic congruent audiovisual integration during the encoding stage of working memory: An ERP and sLORETA study. Scientific Reports, 7(1), 5112. 10.1038/s41598-017-05471-1
- Yuan, Y., Gayet, S., Wisman, D. C., van der Stigchel, S., & van der Stoep, N. (2025). Decoding auditory working memory load from EEG alpha oscillations. bioRxiv, 2025-02. 10.1101/2025.02.14.638227