Is a Picture Worth a Thousand Words? Effects of Foregrounded Multimodal and Narrative Features
By: Yuan Tian, Olivia Fialho, Shisheng Liu and Michael Burke
References
- Baron-Cohen, S., & Wheelwright, S. (2004). The empathy quotient: An investigation of adults with Asperger Syndrome or High Functioning Autism, and normal sex differences. Journal of Autism and Developmental Disorders, 34(2), 163–175. DOI: 10.1023/B:JADD.0000022607.19833.00
- Barthes, R. (1977). Image-music-text (S. Heath, Trans.). Hill and Wang.
- Bateman, J. (2014). Text and image: A critical introduction to the visual/verbal divide. Routledge. DOI: 10.4324/9781315773971
- Bateman, J., Wildfeuer, J., & Hiippala, T. (2017). Multimodality: Foundations, research and analysis – a problem-oriented introduction. De Gruyter. DOI: 10.1515/9783110479898
- Bortolussi, M., Dixon, P., & Sopčák, P. (2010). Gender and reading. Poetics, 38(3), 299–318. DOI: 10.1016/j.poetic.2010.03.004
- Burke, M. (2010). Literary reading, cognition and emotion: An exploration of the oceanic mind. Routledge. DOI: 10.4324/9780203840306
- Caracciolo, M. (2014). Two child narrators: Defamiliarization, empathy, and reader-response in Mark Haddon’s The Curious Incident and Emma Donoghue’s Room. Semiotica, 2014(202), 183–205. DOI: 10.1515/sem-2014-0050
- Carroll, L. (1962). Alice’s adventures in the wonderland and through the looking-glass. Collier Books.
- Cohen, J. (2001). Defining identification: A theoretical look at the identification of audiences with media characters. Mass Communication and Society, 4(3), 245–264. DOI: 10.1207/S15327825MCS0403_01
- Crowne, D. P., & Marlowe, D. A. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24(4), 349–354. DOI: 10.1037/h0047358
- Davis, M. (1980). A multidimensional approach to individual differences in empathy. JSAS Catalog of Selected Documents in Psychology, 10, 85.
- Dillenburger, K., Jordan, J. A., KcKerr, L., Devine, P., & Keenan, M. (2013). Awareness and knowledge of autism and autism interventions: A general population survey. Research in Autism Spectrum Disorders, 7(12), 1558–1567. DOI: 10.1016/j.rasd.2013.09.004
- Dixon, P., Bortolussi, M., Twilley, L. C., & Leung, A. (1993). Literary processing and interpretation: Towards empirical foundations. Poetics, 22(1–2), 5–33. DOI: 10.1016/0304-422X(93)90018-C
- Fialho, O. (2018). Deepening readers’ perceptions of self and others: The role of enactment-imagery, resonance, and sympathy. [Conference presentation]. IGEL Conference, Stavanger, Norway.
- Fialho, O. (2019). What is literature for? The role of transformative reading. Cogent Arts & Humanities, 6(1), 1692532. DOI: 10.1080/23311983.2019.1692532
- Fialho, O. (in press). Transformative Reading. Amsterdam: John Benjamins Publishing Company.
- Fialho, O., & Hoeken, H. (in preparation). Transformative reading: An empirical model.
- Gibbons, A. (2008). Multimodal literature ‘moves’ us: Dynamic movement and embodiment in VAS: An Opera in Flatland. Journal of Language and Communication Studies, 21(41), 107–124. DOI: 10.7146/hjlcb.v21i41.96816
- Gibbons, A. (2010).
The narrative worlds and multimodal figures of House of Leaves: ‘—find your own words; I have no more’ . In M. Grishakova & M. Ryan (Eds.), Intermediality and storytelling (pp. 285–311). De Gruyter. DOI: 10.1515/9783110237740.285 - Gibbons, A. (2012). Multimodality, cognition, and experimental literature. Routledge. DOI: 10.4324/9780203803219
- Green, M. C., & Jenkins, K. M. (2014). Interactive narratives: Processes and outcomes in user-directed stories. Journal of Communication, 64(3), 479–500. DOI: 10.1111/jcom.12093
- Gregoriou, C. (2011).
The linguistic levels of foregrounding in stylistics . In M. Burke (Ed.), The Routledge handbook of stylistics (pp. 87–100). Routledge. - Haddon, M. (2003). The curious incident of the dog in the night-time (audible, J. Woodman, Narrates). Recorded Books.
- Haddon, M. (2004). The curious incident of the dog in the night-time. Vintage Contemporaries.
- Iser, W. (1974). The implied reader: Patterns of communication in prose fiction from Bunyan to Beckett. Columbia University Press.
- Jewitt, C., Bezemer, J., & O’Halloran, K. (2016). Introducing multimodality. Routledge. DOI: 10.4324/9781315638027
- Keen, S. (2007). Empathy and the novel. Oxford University Press. DOI: 10.1093/acprof:oso/9780195175769.001.0001
- Keysers, C. (2011). The empathic brain: How the discovery of mirror neurons changes our understanding of human nature. Van Haren Publishing.
- Kuijpers, M. M., & Hakemulder, F. (2018). Understanding and appreciating literary texts through rereading. Discourse Processes, 55(7), 619–641. DOI: 10.1080/0163853X.2017.1390352
- Kuijpers, M. M., Hakemulder, F., Tan, E. S., & Doicaru, M. M. (2014). Exploring absorbing reading experiences: Developing and validating a self-report scale to measure story world absorption. Scientific Study of Literature, 4(1), 89–122. DOI: 10.1075/ssol.4.1.05kui
- Kuzmičová, A. (2014). Literary narrative and mental imagery: A view from embodied cognition. Style, 48(3), 275–293. DOI: 10.5325/style.48.3.0275
- Leech, N., Barrett, K. C., & Morgan, G. A. (2015). IBM SPSS for intermediate statistics. Routledge. DOI: 10.4324/9780203122778
- Lemke, J. (1998).
Metamedia literacy: Transforming meanings and media . In D. Reinking, M. C. McKenna, L. D. Labbo & R. D. Kieffer (Eds.), Handbook of literacy and technology: Transformation in a post-typographic world (pp. 283–302). Lawrence Erlbaum Associates. - Mak, M., de Vries, C., & Willems, R. M. (2020). The influence of mental imagery instructions and personality characteristics on reading experiences. Collabra: Psychology, 6(1), 43. DOI: 10.1525/collabra.281
- Margolin, U. (2003).
Cognitive science, the thinking mind, and literary narrative . In D. Herman (Ed.), Narrative theory and the cognitive sciences (pp. 271–294). Center for the Study of Language and Information. - Masterson, J., & Hayes, M. (2007). Development and data for UK versions of an author and title recognition test for adults. Journal of Research in Reading, 30(2), 212–219. DOI: 10.1111/j.1467-9817.2006.00320.x
- Miall, D., & Kuiken, D. (1995). Aspects of literary response: A new questionnaire. Research in the Teaching of English, 29(1), 37–58.
https://www.jstor.org/stable/40171422 - Moggach, D. (1999). Tulip fever. Vintage.
- Moggach, D. (2005). Tulip fever. The Dial Press.
- Nørgaard, N. (2019). Multimodal stylistics of the novel: More than words. Routledge. DOI: 10.4324/9781315145556
- Petit, L. (2004). Text and image in the fiction of Anita Brookner and A.S. Byatt [Unpublished doctoral dissertation]. University of Colorado.
- Sadoski, M. & Paivio, A. (2001). Imagery and text: A dual coding theory of reading and writing. Lawrence Erlbaum Associates Publishers.
- Semino, E. (2014). Language, mind and autism in Mark Haddon’s The Curious Incident of the Dog in the Night-Time. Linguistics and Literary Studies, 31, 279–303. DOI: 10.1515/9783110347500.279
- Shklovsky, V. (1965).
Art as technique . In L. T. Lemon & M. J. Reis (Eds. & Trans.), Russian formalist criticism: Four essays (pp. 1–7). University of Nebraska Press. - Simpson, P. (2004). Stylistics: A resource book for students. Routledge. DOI: 10.4324/9780203496589
- Sklar, H. (2013). The art of sympathy in fiction: Forms of ethical and emotional persuasion. John Benjamins Publishing Company. DOI: 10.1075/lal.15
- Sorlin, S. (2020).
Introduction: Manipulation in fiction . In S. Sorlin (Ed.), Stylistic manipulation of the reader in contemporary fiction (pp. 1–27). Bloomsbury Academic. DOI: 10.5040/9781350062993.0005 - Stockwell, P. (2002). Texture: A cognitive aesthetics of reading. Edinburgh University Press.
- Tian, Y. (2022). Multimodality and its effects on literary imagery and emotional engagements. Central China Normal University Press.
- Van Peer, W., Sopcák, P., Castiglione, D., Fialho, O., Jacobs, A., & Hakemulder, F. (2021).
Foregrounding . In D. Kuiken & A. M. Jacobs (Eds.), Handbook of Empirical Literary Studies (pp. 145–176). (De Gruyter Reference). De Gruyter.https://www.degruyter.com/document/doi/10.1515/9783110645958/html . DOI: 10.1515/9783110645958-007
DOI: https://doi.org/10.61645/ssol.178 | Journal eISSN: 2210-4380
Language: English
Page range: 1 - 16
Submitted on: Jul 19, 2023
Accepted on: Jul 19, 2023
Published on: Aug 18, 2023
Published by: International Society for the Empirical Study of Literature
In partnership with: Paradigm Publishing Services
Keywords:
© 2023 Yuan Tian, Olivia Fialho, Shisheng Liu, Michael Burke, published by International Society for the Empirical Study of Literature
This work is licensed under the Creative Commons Attribution 4.0 License.