Skip to main content
Have a personal or library account? Click to login
Is a Picture Worth a Thousand Words? Effects of Foregrounded Multimodal and Narrative Features Cover

Is a Picture Worth a Thousand Words? Effects of Foregrounded Multimodal and Narrative Features

Open Access
|Aug 2023

Figures & Tables

Figure 1

Dynamics Between Images in Reading Multimodal Literature.

Table 1

Mean Age (SD), Age Range and Number of Participants (Females) per Condition.

CONDITIONREADING MATERIALMEAN AGE (SD)RANGENUMBER OF PARTICIPANTS (FEMALES)
Experimental (Multimodal)CI + TF28.9 (10.2)18–4817 (11)
TF + CI36.4 (13.3)18–6018 (12)
Control (Monomodal)CI+ TF29.5 (8.2)18–4417 (13)
TF + CI30.5 (9.2)18–5117 (12)

[i] Notes. CI = An excerpt from The Curious Incident of the Dog in the Night-Time; TF = An excerpt from Tulip Fever.

Figure 2

The Spectrum of Multimodal Printed Literature.

Table 2

Length of Excerpts.

VERSIONTHE CURIOUS INCIDENT (UNUSUAL MIND STYLE)TULIP FEVER (USUAL MIND STYLE)
Multimodal2770 words2573 words
Monomodal2723 words2573 words
Table 3

Experiment Design.

CONDITIONPROCEDURE
Experimental (Multimodal)Condition 1CIRM1TFRM2TM/Dem
Condition 2TFRM1CIRM2TM/Dem
Control (Monomodal)Condition 3CIRM1TFRM2TM/Dem
Condition 4TFRM1CIRM2TM/Dem

[i] Notes. CI = an excerpt from The Curious Incident of the Dog in the Night-Time;

TF = an excerpt from Tulip Fever;

RM1 = Reading measures after the first excerpt;

RM2 = Reading measures after the second excerpt;

TM = Trait measures (trait empathy, fiction exposure, familiarity with autism, familiarity with the reading materials);

Dem = Demographics (age, gender, education level).

Table 4

Mean (SD) Scores on Mental Imagery, Narrative Empathy, and TR Scale per Condition.

SUBSCALESTHE CURIOUS INCIDENTTULIP FEVER
MULTIMODAL VERSIONMONOMODAL VERSIONMULTIMODAL VERSIONMONOMODAL VERSION
SWAS_Mental_Imagery5.55 (1.17)5.39 (1.40)5.73 (1.09)5.25 (1.51)
LRQ_Narrative_Empathy4.07 (1.33)4.04 (1.43)4.07 (1.30)3.74 (1.30)
TR_Enactment_Imagery4.62 (1.08)4.69 (1.39)4.45 (1.24)4.37 (1.29)
TR_Sympathy5.75 (1.06)5.84 (0.87)4.59 (1.28)4.53 (1.24)
TR_Resonance4.14 (1.72)3.61 (1.64)3.66 (1.63)3.68 (1.68)
TR_Self_Other_Perception3.81 (1.38)3.75 (1.47)2.82 (1.31)2.69 (1.37)
Table 5

Mean (SD) Scores on Mental Imagery, Narrative Empathy and TR Scale per Condition in the Multimodal and the Monomodal Conditions.

MULTIMODAL CONDITION
UNUSUAL MIND STYLE (THE CURIOUS INCIDENT)USUAL MIND STYLE (TULIP FEVER)
TOTALFIRSTSECONDTOTALFIRSTSECOND
SWAS_Mental_Imagery5.55 (1.17)5.43 (1.41)5.67 (0.91)5.73 (1.09)5.98 (0.67)5.47 (1.38)
LRQ_Narrative_Empathy4.07 (1.33)4.27 (1.26)3.87 (1.41)4.07 (1.30)3.95 (1.37)4.19 (1.26)
TR_Enactment_Imagery4.62 (1.08)4.41 (1.05)4.82 (1.11)4.45 (1.24)4.48 (1.29)4.42 (1.23)
TR_Sympathy5.75 (1.06)5.84 (1.24)5.67 (0.89)4.59 (1.28)4.82 (1.08)4.34 (1.44)
TR_Resonance4.14 (1.72)4.10 (1.49)4.17 (1.96)3.66 (1.63)3.80 (1.81)3.51 (1.45)
TR_Self_Other_Perception3.81 (1.38)4.10 (1.41)3.54 (1.33)2.82 (1.31)2.55 (1.24)3.11 (1.36)
MONOMODAL CONDITION
UNUSUAL MIND STYLE (THE CURIOUS INCIDENT)USUAL MIND STYLE (TULIP FEVER)
TOTALFIRSTSECONDTOTALFIRSTSECOND
SWAS_Mental_Imagery5.39 (1.40)5.71(1.12)5.08 (1.60)5.25 (1.51)5.63 (1.20)4.88 (1.72)
LRQ_Narrative_Empathy4.04 (1.43)4.72 (1.04)3.36 (1.47)3.74 (1.30)3.71(1.11)3.78 (1.51)
TR_Enactment_Imagery4.69 (1.39)4.87 (1.43)4.50 (1.37)4.37 (1.29)4.61 (1.25)4.13 (1.31)
TR_Sympathy5.84 (0.87)6.00 (0.67)5.68 (1.03)4.53 (1.24)4.99 (1.26)4.07 (1.07)
TR_Resonance3.61 (1.64)3.95 (1.38)3.28 (1.85)3.68 (1.68)4.39 (1.63)2.98 (1.47)
TR_Self_Other_Perception3.75 (1.47)4.00 (1.06)3.50 (1.79)2.69 (1.37)2.85 (1.52)2.54 (1.23)

[i] Note. Scores with significant differences appear in bold.

Figure 3

Interaction Graph of Theme and Group for Sympathy.

Figure 4

Interaction Graph of Narrative Feature and Order for Mental Imagery Subscale.

Figure 5

Interaction Graph of Narrative Feature and Order for Enactment-Imagery Subscale.

Figure 6

Interaction Graph of Narrative Feature and Order for Empathy Subscale.

Figure 7

Interaction Graph of Narrative Feature and Order for Resonance Subscale.

DOI: https://doi.org/10.61645/ssol.178 | Journal eISSN: 2210-4380
Language: English
Page range: 1 - 16
Submitted on: Jul 19, 2023
Accepted on: Jul 19, 2023
Published on: Aug 18, 2023
Published by: International Society for the Empirical Study of Literature
In partnership with: Paradigm Publishing Services

© 2023 Yuan Tian, Olivia Fialho, Shisheng Liu, Michael Burke, published by International Society for the Empirical Study of Literature
This work is licensed under the Creative Commons Attribution 4.0 License.