Have a personal or library account? Click to login
Towards Understanding the Task Dependency of Embodied Language Processing: The Influence of Colour During Language-Vision Interactions Cover

Towards Understanding the Task Dependency of Embodied Language Processing: The Influence of Colour During Language-Vision Interactions

Open Access
|Oct 2020

Figures & Tables

joc-3-1-135-g1.png
Figure 1

(Translated) visual context example for an experimental trial in Experiment 1.

Table 1

List of linguistic materials used in all three experiments.

Target wordColour associationCompetitor word
grasshoppergreenbroccoli
froggreenspinach
lettucegreenemerald
celerygreenturtle
treegreenlizard
leafgreencrocodile
cherryredlipstick
tomatoredbrick
strawberryredfox
lobsterredraspberry
lipsredrose
bananayellowcanary
lemonyellowdandelion
cornyellowchick
joc-3-1-135-g2.png
Figure 2

Upper panels: Mean fixation proportion as a function of trial type, aggregated in time steps of 50 ms. The plots are time-locked to the onset of the critical word. Blue and red lines represent looks to the target and the average distract, respectively and the shaded areas represent within-subject adjusted 95% confidence levels, calculated by participant. Lower panels: GCA model fit (lines) of empirical logit (points) to the target and the average distractors as a function of trial type and experimental condition.

Table 2

Main and interaction effect in the quasi-logistic GCA mixed model analysis in Experiment 1.

Estimateset
(Intercept)–6,360,29–21,61*
Linear0,340,420,81  
Quadratic–0,220,23–0,96  
Object–1,160,03–39,21*
Type0,550,0316,62*
Object * Type–1,110,03–37,59*
Linear * Object–1,490,34–4,40*
Linear * Type0,660,292,30*
Quadratic * Object0,400,192,07*
Quadratic * Type–0,030,16–0,21  
Linear * Object * Type–1,990,13–14,82*
Quadratic * Object * Type0,410,133,24*
joc-3-1-135-g3.png
Figure 3

Visual display example for experimental trials as a function of experimental condition in Experiment 2.

joc-3-1-135-g4.png
Figure 4

Upper panels: Mean fixation proportion as a function of trial type, aggregated in time steps of 50 ms. The plots are time-locked to the onset of the critical word. Blue and red lines represent looks to the target and the average distractors, respectively and the shaded areas represent within-subject adjusted 95% confidence levels, calculated by participants. Lower panels: GCA model fit (lines) of empirical logits (points) to the target and the average distractors as a function of trial type and experimental condition.

Table 3

Main and interaction effect in the quasi-logistic GCA mixed model analysis in Experiment 2.

Estimateset
(Intercept)–5,000,22–22,57*
Linear1,400,473,01*
Quadratic–0,090,18–0,51  
Cubic–0,200,13–1,49  
Object–1,620,03–53,21*
Type0,530,0315,42*
Colour–0,010,03–0,23  
Object * Type–1,340,03–44,20*
Object * Colour–0,170,03–5,59*
Type * Colour–0,050,03–1,78  
Linear * Object–3,530,31–11,56*
Linear * Type0,780,282,83*
Linear * Colour0,320,281,11  
Quadratic * Object0,370,142,64*
Quadratic * Type–0,160,14–1,10  
Quadratic * Colour0,000,17–0,01  
Cubic * Object0,420,133,39*
Cubic * Type0,000,130,02  
Cubic * Colour–0,170,13–1,26  
Object * Type * Colour0,160,035,28*
Linear * Object * Type–2,100,13–16,72*
Linear * Object * Colour–0,870,13–6,92*
Linear * Type * Colour–0,400,14–2,90*
Quadratic * Object * Type0,470,133,74*
Quadratic * Object * Colour–0,060,13–0,46  
Quadratic * Type * Colour0,020,130,13  
Cubic * Object * Type0,080,130,63  
Cubic * Object * Colour0,410,133,27*
Cubic * Type * Colour0,170,131,30  
Linear * Object * Type * Colour0,660,135,27*
Quadratic * Object * Type * Colour0,320,132,51*
Cubic * Object * Type * Colour–0,190,13–1,52  
joc-3-1-135-g5.png
Figure 5

Upper panels: Mean fixation proportion as a function of trial type, aggregated in time steps of 50 ms. The plots are time-locked to the onset of the critical word. Blue and red lines represent looks to the target and the average distractor, respectively and the shaded areas represent within-subject adjusted 95% confidence levels, calculated by participants. Lower panels: GCA model fit (lines) of empirical logit (points) to the target and the average distractors as a function of trial type and experimental condition.

Table 4

Main and interaction effects in the quasi-logistic GCA mixed model analysis in Experiment 3.

Estimateset
(Intercept)–8,520,11–80,03*
Linear0,300,261,16  
Quadratic0,150,111,37  
Object–0,590,01–42,34*
Type0,180,0211,29*
Colour0,050,013,39*
Object * Type–0,170,01–12,17*
Object * Colour0,030,012,41*
Type * Colour0,000,01–0,09  
Linear * Object–0,390,18–2,12*
Linear * Type0,330,152,24*
Linear * Colour–0,050,14–0,36  
Quadratic * Object–0,190,09–2,11*
Quadratic * Type0,140,072,10*
Quadratic * Colour0,000,08–0,03  
Object * Type * Colour–0,040,01–2,99*
Linear * Object * Type–0,560,06–8,67*
Linear * Object * Colour–0,010,06–0,19  
Linear * Type * Colour0,110,061,78  
Quadratic * Object * Type–0,170,06–2,75*
Quadratic * Object * Colour0,010,060,11  
Quadratic * Type * Colour–0,060,06–1,03  
Linear * Object * Type * Colour–0,110,06–1,95  
Quadratic * Object * Type * Colour0,080,061,45  
DOI: https://doi.org/10.5334/joc.135 | Journal eISSN: 2514-4820
Language: English
Submitted on: Mar 5, 2020
|
Accepted on: Oct 8, 2020
|
Published on: Oct 22, 2020
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2020 Falk Huettig, Ernesto Guerra, Andrea Helo, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.