Have a personal or library account? Click to login
Are Faster Participants Always Faster? Assessing Reliability of Participants’ Mean Response Speed in Picture Naming Cover

Are Faster Participants Always Faster? Assessing Reliability of Participants’ Mean Response Speed in Picture Naming

Open Access
|Jan 2024

Figures & Tables

Table 1

Mean and standard deviation (SD) of frequency (Zipf scale), age of acquisition (AoA) ratings, and name agreement (H-index) for the words/pictures in each list.

LISTFREQUENCY MEANFREQUENCY SDAoA MEANAoA SDH-INDEX MEANH-INDEX SD
14.170.485.391.430.130.15
24.280.645.481.690.130.17
joc-7-1-337-g1.png
Figure 1

Illustration of procedure for Experiment 1. Participants completed the depicted experiment at two different sessions, each with a different stimulus list. The order of the stimulus list presentation was counterbalanced.

Table 2

Ranges of correlation coefficients and their typical interpretations for reliability (e.g., Hedge et al., 2018; Landis & Koch, 1977).

CORRELATION COEFFICIENTINTERPRETATION
.81–1Excellent
.61–.8Good
.41–.6Moderate
<.4Poor
joc-7-1-337-g2.png
Figure 2

Posterior distribution with 95% credible interval (black line) (left side) and scatterplots with raw response time means (right side) for split-half reliability in Session 1 (A-B), split-half reliability in Session 2 (C-D), and test-retest reliability (E-F).

joc-7-1-337-g3.png
Figure 3

Illustration of procedure for Experiment 2. Participants completed the depicted experiment at two different sessions, each with a different stimulus list and condition (speeded or non-speeded). The order of the stimulus list presentation and the session at which participants receive the speeded or non-speeded condition was counterbalanced.

joc-7-1-337-g4.png
Figure 4

Posterior distribution with 95% credible interval (black line) (left side) and scatterplots with raw response time means (right side) for split-half reliability in the non-speeded condition (A-B), split-half reliability in the speeded condition (C-D), and the correlation between the conditions (E-F).

joc-7-1-337-g5.png
Figure 5

Scatterplots showing the relationship between participants’ picture naming speed in log units and accuracy in log odds in the non-speeded condition (left side) and speeded condition (right side).

Table 3

Posterior distribution means and credible intervals for split-half reliability calculated with first and second halves of the data.

MODELESTIMATECI_LOWERCI_UPPER
Experiment 1 Session 10.930.880.97
Experiment 1 Session 20.950.910.98
Experiment 2 Non-speeded0.870.770.94
Experiment 2 Speeded0.940.890.98
LIST 1LIST 2
anchorairport
appleambulance
armankle
arrowapron
avocadoasparagus
basketbaby
batteryback
beakballoon
bearbanana
bellbat
benchbeard
bibbed
bikebedroom
bonebelt
bookbible
bottlebin
boxerbomb
braceletboomerang
bullbox
bulletbra
busbrain
butterbroccoli
butterflybroom
candleburger
carrotbutcher
cherrybutton
clowncactus
coatcage
combcalculator
compasscalendar
computercamera
corkcannon
crabcar
dicecaravan
doctorchain
donkeychair
doughnutchocolate
drawerchoir
dresscigarette
drumcloud
earcoconut
elbowcoffee
fairycoffin
fireplacecondom
flagcone
flowercowboy
foxcrown
fridgedentist
ghostdesert
glovedevil
heeldiamond
helmetdinosaur
islanddog
jellyfishdolphin
kangaroodominoes
kitedoor
kiwidragon
lawnmowerduck
lighterearring
limoegg
magnetelephant
mapeye
medalface
mermaidfan
netfarm
pegfeather
plumberfinger
pocketfire
rabbitfist
rhinofoot
rocketfootball
shieldfrog
showerfruit
tomatogiraffe
traygirl
lungglass
castleglasses
hippogreenhouse
tractorguitar
circlegun
skirthair
mouthhand
dummyhandle
camelharp
oliveheart
robothedgehog
tiehoney
knifehouse
snakeiron
onionjar
thumbkeyboard
cowking
squirrelknee
pianolab
sunleaf
suitleg
goatlemon
pipelion
lamplizard
caterpillarman
keymask
suitcasemaze
owlmicrophone
curtainmirror
sawmoustache
kitchenneedle
flippernose
ropenun
koalanurse
lighthouseparachute
wallparrot
fencepenguin
shoepilot
potatopirate
teacherpizza
forkpool
gymprinter
helicopterpumpkin
hatring
wingroad
whaleroof
pearscarecrow
soapscarf
mountainscorpion
zebrascrewdriver
sweetshadow
sausageshark
wavesheep
tattooshirt
submarinesink
triangleskateboard
tunnelskeleton
starskull
tonguesnail
swordsock
judgespider
pencilspoon
orangestapler
rosestrawberry
nestswimming
puppettank
traintelephone
queentelevision
pepperthermometer
pineappletooth
tigertorch
scissorstrumpet
rulerumbrella
windmillvein
wheelbarrowvolcano
tapwaiter
swanwallet
tambourinewatch
zipwell
treewitch
DOI: https://doi.org/10.5334/joc.337 | Journal eISSN: 2514-4820
Language: English
Submitted on: Aug 26, 2021
Accepted on: Dec 6, 2023
Published on: Jan 11, 2024
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2024 Pamela Fuhrmeister, Shereen Elbuy, Audrey Bürki, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.