References
- Baayen, R. H., Davidson, D. J., & Bates, D. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59, 390–412. 10.1016/j.jml.2007.12.005
- Baayen, R. H., & Milin, P. (2010). Analyzing reaction times. International journal of psychological research, 3(2), 12–28. 10.21500/20112084.807
- Brysbaert, M. (2024). Designing and evaluating tasks to measure individual differences in experimental psychology: A tutorial. Cognitive Research: Principles and Implications, 9(1), 11. 10.1186/s41235-024-00540-2
- Brysbaert, M. (2026). Calculating the reliability of word norms.
https://www.researchgate.net/publication/404289654 - De Boeck, P., Bakker, M., Zwitser, R., Nivard, M., Hofman, A., Tuerlinckx, F., & Partchev, I. (2011). The estimation of item response models with the lmer function from the lme4 package in R. Journal of Statistical Software, 39, 1–28. 10.18637/jss.v039.i12
- Fletcher, T. D. (2023). psychometric: Applied Psychometric Theory.
https://cran.r-project.org/web/packages/psychometric/index.html - Gamer, M. (2019). Package ‘irr’.
https://cran.r-project.org/web/packages/irr/irr.pdf - Haines, N. (2026, March 15). How to Estimate a Mean, and What It Means for Science.
https://haines-lab.com/post/how-to-estimate-a-mean-and-what-it-means-for-science/ - Houslay, T. M., & Wilson, A. J. (2017). Avoiding the misuse of BLUP in behavioural ecology. Behavioral Ecology, 28(4), 948–952. 10.1093/beheco/arx023
- Judd, C. M., Westfall, J., & Kenny, D. A. (2012). Treating stimuli as a random factor in social psychology: A new and comprehensive solution to a pervasive but largely ignored problem. Journal of Personality and Social Psychology, 103(1), 54–69. 10.1037/a0028347
- Kahveci, S. (2026). rapidsplithalf: A Fast Permutation-Based Split-Half Reliability Algorithm.
https://cran.r-project.org/web/packages/rapidsplithalf/index.html - Kahveci, S., Bathke, A. C., & Blechert, J. (2025). Reaction-time task reliability is more accurately computed with permutation-based split-half correlations than with Cronbach’s alpha. Psychonomic Bulletin & Review, 32(2), 652–673. 10.3758/s13423-024-02597-y
- Kliegl, R., Wei, P., Dambacher, M., Yan, M., & Zhou, X. (2011). Experimental effects and individual differences in linear mixed models: Estimating the relationship between spatial, object, and attraction effects in visual attention. Frontiers in Psychology, 1, 238. 10.3389/fpsyg.2010.00238
- Lüdecke, D. (2026). Package {performance}.
https://cran.r-project.org/web//packages/performance/refman/performance.html#item_reliability - Miller, J. (2023). Outlier exclusion procedures for reaction time analysis: The cures are generally worse than the disease. Journal of Experimental Psychology: General, 152(11), 3189. 10.1037/xge0001450
- Parsons, S. (2022). splithalf: Calculate Task Split Half Reliability Estimates.
https://cran.r-project.org/web/packages/splithalf/index.html - Pronk, T. (2025). splithalfr: Estimate Split-Half Reliabilities.
https://cran.r-project.org/web/packages/splithalfr/index.html - Pronk, T., Molenaar, D., Wiers, R. W., & Murre, J. (2022). Methods to split cognitive task data for estimating split-half reliability: A comprehensive review and systematic assessment. Psychonomic Bulletin & Review, 29(1), 44–54. 10.3758/s13423-021-01948-3
- Revelle, W. (2026). psych: Procedures for Psychological, Psychometric, and Personality Research.
https://cran.r-project.org/web/packages/psych/index.html - Rey-Sáez, R., Franco-Martínez, A., Revuelta, J., & Vadillo, M. A. (2026). A unified framework for psychometrics in experimental psychology: The standardized generalized hierarchical factor model. Psychological Methods. Advance online publication. 10.1037/met0000846
- Rouder, J. N., Mehrvarz, M., & Schnuerch, M. (2026). The role of reliability in experiments. British Journal of Mathematical and Statistical Psychology, 1–15. 10.1111/bmsp.70042
- Rouder, J. N., Mehrvarz, M., & Stevenson, N. (2025).
Hierarchical factor models for analysis in experimental designs . OSF. 10.31234/osf.io/cetwz_v3 - Savalei, V., Chen, B., & Vanpaemel, W. (2019). Break Coefficient Alpha! (Version 1.0) [Shiny app].
https://semlab.shinyapps.io/breakalpha/ - Savalei, V., & Reise, S. P. (2019). Don’t forget the model in your model-based reliability coefficients: A reply to McNeish. Collabra: Psychology, 5(1), 36. 10.1525/collabra.247
- Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428. 10.1037/0033-2909.86.2.420
- Sijtsma, K., & Pfadt, J. M. (2021). Part II: On the use, the misuse, and the very limited usefulness of Cronbach’s alpha: Discussing lower bounds and correlated errors. Psychometrika, 86(4), 843–860. 10.1007/s11336-021-09789-8
- Ten Hove, D., Jorgensen, T. D., & Van der Ark, L. A. (2025). How to estimate intraclass correlation coefficients for interrater reliability from planned incomplete data. Multivariate Behavioral Research, 60(5), 1042–1061. 10.1080/00273171.2025.2507745
- Yanagida, T. (2026). misty: Miscellaneous Functions.
https://cran.r-project.org/web/packages/misty/index.html
DOI: https://doi.org/10.5334/joc.516 | Journal eISSN: 2514-4820
Language: English
Page range: 42 - 42
Submitted on: May 3, 2026
Accepted on: Aug 6, 2026
Published on: Aug 18, 2026
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
© 2026 Marc Brysbaert, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.