On the Construct Validity of Performance-Based Emotion Recognition Tests: Correlations with Social-Emotional Functioning and Cognitive Skills
By: Emalie Hendel and Marc Brysbaert
References
- Acheson, D. J., Wells, J. B., & MacDonald, M. C. (2008). New and updated tests of print exposure and reading abilities in college students. Behavior Research Methods, 40(1), 278–289. 10.3758/BRM.40.1.278
- Amthauer, R., Brocke, B., Liepmann, D., & Beauducel, A. (1999). Intelligenz-Struktur-Test 2000. Hogrefe.
- Archer, J. (2019). The reality and evolutionary significance of human psychological sex differences. Biological Reviews, 94(4), 1381–1415. 10.1111/brv.12507
- Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001). The “Reading the Mind in the Eyes” Test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 42(2), 241–251. 10.1111/1469-7610.00715
- Beauducel, A., Brocke, B., & Liepmann, D. (2001). Perspectives on fluid and crystallised intelligence: facets for verbal, numerical, and figural intelligence. Personality and Individual Differences, 30(6), 977–994. 10.1016/S0191-8869(00)00087-8
- Beffara, B., Veyrie, M., Mauduit, L., Bardi, L., & Cristofori, I. (2025). No evidence for the efficiency of the eye-tracking-based Reading the Mind in the Eyes Test version at detecting differences of mind reading abilities across psychological traits. Quarterly Journal of Experimental Psychology, 78(12), 2772–2780. 10.1177/17470218251326569
- Berenson, K. R., Gyurak, A., Ayduk, Ö., Downey, G., Garner, M. J., Mogg, K., Bradley, B. P., & Pine, D. S. (2009). Rejection sensitivity and disruption of attention by social threat cues. Journal of Research in Personality, 43(6), 1064–1072. 10.1016/j.jrp.2009.07.007
- Bommer, W. H., Johnson, J. L., Rich, G. A., Podsakoff, P. M., & MacKenzie, S. B. (1995). On the interchangeability of objective and subjective measures of employee performance: A meta-analysis. Personnel Psychology, 48, 587–606. 10.1111/j.1744-6570.1995.tb01772.x
- Bornhofen, C., & Mcdonald, S. (2008). Emotion perception deficits following traumatic brain injury: A review of the evidence and rationale for intervention. Journal of the International Neuropsychological Society, 14(4), 511–525. 10.1017/S1355617708080703
- Brown, M. I., Heck, P., & Chabris, C. F. (2023). Exploring the disconnect between self-report and performance measures of emotional intelligence. Available at SSRN 4590206. 10.2139/ssrn.4590206
- Brysbaert, M. (2019). How many words do we read per minute? A review and meta-analysis of reading rate. Journal of Memory and Language, 109, 104047. 10.1016/j.jml.2019.104047
- Brysbaert, M. (2024). Designing and evaluating tasks to measure individual differences in experimental psychology: A tutorial. Cognitive Research: Principles and Implications, 9(1), 11. 10.1186/s41235-024-00540-2
- Caprara, G. V., & Steca, P. (2005). Affective and Social Self- Regulatory Efficacy Beliefs as Determinants of Positive Thinking and Happiness. European Psychologist, 10(4), 275–286. 10.1027/1016-9040.10.4.275
- Castano, E. (2024). Less Is More: How the Language of Fiction Fosters Emotion Recognition. Emotion Review. 10.1177/17540739241232350
- Christensen, A. P., & Golino, H. (2021). Estimating the Stability of Psychological Dimensions via Bootstrap Exploratory Graph Analysis: A Monte Carlo Simulation and Tutorial. Psych, 3(3), 479–500. 10.3390/psych3030032
- Christensen, A. P., Garrido, L. E., & Golino, H. (2023). Unique Variable Analysis: A Network Psychometrics Method to Detect Local Dependence. Multivariate Behavioral Research, 58(6), 1165–1182. 10.1080/00273171.2023.2194606
- Cong, Y.-Q., Yurdum, L., Fischer, A., & Sauter, D. (2025). Emotions are perceived differently from posed and spontaneous facial expressions. Emotion, 25(6), 1605–1621. 10.1037/emo0001473
- Connolly, H. L., Young, A. W., & Lewis, G. J. (2021). Face perception across the adult lifespan: Evidence for age-related changes independent of general intelligence. Cognition & Emotion, 35(5), 890–901. PubMed (33734017). 10.1080/02699931.2021.1901657
- Conradi, K., Jang, B. G., & McKenna, M. C. (2014). Motivation Terminology in Reading Research: A Conceptual Review. Educational Psychology Review, 26(1), 127–164. 10.1007/s10648-013-9245-z
- Conway, J. R., Long, E. L., Sevi, L., Catmur, C., & Bird, G. (2024). Theoretical limitations on mindreading measures: Commentary on Wendt et al. (2024). Psychological Assessment.
https://ora.ox.ac.uk/objects/uuid:bc15344a-3ab3-472b-8975-40a0bd0f9e20/files/sff365720r - Crumley, J. J., Stetler, C. A., & Horhota, M. (2014). Examining the relationship between subjective and objective memory performance in older adults: A meta-analysis. Psychology and Aging, 29(2), 250–263. 10.1037/a0035908
- Di Giunta, L., Eisenberg, N., Kupfer, A., Steca, P., Tramontano, C., & Caprara, G. V. (2010). Assessing Perceived Empathic and Social Self-Efficacy Across Countries. European Journal of Psychological Assessment, 26(2), 77–86. 10.1027/1015-5759/a000012
- Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction With Life Scale. Journal of Personality Assessment, 49(1), 71–75. 10.1207/s15327752jpa4901_13
- Downey, G., & Feldman, S. I. (1996). Implications of rejection sensitivity for intimate relationships. Journal of Personality and Social Psychology, 70(6), 1327–1343. 10.1037/0022-3514.70.6.1327
- Dunlop, P. D., Bourdage, J. S., de Vries, R. E., McNeill, I. M., Jorritsma, K., Orchard, M., Austen, T., Baines, T., & Choe, W.-K. (2020). Liar! Liar! (When stakes are higher): Understanding how the overclaiming technique can be used to measure faking in personnel selection. Journal of Applied Psychology, 105(8), 784–799. 10.1037/apl0000463
- Eekhof, L. S., & Mar, R. A. (2023). Does reading about fictional minds make us more curious about real ones? Language and Cognition, 1–21. 10.1017/langcog.2023.30
- Franca, M., Bolognini, N., & Brysbaert, M. (2023). Seeing emotions in the eyes: A validated test to study individual differences in the perception of basic emotions. Cognitive Research: Principles and Implications, 8(1), 67. 10.1186/s41235-023-00521-x
- Golino, H. F., & Epskamp, S. (2017). Exploratory graph analysis: A new approach for estimating the number of dimensions in psychological research. PLOS ONE, 12(6),
e0174035 . 10.1371/journal.pone.0174035 - Golino, H. F., Moulder, R., Shi, D., Christensen, A. P., Garrido, L. E., Nieto, M. D., Nesselroade, J., Sadana, R., Thiyagarajan, J. A., & Boker, S. M. (2021). Entropy Fit Indices: New Fit Measures for Assessing the Structure and Dimensionality of Multiple Latent Variables. Multivariate Behavioral Research, 56(6), 874–902. 10.1080/00273171.2020.1779642
- Goring, S. A., Schmank, C. J., Kane, M. J., & Conway, A. R. A. (2021). Psychometric models of individual differences in reading comprehension: A reanalysis of Freed, Hamilton, and Long (2017). Journal of Memory and Language, 119, 104221. 10.1016/j.jml.2021.104221
- Greenberg, D. M., Warrier, V., Abu-Akel, A., Allison, C., Gajos, K. Z., Reinecke, K., Rentfrow, P. J., Radecki, M. A., & Baron-Cohen, S. (2023). Sex and age differences in “theory of mind” across 57 countries using the English version of the “Reading the Mind in the Eyes” Test. Proceedings of the National Academy of Sciences, 120(1),
e2022385119 . 10.1073/pnas.2022385119 - Hafner, R. M., Johnson, B. N., Tone, E. B., Kivity, Y., Levy, K. N., & Bedwell, J. S. (2026). A multi-site psychometric evaluation of the Reading the Mind in the Eyes Test – Revised. Personality and Individual Differences, 250, 113526. 10.1016/j.paid.2025.113526
- Haier, R. J., Colom, R., & Hunt, E. (2023). The science of human intelligence. Cambridge University Press. 10.1017/9781108569576
- Heck, P. R., Brown, M. I., & Chabris, C. F. (2024). A Robust Negative Relationship Between Self-Reports of Social Skills and Performance Measures of Social Intelligence. Swiss Psychology Open: The Official Journal of the Swiss Psychological Society, 4(1). 10.5334/spo.78
- Heredia, A. G., Vallat-Azouvi, C., & Allain, P. (2022).
Social cognition in traumatic brain injury . In Cellular, Molecular, Physiological, and Behavioral Aspects of Traumatic Brain Injury (pp. 447–459). Elsevier. 10.1016/B978-0-12-823036-7.00045-1 - Higgins, W. C., Kaplan, D. M., Deschrijver, E., & Ross, R. M. (2024). Construct validity evidence reporting practices for the Reading the Mind in the Eyes Test: A systematic scoping review. Clinical Psychology Review, 108, 102378. 10.1016/j.cpr.2023.102378
- Hodson, G. (2021). Construct jangle or construct mangle? Thinking straight about (nonredundant) psychological constructs. Journal of Theoretical Social Psychology, 5(4), 576–590. 10.1002/jts5.120
- Irwing, P., Hughes, D. J., Tokarev, A., & Booth, T. (2023). Towards a taxonomy of personality facets. European Journal of Personality, 08902070231200919. 10.1177/08902070231200919
- Jamieson, G. A. (2005). The modified tellegen absorption scale: A clearer window on the structure and meaning of absorption. Australian Journal of Clinical & Experimental Hypnosis, 33(2), 119–139.
- Johnson, W., & Bouchard, T. J.
Jr. (2005). The structure of human intelligence: It is verbal, perceptual, and image rotation (VPR), not fluid and crystallized. Intelligence, 33(4), 393–416. 10.1016/j.intell.2004.12.002 - Kim, H., Kaduthodil, J., Strong, R. W., Germine, L., Cohan, S., & Wilmer, J. B. (2022). Multiracial Reading the Mind in the Eyes Test (MRMET): An inclusive version of an influential measure. 10.31219/osf.io/y8djm
- Kittel, A. F. D., Olderbak, S., & Wilhelm, O. (2022). Sty in the Mind’s Eye: A Meta-Analytic Investigation of the Nomological Network and Internal Consistency of the “Reading the Mind in the Eyes” Test. Assessment, 29(5), 872–895. 10.1177/1073191121996469
- Kuhn, A., & Wolter, S. C. (2022). Things versus People: Gender Differences in Vocational Interests and in Occupational Preferences. Journal of Economic Behavior & Organization, 203, 210–234. 10.1016/j.jebo.2022.09.003
- Kuijpers, M. M., Douglas, S., & Kuiken, D. (2020). Capturing the Ways We Read. Anglistik, 31(1), 53–69. 10.33675/ANGL/2020/1/6
- Lippa, R. A., Preston, K., & Penner, J. (2014). Women’s Representation in 60 Occupations from 1972 to 2010: More Women in High-Status Jobs, Few Women in Things-Oriented Jobs. PLOS ONE, 9(5),
e95960 . 10.1371/journal.pone.0095960 - Lubben, J., Blozik, E., Gillmann, G., Iliffe, S., von Renteln Kruse, W., Beck, J. C., & Stuck, A. E. (2006). Performance of an Abbreviated Version of the Lubben Social Network Scale Among Three European Community-Dwelling Older Adult Populations. The Gerontologist, 46(4), 503–513. 10.1093/geront/46.4.503
- MacCann, C., Joseph, D. L., Newman, D. A., & Roberts, R. D. (2014). Emotional intelligence is a second-stratum factor of intelligence: Evidence from hierarchical and bifactor models. Emotion, 14(2), 358–374. 10.1037/a0034755
- MacCann, C., & Roberts, R. D. (2008). New paradigms for assessing emotional intelligence: Theory and data. Emotion, 8(4), 540–551. 10.1037/a0012746
- Mar, R. A., Oatley, K., & Peterson, J. B. (2009). Exploring the link between reading fiction and empathy: Ruling out individual differences and examining outcomes. COMM, 34(4), 407–428. 10.1515/COMM.2009.025
- Marcoulides, K. M., & Yuan, K.-H. (2017). New Ways to Evaluate Goodness of Fit: A Note on Using Equivalence Testing to Assess Structural Equation Models. Structural Equation Modeling: A Multidisciplinary Journal, 24(1), 148–153. 10.1080/10705511.2016.1225260
- Martin-Chang, S., Kozak, S., Levesque, K. C., Calarco, N., & Mar, R. A. (2021). What’s your pleasure? Exploring the predictors of leisure reading for fiction and nonfiction. Reading and Writing, 34(6), 1387–1414. 10.1007/s11145-020-10112-7
- Mayer, J. D., Caruso, D. R., Salovey, P., Lin, I. Y., Hansma, B. J., Solomon, J., Sitarenios, G., & Romero Escobar, M. (2025). Measuring emotional intelligence with the MSCEIT 2: Theory, rationale, and initial findings. Frontiers in Psychology, 16. 10.3389/fpsyg.2025.1539785
- McGrew, K. S. (2009). CHC theory and the human cognitive abilities project: Standing on the shoulders of the giants of psychometric intelligence research. Intelligence, 37(1), 1–10. 10.1016/j.intell.2008.08.004
- McLean, K., Bussey, T., Nix, J., Rojek, J., Curran, A., Ta-Johnson, V., & Alpert, G. P. (2026). Developing and validating an emotion recognition test for policing. Policing: An International Journal, 49(1), 52–72. 10.1108/PIJPSM-04-2025-0072
- Meyer, K., Sommer, W., & Hildebrandt, A. (2021). Reflections and New Perspectives on Face Cognition as a Specific Socio-Cognitive Ability. Journal of Intelligence, 9(2), 30. 10.3390/jintelligence9020030
- Murphy, B. A., & Hall, J. A. (2024). How a strong measurement validity review can go astray: A look at Higgins et al. (2024) and recommendations for future measurement-focused reviews. Clinical Psychology Review, 114, 102506. 10.1016/j.cpr.2024.102506
- Murphy, B. A., & Lilienfeld, S. O. (2019). Are self-report cognitive empathy ratings valid proxies for cognitive empathy ability? Negligible meta-analytic relations with behavioral task performance. Psychological Assessment, 31(8), 1062–1072. 10.1037/pas0000732
- Neumann, David. L., Chan, R. C. K., Boyle, Gregory. J., Wang, Y., & Rae Westbury, H. (2015).
Measures of Empathy: Self-Report, Behavioral, and Neuroscientific Approaches . In G. J. Boyle, D. H. Saklofske, & G. Matthews (Eds.), Measures of Personality and Social Psychological Constructs (pp. 257–289). Academic Press. 10.1016/B978-0-12-386915-9.00010-3 - Nicolet-dit-Félix, M., Gillioz, C., Mortillaro, M., Sander, D., & Fiori, M. (2023). Emotional intelligence and attentional bias to emotional faces: Evidence of hypersensitivity towards emotion information. Personality and Individual Differences, 201, 111917. 10.1016/j.paid.2022.111917
- Oakley, B. F. M., Brewer, R., Bird, G., & Catmur, C. (2016). Theory of mind is not theory of emotion: A cautionary note on the Reading the Mind in the Eyes Test. Journal of Abnormal Psychology, 125(6), 818–823. 10.1037/abn0000182
- Reniers, R. L. E. P., Corcoran, R., Drake, R., Shryane, N. M., & Völlm, B. A. (2011). The QCAE: A Questionnaire of Cognitive and Affective Empathy. Journal of Personality Assessment, 93(1), 84–95. 10.1080/00223891.2010.528484
- Renner, B. (2006). Curiosity About People: The Development of a Social Curiosity Measure in Adults. Journal of Personality Assessment, 87(3), 305–316. 10.1207/s15327752jpa8703_11
- Roberts, R. D., MacCann, C., Matthews, G., & Zeidner, M. (2010). Emotional Intelligence: Toward a Consensus of Models and Measures. Social and Personality Psychology Compass, 4(10), 821–840. 10.1111/j.1751-9004.2010.00277.x
- Rosseel, Y. (2012). lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48, 1–36. 10.18637/jss.v048.i02
- Russell, D. W. (1996). UCLA Loneliness Scale (Version 3): Reliability, Validity, and Factor Structure. Journal of Personality Assessment, 66(1), 20–40. 10.1207/s15327752jpa6601_2
- Salovey, P., & Mayer, J. D. (1990). Emotional Intelligence. Imagination, Cognition and Personality, 9(3), 185–211. 10.2190/DUGG-P24E-52WK-6CDG
- Samur, D., Luminet, O., & Koole, S. L. (2017). Alexithymia predicts lower reading frequency: The mediating roles of mentalising ability and reading attitude. Poetics, 65, 1–11. 10.1016/j.poetic.2017.09.002
- Schlegel, K., Fontaine, J. R. J., & Scherer, K. R. (2016). The Nomological Network of Emotion Recognition Ability: Evidence from the Geneva Emotion Recognition Test. European Journal of Psychological Assessment, 35(3), 352–363. 10.1027/1015-5759/a000396
- Schlegel, K., Grandjean, D., & Scherer, K. R. (2014). Introducing the Geneva Emotion Recognition Test: An example of Rasch-based test development. Psychological Assessment, 26(2), 666–672. 10.1037/a0035246
- Schlegel, K., & Scherer, K. R. (2016). Introducing a short version of the Geneva Emotion Recognition Test (GERT-S): Psychometric properties and construct validation. Behavior Research Methods, 48(4), 1383–1392. 10.3758/s13428-015-0646-4
- Sunahara, C. S., Rosenfield, D., Alvi, T., Wallmark, Z., Lee, J., Fulford, D., & Tabak, B. A. (2022). Revisiting the association between self-reported empathy and behavioral assessments of social cognition. Journal of Experimental Psychology: General, 151(12), 3304–3322. 10.1037/xge0001226
- Talipski, L. A., Palermo, R., Sutherland, C. A. M., Gignac, G. E., Jeffery, L., Crookes, K., Wilmer, J. B., Krumhuber, E. G., Bell, J., & Dawel, A. (2026). Introducing the Naturalistic Expression Labeling Task (NELT): Associations with posed expression labeling, empathy, and general cognitive ability. Behavior Research Methods, 58(5), 116. 10.3758/s13428-026-02944-y
- Tellegen, A., & Atkinson, G. (1974). Openness to absorbing and self-altering experiences (“absorption”), a trait related to hypnotic susceptibility. Journal of Abnormal Psychology, 83(3), 268–277. 10.1037/h0036681
- Terhune, D. B., & Jamieson, G. A. (2021). Hallucinations and the meaning and structure of absorption. Proceedings of the National Academy of Sciences of the United States of America, 118(32),
e2108467118 . 10.1073/pnas.2108467118 - Tracey, T. J. G. (2002). Personal Globe Inventory: Measurement of the Spherical Model of Interests and Competence Beliefs. Journal of Vocational Behavior, 60(1), 113–172. 10.1006/jvbe.2001.1817
- Tracey, T. J. G. (2010). Development of an abbreviated Personal Globe Inventory using item response theory: The PGI-Short. Journal of Vocational Behavior, 76(1), 1–15. 10.1016/j.jvb.2009.06.007
- Vermeiren, H., Vandendaele, A., & Brysbaert, M. (2023). Validated tests for language research with university students whose native language is English: Tests of vocabulary, general knowledge, author recognition, and reading comprehension. Behavior Research Methods, 55(3), 1036–1068. 10.3758/s13428-022-01856-x
- Völker, J. (2020). An Examination of Ability Emotional Intelligence and Its Relationships with Fluid and Crystallized Abilities in a Student Sample. Journal of Intelligence, 8(2), 18. PubMed (32344642). 10.3390/jintelligence8020018
- Walker, D. L., Palermo, R., Callis, Z., & Gignac, G. E. (2023). The association between intelligence and face processing abilities: A conceptual and meta-analytic review. Intelligence, 96, 101718. 10.1016/j.intell.2022.101718
- Walker, D. L., Palermo, R., & Gignac, G. E. (2025). The inter-association between face processing, intelligence, and autistic-like nonverbal communication. Quarterly Journal of Experimental Psychology, 78(12), 2688–2712. 10.1177/17470218251323388
- Wei, T., & Simko, V. (2010). corrplot: Visualization of a Correlation Matrix (p. 0.95) [Dataset]. 10.32614/CRAN.package.corrplot
- Wendt, L. P., Zimmermann, J., Spitzer, C., & Müller, S. (2024). Mindreading Measures Misread? A Multimethod Investigation Into the Validity of Self-Report and Task-Based Approaches. Psychological Assessment, 36(5), 365–378. 10.1037/pas0001310
- Wilhelm, O., & Kyllonen, P. (2021). To predict the future, consider the past: Revisiting Carroll (1993) as a guide to the future of intelligence research. Intelligence, 89, 101585. 10.1016/j.intell.2021.101585
- Xiao, H., Double, K. S., Pinkus, R., Kalwani, M., Leckie, R., & MacCann, C. (2025, November 29). The Relationship between Emotional Intelligence and Emotion Regulation: A Meta-Analysis. 10.31234/osf.io/2h4f7_v1
- Zell, E., & Krizan, Z. (2014). Do People Have Insight Into Their Abilities? A Metasynthesis. Perspectives on Psychological Science, 9(2), 111–125. 10.1177/1745691613518075
DOI: https://doi.org/10.5334/pb.1443 | Journal eISSN: 0033-2879
Language: English
Page range: 47 - 64
Submitted on: Aug 25, 2025
Accepted on: May 6, 2026
Published on: May 25, 2026
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year
Keywords:
© 2026 Emalie Hendel, Marc Brysbaert, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.