Have a personal or library account? Click to login
A Robust Negative Relationship Between Self-Reports of Social Skills and Performance Measures of Social Intelligence Cover

A Robust Negative Relationship Between Self-Reports of Social Skills and Performance Measures of Social Intelligence

Open Access
|Apr 2024

References

  1. Aldrup, K., Carstensen, B., Köller, M., & Klusmann, U. (2020). Measuring teachers’ social-emotional competence: Development and validation of a situational judgment test. Frontiers in Psychology, 11, 892. DOI: 10.3389/fpsyg.2020.00892
  2. Alicke, M. (1985). Global self-evaluation as determined by the desirability and controllability of trait adjectives. Journal of Personality and Social Psychology, 49, 16211630. DOI: 10.1037/0022-3514.49.6.1621
  3. Allen, V., Weissman, A., Hellwig, S., MacCann, C., & Roberts, R. (2014). Development of the situational judgment test of emotional understanding – brief (STEU-B) using item response theory. Personality and Individual Differences, 65, 37. DOI: 10.1016/j.paid.2014.01.051
  4. Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001b). The “Reading the mind in the eyes” test revised edition: A study of normal adults, adults with Asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 42, 241251. DOI: 10.1017/S0021963001006643
  5. Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., & Clubley, E. (2001a). The Autism-Spectrum Quotient (AQ): Evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. Journal of Autism and Developmental Disorders, 31, 517. DOI: 10.1023/A:1005653411471
  6. Brackett, M. A., Rivers, S. E., Shiffman, S., Lerner, N., & Salovey, P. (2006). Relating emotional abilities to social functioning: A comparison of self-report and performance measures of emotional intelligence. Journal of Personality and Social Psychology, 91, 780795. DOI: 10.1037/0022-3514.91.4.780
  7. Brannick, M., Wahi, M. M., Arce, M., Johnson, H. A., Nazian, S., & Goldin, S. (2009). Comparison of trait and ability measures of emotional intelligence in medical students. Medical Education, 43, 10621068. DOI: 10.1111/j.1365-2923.2009.03430.x
  8. Brown, J. D. (2012). Understanding the better than average effect: Motives (still) matter. Personality and Social Psychology Bulletin, 38, 209219. DOI: 10.1177/0146167211432763
  9. Brown, M, Heck, P., & Chabris, C. (2023). The Social Shapes Test as a self-administered, online measure of social intelligence: Two studies with typically developing adults and adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 116. DOI: 10.1007/s10803-023-05901-2
  10. Brown, M., Ratajska, A., Hughes, S., Fishman, J., Huerta, E., & Chabris, C. (2019). The social shapes test: A new measure of social intelligence, mentalizing, and theory of mind. Personality and Individual Differences, 143, 107117. DOI: 10.1016/j.paid.2019.01.035
  11. Brown, M., Speer, A., Tenbrink, A., & Chabris, C. (2022). Using game-like, animated shapes to simulate social interactions: Weaker group score differences compared to a written situational judgment test. International Journal of Selection and Assessment, 30, 167181. DOI: 10.1111/ijsa.12375
  12. Brown, M., Wai, J., & Chabris, C. (2021). Can you ever be too smart for your own good? Comparing linear and nonlinear effects of cognitive ability on life outcomes. Perspectives on Psychological Science, 16, 13371359. DOI: 10.1177/1745691620964122
  13. Bryan, V., & Mayer, J. (2021). Are people-centered intelligences psychometrically distinct from thing-centered intelligences? A meta-analysis. Journal of Intelligence, 9, 48. DOI: 10.3390/jintelligence9040048
  14. Burger-Caplan, R., Saulnier, C., Jones, W., & Klin, A. (2016). Predicting social and communicative ability in school-age children with autism spectrum disorder: A pilot study of the Social Attribution Task, Multiple Choice. Autism, 20, 952962. DOI: 10.1177/1362361315617589
  15. Burson, K., Larrick, R., & Klayman, J. (2006). Skilled or unskilled, but still unaware of it: how perceptions of difficulty drive miscalibration in relative comparisons. Journal of Personality and Social Psychology, 90, 6077. DOI: 10.1037/0022-3514.90.1.60
  16. Christiansen, N., Janovics, J., & Siers, B. (2010). Emotional intelligence in selection contexts: Measurement method, criterion-related validity, and vulnerability to response distortion. International Journal of Selection and Assessment, 18, 87101. DOI: 10.1111/j.1468-2389.2010.00491.x
  17. Chung, Y., Barch, D., & Strube, M. (2014). A meta-analysis of mentalizing impairments in adults with schizophrenia and autism spectrum disorder. Schizophrenia Bulletin, 40, 602616. DOI: 10.1093/schbul/sbt048
  18. Condon, D., & Revelle, W. (2014). The international cognitive ability resource: Development and initial validation of a public-domain measure. Intelligence, 43, 5264. DOI: 10.1016/j.intell.2014.01.004
  19. Cor, M. K., Haertel, E., Krosnick, J. A., & Malhotra, N. (2012). Improving ability measurement in surveys by following the principles of IRT: The Wordsum vocabulary test in the General Social Survey. Social Science Research, 41, 10031016. DOI: 10.1016/j.ssresearch.2012.05.007
  20. Côté, S. (2015). Emotional intelligence in organizations. Annual Review of Organizational Psychology and Organizational Behavior, 1, 459488. DOI: 10.1146/annurev-orgpsych-031413-091233
  21. Davis, M. (1983). Measuring individual differences in empathy: Evidence for a multidimensional approach. Journal of Personality and Social Psychology, 44, 113126. DOI: 10.1037/0022-3514.44.1.113
  22. Dunning, D., & Beauregard, K. (2000). Regulating impressions of others to affirm images of the self. Social Cognition, 18, 198222. DOI: 10.1521/soco.2000.18.2.198
  23. Elfenbein, H., & MacCann, C. (2017). A closer look at ability emotional intelligence (EI): What are its component parts, and how do they relate to each other? Social and Personality Psychology Compass, 11, e12324. DOI: 10.1111/spc3.12324
  24. Engel, D., Woolley, A., Jing, L., Chabris, C., & Malone, T. (2014). Reading the mind in the eyes or reading between the lines? Theory of Mind predicts collective intelligence equally well online and face-to-face. PLoS ONE, 9, e115212. DOI: 10.1371/journal.pone.0115212
  25. English, M., Gignac, G., Visser, T., Whitehouse, A., Enns, J., & Maybery, M. (2021). The Comprehensive Autistic Trait Inventory (CATI): development and validation of a new measure of autistic traits in the general population. Molecular Autism, 12, 123. DOI: 10.1186/s13229-021-00445-7
  26. Faul, F., Erdfelder, E., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41, 11491160. DOI: 10.3758/BRM.41.4.1149
  27. Feather, N. (1994). Attitudes toward high achievers and reactions to their fall: Theory and research concerning tall poppies. In M. Zanna (Ed.), Advances in experimental social psychology (Vol. 26, pp. 173). San Diego, CA: Academic Press. DOI: 10.1016/S0065-2601(08)60151-3
  28. Ferris, G., Witt, L., & Hochwarter, W. (2001). Interaction of social skill and general mental ability on job performance and salary. Journal of Applied Psychology, 86, 10751082. DOI: 10.1037/0021-9010.86.6.1075
  29. Freund, P., & Kasten, N. (2012). How smart do you think you are? A meta-analysis on the validity of self-estimates of cognitive ability. Psychological Bulletin, 138, 296321. DOI: 10.1037/a0026556
  30. Frey, M., & Detterman, D. (2004). Scholastic assessment or g? The relationship between the Scholastic Assessment Test and general cognitive ability. Psychological Science, 15, 373378. DOI: 10.1111/j.0956-7976.2004.00687.x
  31. Gignac, G. (2018). Socially desirable responding suppresses the association between self-assessed intelligence and task-based intelligence. Intelligence, 69, 5058. DOI: 10.1016/j.intell.2018.05.003
  32. Gignac, G., & Zajenkowski, M. (2020). The Dunning-Kruger effect is (mostly) a statistical artefact: Valid approaches to testing the hypothesis with individual differences data. Intelligence, 80, 101449. DOI: 10.1016/j.intell.2020.101449
  33. Grieve, R., & Mahar, D. (2013). Can social intelligence be measured? Psychometric properties of the Tromsø Social Intelligence Scale–English version. The Irish Journal of Psychology, 34, 112. DOI: 10.1080/03033910.2012.737758
  34. Grüning, D., & Krueger, J. (2022). Strategic thinking in the shadow of self-enhancement: Benefits and costs. PsyArXiv. DOI: 10.31234/osf.io/gtc2m
  35. Harris, A., McMillan, J., Listyg, B., Matzen, L., & Carter, N. (2020). Measuring intelligence with the sandia matrices: Psychometric review and recommendations for free raven-like item sets. Personnel Assessment and Decisions, 6, 6. DOI: 10.25035/pad.2020.03.006
  36. Heck, P., & Krueger, J. (2015). Self-enhancement diminished. Journal of Experimental Psychology: General, 144, 10031020. DOI: 10.1037/xge0000105
  37. Heck, P., & Krueger, J. (2016). Social perception of self-enhancement bias and error. Social Psychology, 47, 327339. DOI: 10.1027/1864-9335/a000287
  38. Heck, P., Simons, D., & Chabris, C. (2018). 65% of Americans believe they are above average in intelligence: Results of two nationally representative surveys. PloS one, 13, e0200103. DOI: 10.1371/journal.pone.0200103
  39. Heider, F., & Simmel, M. (1944). An experimental study of apparent behavior. American Journal of Psychology, 57, 243259. DOI: 10.2307/1416950
  40. Higgins, W., Kaplan, D., Deschrijver, E., & Ross, R. (2023). Construct validity evidence reporting practices for the Reading the mind in the eyes test: A systematic scoping review. Clinical Psychology Review, 102378. DOI: 10.1016/j.cpr.2023.102378
  41. Hoorens, V., Pandelaere, M., Oldersma, F., & Sedikides, C. (2012). The hubris hypothesis: You can self-enhance, but you’d better not show it. Journal of Personality, 80, 12371274. DOI: 10.1111/j.1467-6494.2011.00759.x
  42. Howard, M. C., & Cogswell, J. E. (2018). The “other” relationships of self-assessed intelligence: A meta-analysis. Journal of Research in Personality, 77, 3146. DOI: 10.1016/j.jrp.2018.09.006
  43. Humberg, S., Dufner, M., Schönbrodt, F., Geukes, K., Hutteman, R., Van Zalk, M., … & Back, M. (2018). Enhanced versus simply positive: A new condition-based regression analysis to disentangle effects of self-enhancement from effects of positivity of self-view. Journal of Personality and Social Psychology, 114, 303322. DOI: 10.1037/pspp0000134
  44. Johannesen, J., Fiszdon, J., Weinstein, A., Ciosek, D., & Bell, M. (2018). The Social Attribution Task-Multiple Choice (SAT-MC): Psychometric comparison with social cognitive measures for schizophrenia research. Psychiatry Research, 262, 154161. DOI: 10.1016/j.psychres.2018.02.011
  45. Jones, M., Deckler, E., Laurrari, C., Jarskog, L., Penn, D., Pinkham, A., & Harvey, P. (2020). Confidence, performance, and accuracy of self-assessment of social cognition: a comparison of schizophrenia patients and healthy controls. Schizophrenia Research: Cognition, 19, 100133. DOI: 10.1016/j.scog.2019.01.002
  46. Joseph, D., & Neuman, D. (2010). Emotional intelligence: An integrative meta-analysis and cascading model. Journal of Applied Psychology, 95, 5478. DOI: 10.1037/a0017286
  47. Kittel, A., Olderbak, S., & Wilhelm, O. (2021). Sty in the mind’s eye: A meta-analytic investigation of the nomological network and internal consistency of the “Reading the Mind in the Eyes” test. Assessment, 29, 872895. DOI: 10.1177/1073191121996469
  48. Klar, Y., & Giladi, E. (1999). Are most people happier than their peers, or are they just happy? Personality and Social Psychology Bulletin, 25, 586595. DOI: 10.1177/0146167299025005004
  49. Krueger, J., & Mueller, R. (2002). Unskilled, unaware, or both? The better-than-average heuristic and statistical regression predict errors in estimates of own performance. Journal of Personality and Social Psychology, 82, 180188. DOI: 10.1037/0022-3514.82.2.180
  50. Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77, 11211134. DOI: 10.1037/0022-3514.77.6.1121
  51. Krueger, J., Heck, P., & Asendorpf, J. (2017). Self-enhancement: Conceptualization and assessment. Collabra: Psychology, 3, 111. DOI: 10.1525/collabra.91
  52. Krueger, J., Heck, P., Evans, A., & DiDonato, T. (2020). Social game theory: Preferences, perceptions, and choices. European Review of Social Psychology, 31, 222253. DOI: 10.1080/10463283.2020.1778249
  53. Krueger, J., & Wright, J. (2011). Measurement of selfenhancement (and self-protection). In M. Alicke, & C. Sedikides (Eds.), Handbook of self-enhancement and selfprotection (pp. 472494). New York, NY: Guilford.
  54. Kwan, V., John, O., Kenny, D., Bond, M., & Robins, R. (2004). Reconceptualizing individual differences in self-enhancement bias: An interpersonal approach. Psychological Review, 111, 94110. DOI: 10.1037/0033-295X.111.1.94
  55. Lievens, F., & Chan, D. (2010). Practical intelligence, emotional intelligence, and social intelligence. In J. L. Farr, & N. T. Tippins (Eds.), Handbook of employee selection (pp. 339359). Routledge/Taylor & Francis Group.
  56. Litman, L., Robinson, J., & Abberbock, T. (2017). TurkPrime.com: A versatile crowdsourcing data acquisition platform for the behavioral sciences. Behavior Research Methods, 49, 433442. DOI: 10.3758/s13428-016-0727-z
  57. MacCann, C., Jiang, Y., Brown, L., Double, K., Bucich, M., & Minbashian, A. (2020). Emotional intelligence predicts academic performance: A meta-analysis. Psychological Bulletin, 146, 150186. DOI: 10.1037/bul0000219
  58. MacCann, C., & Roberts, R. (2008). New paradigms for assessing emotional intelligence: theory and data. Emotion, 8, 540551. DOI: 10.1037/a0012746
  59. Malhotra, N., Krosnick, J., & Haertel, E. (2007). The psychometric properties of the GSS Wordsum vocabulary test. GSS Methodological Report, 11, 163.
  60. Martinez, G., Mosconi, E., Daben-Huard, C., Parellada, M., Fananas, L., Gaillard, R., Fatjo-Vilas, M., Krebs, M., & Amado, I. (2019). “A circle and a triangle dancing together”: Alteration of social cognition in schizophrenia compared to autism spectrum disorders. Schizophrenia Research, 210, 94100. DOI: 10.1016/j.schres.2019.05.043
  61. Mayer, J., Caruso, D., & Salovey, P. (2016). The ability model of emotional intelligence: Principles and updates. Emotion Review, 8, 290300. DOI: 10.1177/1754073916639667
  62. Mayer, J., Panter, A., & Caruso, D. (2020). When people estimate their personal intelligence who is overconfident? Who is accurate? Journal of Personality, 88, 11291144. DOI: 10.1111/jopy.12561
  63. Mayer, J., Salovey, P., & Caruso, D. (2004). Emotional intelligence: Theory, findings, and implications. Psychological Inquiry, 15, 197215. DOI: 10.1207/s15327965pli1503_02
  64. McIntosh, R., Moore, A., Liu, Y., & Della Sala, S. (2022). Skill and self-knowledge: empirical refutation of the dual-burden account of the Dunning-Kruger effect. Royal Society Open Science, 9, 191727. DOI: 10.1098/rsos.191727
  65. Mesmer-Magnus, J., Viswesvaran, C., Deshpande, S., & Joseph, J. (2006). Social desirability: The role of over-claiming, self-esteem, and emotional intelligence. Psychology Science, 48, 336356.
  66. Miao, C., Humphrey, R., & Qian, S. (2017). A meta-analysis of emotional intelligence and work attitudes. Journal of Occupational and Organizational Psychology, 90, 177202. DOI: 10.1111/joop.12167
  67. Miller, J., Windschitl, P., Treat, T., & Scherer, A. (2019). Unhealthy and unaware? Misjudging social comparative standing for health-relevant behavior. Journal of Experimental Social Psychology, 85, 103873. DOI: 10.1016/j.jesp.2019.103873
  68. Moore, D., & Healy, P. (2008). The trouble with overconfidence. Psychological Review, 115, 502517. DOI: 10.1037/0033-295X.115.2.502
  69. Murphy, B., & Lilienfeld, S. (2019). Are self-report cognitive empathy ratings valid proxies for cognitive empathy ability? Negligible meta-analytic relations with behavioral task performance. Psychological Assessment, 31, 10621072. DOI: 10.1037/pas0000732
  70. Olderbak, S., & Wilhelm, O. (2020). Overarching principles for the organization of socioemotional constructs. Current Directions in Psychological Science, 29, 6370. DOI: 10.1177/0963721419884317
  71. Olderbak, S., Wilhelm, O., Olaru, G., Geiger, M., Brenneman, M., & Roberts, R. (2015). A psychometric analysis of the reading the mind in the eyes test: Toward a brief form for research and applied settings. Frontiers in Psychology, 6, 15031520. DOI: 10.3389/fpsyg.2015.01503
  72. Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017). Beyond the Turk: Alternative platforms for crowdsourcing behavioral research. Journal of Experimental Social Psychology, 70, 153163. DOI: 10.1016/j.jesp.2017.01.006
  73. Pennycook, G., Cheyne, J., Barr, N., Koehler, D., & Fugelsang, J. (2015). On the reception and detection of pseudo-profound bullshit. Judgment and Decision Making, 10, 549563. DOI: 10.1017/S1930297500006999
  74. Peñuelas-Calvo, I., Sareen, A., Sevilla-Llewellyn-Jones, J., & Fernández-Berrocal, P. (2019). The “Reading the Mind in the Eyes” test in autism-spectrum disorders comparison with healthy controls: a systematic review and meta-analysis. Journal of Autism and Developmental Disorders, 49, 10481061. DOI: 10.1007/s10803-018-3814-4
  75. Ratajska, A., Brown, M., & Chabris, C. (2020). Attributing social meaning to animated shapes: A new experimental study of apparent behavior. American Journal of Psychology, 133, 295312. DOI: 10.5406/amerjpsyc.133.3.0295
  76. Raven, J., Court, J., & Raven, J. (1985). A manual for Raven’s Progressive Matrices and Vocabulary Scales. London: H. K. Lewis.
  77. Realo, A., Allik, J., Nolvak, A., Valk, R., Ruus, T., Schmidt, M., & Eilola, T. (2003). Mind-reading ability: Beliefs and performance. Journal of Research in Personality, 37, 420445. DOI: 10.1016/S0092-6566(03)00021-7
  78. Riggio, R. E. (1986). Assessment of basic social skills. Journal of Personality and Social Psychology, 51, 649660. DOI: 10.1037/0022-3514.51.3.649
  79. Roberts, S., Bareket-Shavit, C., Dollins, F., Goldie, P., & Mortenson, E. (2020). Racial inequality in psychological research: Trends of the past and recommendations for the future. Perspectives on Psychological Science, 15, 12951309. DOI: 10.1177/1745691620927709
  80. Rosenthal, R. (2014). Binomial Effect Size Display. In Wiley StatsRef: Statistics Reference Online N. Balakrishnan, T. Colton, B. Everitt, W. Piegorsch, F. Ruggeri & J. L. Teugels) (Eds.). DOI: 10.1002/9781118445112.stat06256
  81. Schlegel, K., & Mortillaro, M. (2019). The Geneva Emotional Competence Test (GECo): An ability measure of workplace emotional intelligence. Journal of Applied Psychology, 104, 559580. DOI: 10.1037/apl0000365
  82. Sheldon, O., Dunning, D., & Ames, D. (2014). Emotionally unskilled, unaware, and uninterested in learning more: Reactions to feedback about deficits in emotional intelligence. Journal of Applied Psychology, 99, 125137. DOI: 10.1037/a0034138
  83. Silberstein, J., Pinkham, A., Penn, D., & Harvey, P. (2018). Self assessment of social cognitive ability in schizophrenia: Association with social cognitive test performance, informant assessments of social cognitive ability, and everyday outcomes. Schizophrenia Research, 199, 7582. DOI: 10.1016/j.schres.2018.04.015
  84. Silvera, D., Martinussen, M., & Dahl, T. (2001). The Tromsø Social Intelligence Scale, a self-report measure of social intelligence. Scandinavian Journal of Psychology, 42, 313319. DOI: 10.1111/1467-9450.00242
  85. Sezer, O., Gino, F., & Norton, M. (2018). Humblebragging: A distinct—and ineffective—self-presentation strategy. Journal of Personality and Social Psychology, 114, 5274. DOI: 10.1037/pspi0000108
  86. Speer, A., Christiansen, N., & Laginess, A. (2019). Social intelligence and interview accuracy: Individual differences in the ability to construct interviews and rate accurately. International Journal of Selection and Assessment, 27, 104128. DOI: 10.1111/ijsa.12237
  87. Stanton, J., Sinar, E., Balzer, W., & Smith, P. (2002). Issues and strategies for reducing the length of self-report scales. Personnel Psychology, 55, 167194. DOI: 10.1111/j.1744-6570.2002.tb00108.x
  88. Sternberg, R. J., Conway, B. E., Ketron, J. L., & Bernstein, M. (1981). People’s conceptions of intelligence. Journal of Personality and Social Psychology, 41, 3755. DOI: 10.1037/0022-3514.41.1.37
  89. Tappin, B., & McKay, R. (2017). The illusion of moral superiority. Social Psychological and Personality Science, 8, 623631. DOI: 10.1177/1948550616673878
  90. Trzesniewski, K., Donnellan, M., & Robins, R. (2008). Do today’s young people really think they are so extraordinary? An examination of secular trends in narcissism and self-enhancement. Psychological Science, 19, 181188. DOI: 10.1111/j.1467-9280.2008.02065.x
  91. Watson, D., Hubbard, B., & Wiese, D. (2000). Self–other agreement in personality and affectivity: The role of acquaintanceship, trait visibility, and assumed similarity. Journal of Personality and Social Psychology, 78, 546558. DOI: 10.1037/0022-3514.78.3.546
  92. Wilson, A. (2021). Do animated triangles reveal a marked difficulty among autistic people with reading minds? Autism, 25, 11751186. DOI: 10.1177/1362361321989152
  93. Wosinka, W., Dabul, A., Whetstone-Dion, R., & Cialdini, R. (1996). Self-presentational responses to success in the organization: The costs and benefits of modesty. Basic and Applied Social Psychology, 18, 229242. DOI: 10.1207/s15324834basp1802_8
  94. Zell, E., & Krizan, Z. (2014). Do people have insight into their abilities? A metasynthesis. Perspectives on Psychological Science, 9, 111125. DOI: 10.1177/1745691613518075
  95. Zell, E., Strickhouser, J., Sedikides, C., & Alicke, M. (2020). The better-than-average effect in comparative self-evaluation: A comprehensive review and meta-analysis. Psychological Bulletin, 146, 118149. DOI: 10.1037/bul0000218
  96. Zhou, X., & Jenkins, R. (2020). Dunning-Kruger effects in face perception. Cognition, 203, 104345. DOI: 10.1016/j.cognition.2020.104345
DOI: https://doi.org/10.5334/spo.78 | Journal eISSN: 2752-5341
Language: English
Submitted on: Jan 31, 2024
|
Accepted on: Apr 3, 2024
|
Published on: Apr 18, 2024
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2024 Patrick R. Heck, Matt I. Brown, Christopher F. Chabris, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.