Applying Game-Based Approaches in Personnel Selection: a Systematic Literature Review

Aouam, Hamza; Belmouffeq, Bouchra; Mahil, Aziza

doi:10.2478/mdke-2023-0002

Abstract

Gamification has expanded dramatically in the field of human resource management in recent years. Research that has examined the influence of gamification on changes in candidates' perceptions of personnel selection is still expanding, as the majority of academic work in gamification is related to the field of education. This paper aims to investigate how job seekers perceive selection assessment tools based on gamification through a systematic review. The systematic review contains articles published between 2010 and 2022 and indexed in five databases. In the first stage, 5260 articles are included in our search. We chose as exclusion criteria articles published before 2010, references other than journal articles, reviews, and conference articles. Furthermore, we excluded articles published in languages other than English and French, off-topic articles. After assessing all the references, we selected 21 articles following PRISMA statement. The results highlighted 21 scientific articles covering the following themes: candidates' reactions to gamification tools and serious games, candidates' reactions to gamified selection tests, advantages and limits of gamification, and the performance level of candidates regarding the use of gamification. Limitations and implications for future research were discussed.

References

Akoodie, Y. (2020). Gamification in psychological assessment in South Africa: A narrative review. African Journal of Psychological Assessment, 2, 1-10. https://doi.org/10.4102/ajopa.v2i0.24
Search in Google Scholar Back to article
Armstrong, M. B., Ferrell, J. Z., Collmus, A. B., & Landers, R. N. (2016). Correcting misconceptions about gamification of assessment: more than SJTs and badges. Industrial and Organizational Psychology, 9(3), 671–677. https://doi.org/10.1017/iop.2016.69
Search in Google Scholar Back to article
Arvey, R. D., & Sackett, P. R. (1993). Fairness in selection: Current developments and perspectives. In N. Schmitt & W. Borman (Eds.), Personnel selection in organizations (pp. 171–202). Jossey-Bass.
Search in Google Scholar Back to article
Attali, Y., & Arieli-Attali, M. (2015). Gamification in assessment: Do points affect test performance? Computers & Education, 83, 57–63. https://doi.org/10.1016/j.compedu.2014.12.012
Search in Google Scholar Back to article
Beck, L. A. (1992). Csikszentmihalyi, Mihaly. (1990). Flow: the psychology of optimal experience. Journal of Leisure Research, 24(1), 93–94. https://doi.org/10.1080/00222216.1992.11969876
Search in Google Scholar Back to article
Bies, R. J., & Moag, J. F. (1986). Interactional justice: communication criteria of fairness. In R. J. Lewicki, B. H. Sheppard, & M. H. Bazerman (Eds.), Research on negotiations in organizations (pp. 43-55). Greenwich.
Search in Google Scholar Back to article
Bourgonjon, J., Valcke, M., Soetaert, R., & Schellens, T. (2010). Students’ perceptions about the use of video games in the classroom. Computers & Education, 54(4), 1145–1156. https://doi.org/10.1016/j.compedu.2009.10.022
Search in Google Scholar Back to article
Buil, I., Catalán, S., & Martínez, E. (2020). Understanding applicants’ reactions to gamified recruitment. Journal of Business Research, 110, 41–50. https://doi.org/10.1016/j.jbusres.2019.12.041
Search in Google Scholar Back to article
Buil, I., Catalán, S., & Ortega, R. (2019). Gamification and motivation: new tools for talent acquisition. UCJC Business and Society Review, 63, 146–161. https://doi.org/10.3232/UBR.2019.V16.N3.04
Search in Google Scholar Back to article
Collmus, A. B., & Landers, R. N. (2019). Game-framing to improve applicant perceptions of cognitive assessments. Journal of Personnel Psychology, 18(3), 157–162. https://doi.org/10.1027/1866-5888/a000227
Search in Google Scholar Back to article
Colquitt, J. A. (2001). On the dimensionality of organizational justice: A construct validation of a measure. Journal of Applied Psychology, 86(3), 386–400. https://doi.org/10.1037/0021-9010.86.3.386
Search in Google Scholar Back to article
Colquitt, J. A., Greenberg, J., & Zapata-Phelan, C. P. (2005). What is organizational justice? A historical overview. In J. Greenberg & J. Colquitt (Eds.), Handbook of organizational justice (pp. 3–56). Lawrence Erlbaum Associates Publishers.
Search in Google Scholar Back to article
Constantin, V. D., & Stoenescu R. D. (2015, April 23-24). Gamification in the recruitment process: studying Romanian potential employees’ perception [Paper presentation]. The 11th International Scientific Conference “eLearning and Software for Education”, Bucharest, Romania. https://doi.org/10.12753/2066-026X-15-098
Search in Google Scholar Back to article
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information Technology. MIS Quarterly, 13(3), 319. https://doi.org/10.2307/249008
Search in Google Scholar Back to article
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2014). Du game design au gamefulness: Définir la gamification. Sciences du Jeu, 2. https://doi.org/10.4000/sdj.287
Search in Google Scholar Back to article
Ellison, L. J., McClure Johnson, T., Tomczak, D., Siemsen, A., & Gonzalez, M. F. (2020). Game on! Exploring reactions to game-based selection assessments. Journal of Managerial Psychology, 35(4), 241–254. https://doi.org/10.1108/JMP-09-2018-0414
Search in Google Scholar Back to article
Galois-Faurie, I., & Lacroux, A. (2014). « Serious games » et recrutement: Quels enjeux de recherche en gestion des ressources humaines ? @GRH, 10(1), 11. https://doi.org/10.3917/grh.141.0011
Search in Google Scholar Back to article
Gangadharbatla, H., & Davis, D. Z. (Eds.). (2016). Emerging research and trends in gamification. IGI Global. https://doi.org/10.4018/978-1-4666-8651-9
Search in Google Scholar Back to article
Georgiou, K. (2021). Can explanations improve applicant reactions towards gamified assessment methods? International Journal of Selection and Assessment, 00,1–16. https://doi.org/10.1111/ijsa.12329
Search in Google Scholar Back to article
Georgiou, K., Gouras, A., & Nikolaou, I. (2019). Gamification in employee selection: The development of a gamified assessment. International Journal of Selection and Assessment, 27(2), 91–103. https://doi.org/10.1111/ijsa.12240
Search in Google Scholar Back to article
Georgiou, K., & Nikolaou, I. (2020). Are applicants in favor of traditional or gamified assessment methods? Exploring applicant reactions towards a gamified selection method. Computers in Human Behavior, 109, 106356. https://doi.org/10.1016/j.chb.2020.106356
Search in Google Scholar Back to article
Gilliland, S. W. (1993). The perceived fairness of selection systems: An organizational justice perspective. The Academy of Management Review, 18(4), 694–734. https://doi.org/10.2307/258595
Search in Google Scholar Back to article
Gkorezis, P., Georgiou, K., Nikolaou, I., & Kyriazati, A. (2020). Gamified or traditional situational judgement test? A moderated mediation model of recommendation intentions via organizational attractiveness. European Journal of Work and Organizational Psychology, 30(2), 240–250. https://doi.org/10.1080/1359432X.2020.1746827
Search in Google Scholar Back to article
Godollei, A., & Chapman, D. (2017). Gamified cognitive assessments in selection: validity, discrimination and applicant reactions. Academy of Management, 1(2016). https://doi.org/10.5465/ambpp.2016.312
Search in Google Scholar Back to article
Hommel, B. E., Ruppel, R., & Zacher, H. (2021). Assessment of cognitive flexibility in personnel selection: Validity and acceptance of a gamified version of the Wisconsin Card Sorting Test. International Journal of Selection and Assessment, 30(1), 126–144. https://doi.org/10.1111/ijsa.12362
Search in Google Scholar Back to article
Khan, M., Shaikh, H. R., Memon, A. M., & Kazi, A. G. (2019). Willingness of gamified recruitment and selection among job seekers of Sindh, Pakistan. Journal of Management Info, 6(4), 15–22. https://doi.org/10.31580/jmi.v6i4.1156
Search in Google Scholar Back to article
Kravitz, D. A., Stinson, V., & Chavez, T. L. (1996). Evaluations of tests used for making selection and promotion decisions. International Journal of Selection and Assessment, 4(1), 24-34. https://doi.org/10.1111/j.1468-2389.1996.tb00045.x
Search in Google Scholar Back to article
Lacroux, A., & Martin-Lacroux, C. (2021). L’Intelligence artificielle au service de la lutte contre les discriminations dans le recrutement: Nouvelles promesses et nouveaux risques. Management & Avenir, 122(2), 121–142. https://doi.org/10.3917/mav.122.0121
Search in Google Scholar Back to article
Landers, R. N. (2014). Developing a theory of gamified learning: Linking serious games and gamification of learning. Simulation & Gaming, 45(6), 752–768. https://doi.org/10.1177/1046878114563660
Search in Google Scholar Back to article
Landers, R. N., Auer, E. M., & Abraham, J. D. (2020). Gamifying a situational judgment test with immersion and control game elements: Effects on applicant reactions and construct validity. Journal of Managerial Psychology, 35(4), 225–239. https://doi.org/10.1108/JMP-10-2018-0446
Search in Google Scholar Back to article
Laumer, S., Eckhardt, A., & Weitzel, T. (2012). Online gaming to find a new job—examining job seekers’ intention to use serious games as a self-assessment tool. German Journal of Research in Human Resource Management, 26(3), 218–240. https://doi.org/10.1177/239700221202600302
Search in Google Scholar Back to article
Leventhal, G. S. (1980). What should be done with equity theory? In K. J. Gergen, M. S. Greenberg & R. H. Willis (Eds.), Social exchanges: advances in theory and research (pp. 27-55).Plenum. http://dx.doi.org/10.1007/978-1-4613-3087-5_2
Search in Google Scholar Back to article
Levy, R. (2013). Psychometric and evidentiary advances, opportunities, and challenges for simulation-based assessment. Educational Assessment, 18(3), 182–207. https://doi.org/10.1080/10627197.2013.814517
Search in Google Scholar Back to article
Marzucco, L., & Hansez, I. (2013). Etude des perceptions d’équité des candidats dans une situation de sélection: Influence de la justice procédurale et distributive. Psychologie du Travail et des Organisations, 19(1), 45–70. https://doi.org/10.1016/S1420-2530(16)30068-1
Search in Google Scholar Back to article
Mateo, S. (2020). Procédure pour conduire avec succès une revue de littérature selon la méthode PRISMA. Kinésithérapie, la Revue, 20(226), 29–37. https://doi.org/10.1016/j.kine.2020.05.019
Search in Google Scholar Back to article
Mavridis, A., & Tsiatsos, T. (2017). Game-based assessment: Investigating the impact on test anxiety and exam performance: Game-based assessment. Journal of Computer Assisted Learning, 33(2), 137–150. https://doi.org/10.1111/jcal.12170
Search in Google Scholar Back to article
Melchers, K. G., & Basch, J. M. (2021). Fair play? Sex-, age-, and job-related correlates of performance in a computer-based simulation game. International Journal of Selection and Assessment, 30(1), 48–61. https://doi.org/10.1111/ijsa.12337
Search in Google Scholar Back to article
Mislevy, R. J., Oranje, A., Bauer, M., von Davier, A. A., Hao, J., Corrigan, S., & John, M. (2014). Psychometric considerations in game-based assessment. GlassLab. http://www.instituteofplay.org/wp-content/uploads/2014/02/GlassLab_GBA1_WhitePaperFull.pdf
Search in Google Scholar Back to article
Montefiori, L. (2016). Game-based assessment: Face validity, fairness perception, and impact on employer’s brand image. Assessment and Development Matters, 8(2), 19-22.
Search in Google Scholar Back to article
National Center for Research on Evaluation, Standards, Student Testing. (2010). Automated assessment complex task performance in games and simulations. CRESST Research report. https://files.eric.ed.gov/fulltext/ED512656.pdf
Search in Google Scholar Back to article
Nikolaou, I., Georgiou, K., & Kotsasarlidou, V. (2019). Exploring the Relationship of a Gamified Assessment with Performance. The Spanish Journal of Psychology, 22, E6. https://doi.org/10.1017/sjp.2019.5
Search in Google Scholar Back to article
Schuler, H. (1993). Social validity of selection situations: A concept and some empirical results. In H. Schuler, J. Farr & M. Smith (Eds.), Personnel selection and assessment: Individual and organizational perspectives (pp. 11–26). Lawrence Erlbaum Associates.
Search in Google Scholar Back to article
Stanescu, D., Ioniţă, C., & Ioniţă, A. (2020). Game thinking in personnel recruitment and selection: advantages and disadvantages. Postmodern Openings, 11(2), 267-276. https://doi.org/10.18662/po/11.2/174
Search in Google Scholar Back to article
Stanescu, D., Tosca, A., & Ioniţă, C. (2018). Game-based assessment - the new revolution of candidates’ assessment. In C. Bratianu, A. Zbuchea, & A. Vitelar (Eds.), Strategica: challenging the status quo in management and economics (pp. 480–489). Tritonic Publishing House. https://www.webofscience.com/wos/woscc/summary/c73feb74-7e7f-433c-8ff3-3197290c5111-2fcd915e/relevance/4
Search in Google Scholar Back to article
Steiner, D. D., & Gilliland, S. W. (1996). Fairness reactions to personnel selection techniques in France and the United States. Journal of Applied Psychology, 81(2), 134–141. https://doi.org/10.1037/0021-9010.81.2.134
Search in Google Scholar Back to article
Tosca, A., Ioniţă, C., Stanescu, D., & Stanciu, A. (2019). Innovative solutions for online recruitment – gamified assessment. Postmodern Openings, 10(1), 151-164. https://doi.org/10.18662/po/59
Search in Google Scholar Back to article
Ventura, M., & Shute, V. (2013). The validity of a game-based assessment of persistence. Computers in Human Behavior, 29(6), 2568–2572. https://doi.org/10.1016/j.chb.2013.06.033
Search in Google Scholar Back to article
Willis, C., Powell-Rudy, T., Colley, K., & Prasad, J. (2021). Examining the use of game-based assessments for hiring autistic job seekers. Journal of Intelligence, 9(4), 53. https://doi.org/10.3390/jintelligence9040053
Search in Google Scholar Back to article
Woźniak, J. (2015). The use of gamification at different levels of e-recruitment. Management Dynamics in the Knowledge Economy, 3(2), 257-278. http://bit.ly/3ThmHjl
Search in Google Scholar Back to article

Applying Game-Based Approaches in Personnel Selection: a Systematic Literature Review

Abstract

Paradigm

My account