Have a personal or library account? Click to login
Investigating the Road to Equity: A Scoping Review of Solutions to Mitigate Implicit Bias in Assessment within Medical Education Cover

Investigating the Road to Equity: A Scoping Review of Solutions to Mitigate Implicit Bias in Assessment within Medical Education

Perspectives on Medical Education
Volume 14 (2025): Issue 1
By: Kristin E. Mangalindan,  Tasha R. Wyatt,  Kirsten R. Brown,  Marina Shapiro and  Lauren A. Maggio  
Open Access
|Mar 2025

References

  1. 1Solomon SR, Atalay AJ, Osman NY. Diversity Is Not Enough: Advancing a Framework for Antiracism in Medical Education. Acad Med. 2021;96(11):1513–7. DOI: 10.1097/ACM.0000000000004251
    Back to article
  2. 2Corrice A. Unconscious Bias in Faculty and Leadership Recruitment: A Literature Review. Association of American Medical Colleges [Internet]. 2009; 9.
    Back to article
  3. 3Rojek AE, Khanna R, Yim JWL, Gardner R, Lisker S, Hauer KE, et al. Differences in Narrative Language in Evaluations of Medical Students by Gender and Under-represented Minority Status. J Gen Intern Med. 2019;34(5):684–91. DOI: 10.1007/s11606-019-04889-9
    Back to article
  4. 4Zhang N, Blissett S, Anderson D, O’Sullivan P, Qasim A. Race and Gender Bias in Internal Medicine Program Director Letters of Recommendation. J Grad Med Educ. 2021;13(3):335–44. DOI: 10.4300/JGME-D-20-00929.1
    Back to article
  5. 5Teherani A, Hauer KE, Fernandez A, King, TE Jr., Lucey C. How Small Differences in Assessed Clinical Performance Amplify to Large Differences in Grades and Awards: A Cascade With Serious Consequences for Students Underrepresented in Medicine. Acad Med. 2018;93(9):1286–92. DOI: 10.1097/ACM.0000000000002323
    Back to article
  6. 6Hill KA, Desai MM, Chaudhry SI, Nguyen M, McDade W, Xu Y, et al. Association of Marginalized Identities With Alpha Omega Alpha Honor Society and Gold Humanism Honor Society Membership Among Medical Students. JAMA Netw Open. 2022;5(9):e2229062. DOI: 10.1001/jamanetworkopen.2022.29062
    Back to article
  7. 7Yoo A, George BP, Auinger P, Strawderman E, Paul DA. Representation of Women and Underrepresented Groups in US Academic Medicine by Specialty. JAMA Netw Open. 2021;4(8):e2123512. DOI: 10.1001/jamanetworkopen.2021.23512
    Back to article
  8. 8Kaplan SE, Raj A, Carr PL, Terrin N, Breeze JL, Freund KM. Race/Ethnicity and Success in Academic Medicine: Findings From a Longitudinal Multi-Institutional Study. Acad Med. 2018;93(4):616–22. DOI: 10.1097/ACM.0000000000001968
    Back to article
  9. 9Pearce J, Tavares W. A philosophical history of programmatic assessment: tracing shifting configurations. Adv Health Sci Educ. 2021;26(4):1291–310. DOI: 10.1007/s10459-021-10050-1
    Back to article
  10. 10Kakara Anderson HL, Govaerts M, Abdulla L, Balmer DF, Busari JO, West DC. Clarifying and expanding equity in assessment by considering three orientations: Fairness, inclusion and justice. Med Educ. 2024. DOI: 10.1111/medu.15534
    Back to article
  11. 11Ismaeel R, Pusic LJ, Gottlieb M, Chan TM, Oyedokun TO, Thoma B. Bias in Observed Assessments in Medical Education: A Scoping Review. Acad Med. 2024. DOI: 10.1097/ACM.0000000000005794
    Back to article
  12. 12Gottlieb M, Davenport D, Landry A, Bailey J, Westrick J, Daniel M. Holistic Review in Applicant Selection: A Scoping Review. Acad Med. 2024. DOI: 10.1097/ACM.0000000000005891
    Back to article
  13. 13Arksey H, O’Malley L. Scoping studies: towards a methodological framework. International Journal of Social Research Methodology. 2005;8(1):19–32. DOI: 10.1080/1364557032000119616
    Back to article
  14. 14Levac D, Colquhoun H, O’Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5:69. DOI: 10.1186/1748-5908-5-69
    Back to article
  15. 15Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169(7):467–73. DOI: 10.7326/M18-0850
    Back to article
  16. 16Nivet MA, editor. Achieving Health Equity Through Inclusion and Innovation. Association of American Medical Colleges; 2010; Washington, DC; 2010.
    Back to article
  17. 17Rivers AM, Rees HR, Calanchini J, Sherman JW. Implicit Bias Reflects the Personal and the Social. Psychological Inquiry. 2017;28(4):301–5. DOI: 10.1080/1047840X.2017.1373549
    Back to article
  18. 18Saldana J. The coding manual for qualitative researchers. Thousand Oaks, CA: SAGE Publication; 2021.
    Back to article
  19. 19Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology. 2006;3(2):77–101. DOI: 10.1191/1478088706qp063oa
    Back to article
  20. 20Byrne D. A worked example of Braun and Clarke’s approach to reflexive thematic analysis. Quality & Quantity. 2022;56(3):1391–412. DOI: 10.1007/s11135-021-01182-y
    Back to article
  21. 21Teherani A, Harleman E, Hauer KE, Lucey C. Toward Creating Equity in Awards Received During Medical School: Strategic Changes at One Institution. Acad Med. 2020;95(5):724–9. DOI: 10.1097/ACM.0000000000003219
    Back to article
  22. 22Rosales V, Conley C, Norris MC. Racial and Ethnic Disparities in Situational Judgment Testing Among Applicants to an Anesthesiology Residency Program. J Grad Med Educ. 2024;16(2):140–5. DOI: 10.4300/JGME-D-23-00360.1
    Back to article
  23. 23Gustafson CE, Johnson CJ, Beck Dallaghan GL, Knight OJ, Malloy KM, Nichols KR, et al. Evaluating situational judgment test use and diversity in admissions at a southern US medical school. PLoS One. 2023;18(2):e0280205. DOI: 10.1371/journal.pone.0280205
    Back to article
  24. 24Agarwal V, Mullins ME, Mainiero MB, Suh RD, Chetlen AL, Lewis PJ. The ADVICER Template for Faculty Reviewer Letters for Promotion and Appointment. Acad Rad. 2022;29(9):1413–6. DOI: 10.1016/j.acra.2021.12.027
    Back to article
  25. 25Arnold MJ, Dong T, Liotta R, Saguil AA, Durning SJ. Does Masking MCAT Scores During Admissions Increase Equity? Acad Med. 2023. DOI: 10.1097/ACM.0000000000005434
    Back to article
  26. 26Babal JC, Webber S, Nacht CL, Nackers KAM, Tiedt K, Allen A, et al. Recognizing and Mitigating Gender Bias in Medical Teaching Assessments. J Grad Med Educ. 2022;14(2):139–43. DOI: 10.4300/JGME-D-21-00774.1
    Back to article
  27. 27Ballejos MP, Fortner S, Reira J, Hartley RS, Romero-Leggott V, Sapién RE. Applying holistic review practices to a Combined Baccalaureate/Medical Degree Program: Reflections on lessons learned. J Nat Med Assoc. 2023;115(3):326–32. DOI: 10.1016/j.jnma.2023.03.006
    Back to article
  28. 28Bandiera G, Abrahams C, Ruetalo M, Hanson MD, Nickell L, Spadafora S. Identifying and Promoting Best Practices in Residency Application and Selection in a Complex Academic Health Network. Acad Med. 2015;90(12):1594–601. DOI: 10.1097/ACM.0000000000000954
    Back to article
  29. 29Barceló NE, Shadravan S, Wells CR, Goodsmith N, Tarrant B, Shaddox T, et al. Reimagining Merit and Representation: Promoting Equity and Reducing Bias in GME Through Holistic Review. Acad Psych. 2021;45(1):34–42. DOI: 10.1007/s40596-020-01327-5
    Back to article
  30. 30Buchanan AO, Strano-Paul L, Saudek K, Lupi C, Jones L, Wagner MJ, et al. Preparing Effective Narrative Evaluations for the Medical School Performance Evaluation (MSPE). MedEdPORTAL. 2022;18:11277. DOI: 10.15766/mep_2374-8265.11277
    Back to article
  31. 31Burk-Rafel J, Reinstein I, Feng J, Kim MB, Miller LH, Cocks PM, et al. Development and Validation of a Machine Learning-Based Decision Support Tool for Residency Applicant Screening and Review. Acad Med. 2021;96(11S):S54–S61. DOI: 10.1097/ACM.0000000000004317
    Back to article
  32. 32Caldwell LS, Garcia-Fleury I, An Q, Lawler EA. Does Removing the Photograph and Name Change the Reviewer’s Perception of Orthopaedic Residency Applicants? J Am Acad Orthop Surg. 2021;29(21):937–42. DOI: 10.5435/JAAOS-D-20-00213
    Back to article
  33. 33Chi B, Krull C, Akamagwuna U, Huang D. Incorporating Holistic Review in Recruitment in a Physical Medicine and Rehabilitation Residency Program. Am J Phys Med Rehabil. 2022;101(9):859–63. DOI: 10.1097/PHM.0000000000002000
    Back to article
  34. 34Clapp JT, Heins SJ, Gaulton TG, Kleid MA, Lane-Fall MB, Aysola J, et al. Does Masked Interviewing Encourage Holistic Review in Residency Selection? A Mixed-Methods Study. Teach Learn Med. 2023. DOI: 10.1080/10401334.2023.2204074
    Back to article
  35. 35Colson ER, Perez M, Blaylock L, Jeffe DB, Lawrence SJ, Wilson SA, et al. Washington University School of Medicine in St. Louis Case Study: A Process for Understanding and Addressing Bias in Clerkship Grading. Acad Med. 2020;95(12S Addressing Harmful Bias and Eliminating Discrimination in Health Professions Learning Environments):S131–S5. DOI: 10.1097/ACM.0000000000003702
    Back to article
  36. 36Desy J, Coderre S, Davis M, Cusano R, McLaughlin K. How can we reduce bias during an academic assessment reappraisal? Med Teach. 2019;41(11):1315–8. DOI: 10.1080/0142159X.2019.1638503
    Back to article
  37. 37Diaz T, Navarro JR, Chen EH. An Institutional Approach to Fostering Inclusion and Addressing Racial Bias: Implications for Diversity in Academic Medicine. Teach Learn Med. 2020;32(1):110–6. DOI: 10.1080/10401334.2019.1670665
    Back to article
  38. 38Edman J, Takacs EB, Tracy CR. Successful integration of blinded interviews for resident selection: applicant and faculty perspective. Urology. 2023. DOI: 10.1016/j.urology.2023.07.032
    Back to article
  39. 39Eisenberg MA, Deboever N, Swisher SG, Vaporciyan AA, Hetz RA, Antonoff MB. Removing Implicit Bias From Cardiothoracic Surgery Resident Recruitment: Changing the Paradigm. J Surg Res. 2023;292:72–8. DOI: 10.1016/j.jss.2023.07.024
    Back to article
  40. 40Elks ML, Herbert-Carter J, Smith M, Klement B, Knight BB, Anachebe NF. Shifting the Curve: Fostering Academic Success in a Diverse Student Body. Acad Med. 2018;93(1):66–70. DOI: 10.1097/ACM.0000000000001783
    Back to article
  41. 41Elmaraghi S, Rao VK, Christie BM. Linear Modeling to Reduce Bias in Plastic Surgery Residency Selection. Plast Reconstr Surg. 2021;147(3):538–44. DOI: 10.1097/PRS.0000000000007684
    Back to article
  42. 42Epstein S, Konuthula N, Meyer TK, Whipple ME, Bowe SN, Bly RA, et al. Implementing a “Distance Traveled” Question to Improve Resident Diversity: Process and Feasibility. OTO Open. 2022;6(3). DOI: 10.1177/2473974X221113847
    Back to article
  43. 43Gallegos M, Landry A, Alvarez A, Davenport D, Caldwell MT, Parsons M, et al. Holistic Review, Mitigating Bias, and Other Strategies in Residency Recruitment for Diversity, Equity, and Inclusion: An Evidence-based Guide to Best Practices from the Council of Residency Directors in Emergency Medicine. West J Emerg Med. 2022;23(3):345–52. DOI: 10.5811/westjem.2022.3.54419
    Back to article
  44. 44Gardner AK, D’Onofrio BC, Dunkin BJ. Can We Get Faculty Interviewers on the Same Page? An Examination of a Structured Interview Course for Surgeons. J Surg Educ. 2018;75(1):72–7. DOI: 10.1016/j.jsurg.2017.06.006
    Back to article
  45. 45Girod S, Fassiotto M, Grewal D, Ku MC, Sriram N, Nosek BA, et al. Reducing Implicit Gender Leadership Bias in Academic Medicine With an Educational Intervention. Acad Med. 2016;91(8):1143–50.
    Back to article
  46. 46Grabowski CJ. Impact of holistic review on student interview pool diversity. Adv Health Sci Educ Theory Pract. 2018;23(3):487–98. DOI: 10.1007/s10459-017-9807-9
    Back to article
  47. 47Hoff ML, Liao NN, Mosquera CA, Saucedo A, Wallihan RG, Walton JR, et al. An initiative to increase residency program diversity. Peds. 2022;149(1):1–9. DOI: 10.1542/peds.2021-050964
    Back to article
  48. 48Hughes RH, Kleinschmidt S, Sheng AY. Using structured interviews to reduce bias in emergency medicine residency recruitment: Worth a second look. AEM Educ Train. 2021;5(Suppl 1):S130–S4. DOI: 10.1002/aet2.10562
    Back to article
  49. 49Javier D, Solis LG, Paul MF, Thompson EL, Maynard G, Latif Z, et al. Implementation of an unconscious bias course for the National Research Mentoring Network. BMC Med Educ. 2022;22(1):391. DOI: 10.1186/s12909-022-03466-9
    Back to article
  50. 50Joy TR. Strategies For Enhancing Equity, Diversity, and Inclusion in Medical School Admissions-A Canadian Medical School’s Journey. Front Public Health. 2022;10:879173. DOI: 10.3389/fpubh.2022.879173
    Back to article
  51. 51Kallianos KG, Webb EM, Hess CP, Talbott J, Bucknor MD. Use of the Implicit Association Test to Improve Diversity in Radiology. J Am Coll Radiol. 2019;16(7):976–9. DOI: 10.1016/j.jacr.2019.01.010
    Back to article
  52. 52Kinnear B, Weber DE, Schumacher DJ, Edje L, Warm EJ, Anderson HL. Reconstructing Neurath’s Ship: A Case Study in Reevaluating Equity in a Program of Assessment. Acad Med. 2023. DOI: 10.1097/ACM.0000000000005249
    Back to article
  53. 53Kiraly L, Dewey E, Brasel K. Hawks and Doves: Adjusting for Bias in Residency Interview Scoring. J Surg Educ. 2020;77(6):e132–e7. DOI: 10.1016/j.jsurg.2020.08.013
    Back to article
  54. 54Konuthula D, Cameron FD, Jonassaint N, Ufomata E, Torres O, Essien UR, et al. Perspectives on Anti-Black Racism and Mitigation Strategies Among Faculty Experts at Academic Medical Centers. JAMA Network Open. 2022;5(4). DOI: 10.1001/jamanetworkopen.2022.8534
    Back to article
  55. 55Lai SH, Suarez-Pierre A, Jaiswal K, Travis C, Steward L, Nehler M, et al. Implementation of a Holistic Review Process of US Allopathic Medical Students Eliminates Non-Comparable Metrics and Bias in General Surgery Residency Interview Invitations. J Surg Educ. 2023. DOI: 10.1016/j.jsurg.2023.07.008
    Back to article
  56. 56Langhan ML, Goldman MP, Tiyyagura G. Can Behavior-Based Interviews Reduce Bias in Fellowship Applicant Assessment? Acad Pediatr. 2022;22(3):478–85. DOI: 10.1016/j.acap.2021.12.017
    Back to article
  57. 57Lau CO, Johnson AB, Nolder AR, King D, Strub GM. A novel algorithm to reduce bias and improve the quality and diversity of residency interviewees. Laryngoscope Investig Otolaryngol. 2022;7(5):1367–75. DOI: 10.1002/lio2.908
    Back to article
  58. 58Lucey CR, Hauer KE, Boatright D, Fernandez A. Medical Education’s Wicked Problem: Achieving Equity in Assessment for Medical Learners. Acad Med. 2020;95(12S Addressing Harmful Bias and Eliminating Discrimination in Health Professions Learning Environments): S98–S108. DOI: 10.1097/ACM.0000000000003717
    Back to article
  59. 59Lupton KL, O’Sullivan PS. How Medical Educators Can Foster Equity and Inclusion in Their Teaching: A Faculty Development Workshop Series. Acad Med. 2020;95(12):S71–S6. DOI: 10.1097/ACM.0000000000003687
    Back to article
  60. 60Parkas V, Maysonet J, Chudow J, Hess L, Swartz TH. “Time-In”: A Tool for Interrupting Bias in Medical School Admissions Committee Meetings. Acad Med. 2023;98(5):580–4. DOI: 10.1097/ACM.0000000000005082
    Back to article
  61. 61Nehemiah A, Roberts SE, Song Y, Kelz RR, Butler PD, Morris JB, et al. Looking Beyond the Numbers: Increasing Diversity and Inclusion Through Holistic Review in General Surgery Recruitment. J Surg Educ. 2021;78(3):763–9. DOI: 10.1016/j.jsurg.2020.08.048
    Back to article
  62. 62Shaffrey EC, Moura SP, Wirth PJ, Attaluri PK, Schappe A, Edalatpour A, et al. Objective Residency Applicant Assessment Using a Linear Rank Model. J Surg Educ. 2023;80(6):776–85. DOI: 10.1016/j.jsurg.2023.03.002
    Back to article
  63. 63Villwock JA, Hamill CS, Sale KA, Sykes KJ. Beyond the USMLE: The STAR Algorithm for Initial Residency Applicant Screening and Interview Selection. J Surg Res. 2019;235:447–52. DOI: 10.1016/j.jss.2018.07.057
    Back to article
  64. 64Nakae S, Palermo AG, Sun M, Byakod R, La T. Bias Breakers: Continuous Practice for Admissions and Selection Committees. MedEdPORTAL. 2022;18:11285. DOI: 10.15766/mep_2374-8265.11285
    Back to article
  65. 65Yemane L, Omoruyi E. Underrepresented in medicine in graduate medical education: Historical trends, bias, and recruitment practices. Current Problems in Pediatr Adol Health Care. 2021;51(10):101088. DOI: 10.1016/j.cppeds.2021.101088
    Back to article
  66. 66Capers Qt. How Clinicians and Educators Can Mitigate Implicit Bias in Patient Care and Candidate Selection in Medical Education. ATS Sch. 2020;1(3):211–7. DOI: 10.34197/ats-scholar.2020-0024PS
    Back to article
  67. 67Klein R, Julian KA, Snyder ED, Koch J, Ufere NN, Volerman A, et al. Gender Bias in Resident Assessment in Graduate Medical Education: Review of the Literature. J Gen Int Med. 2019;34(5):712–9. DOI: 10.1007/s11606-019-04884-0
    Back to article
  68. 68Christophers B, Marr MC, Pendergrast TR. Medical School Admission Policies Disadvantage Low-Income Applicants. Perm J. 2022;26(2):172–6. DOI: 10.7812/TPP/21.181
    Back to article
  69. 69Jerant A, Sciolla AF, Henderson MC, Griffin E, Talamantes E, Fancher T, et al. Medical Student Socioeconomic Disadvantage, Self-Designated Disadvantage, and Subsequent Academic Performance. J Health Care Poor Underserved. 2019;30(4):1419–32. DOI: 10.1353/hpu.2019.0095
    Back to article
  70. 70McClintock AH, Fainstad T, Jauregui J, Yarris LM. Countering Bias in Assessment. Journal Grad Med Educ. 2021;13(5):725–6. DOI: 10.4300/JGME-D-21-00722.1
    Back to article
  71. 71Marvin R, Park YS, Dekhtyar M, Hartzen M, Bessey L, Finkenbine R, et al. Implementation of the AAMC’s Holistic Review Model for Psychiatry Resident Recruitment. MedEdPORTAL. 2023;19:11299. DOI: 10.15766/mep_2374-8265.11299
    Back to article
  72. 72Robinett K, Kareem R, Reavis K, Quezada S. A multi-pronged, antiracist approach to optimize equity in medical school admissions. Med Educ. 2021;55(12):1376–82. DOI: 10.1111/medu.14589
    Back to article
  73. 73Spector AR, Railey KM. Reducing Reliance on Test Scores Reduces Racial Bias in Neurology Residency Recruitment. J Natl Med Assoc. 2019;111(5):471–4. DOI: 10.1016/j.jnma.2019.03.004
    Back to article
  74. 74Phillips MR, Charles A. Addressing implicit bias in the surgical residency application and interview process for underrepresented minorities. Surg. 2021;169(6):1283–4. DOI: 10.1016/j.surg.2021.01.018
    Back to article
  75. 75Wusu MH, Tepperberg S, Weinberg JM, Saper RB. Matching Our Mission: A Strategic Plan to Create a Diverse Family Medicine Residency. Fam Med. 2019;51(1):31–6. DOI: 10.22454/FamMed.2019.955445
    Back to article
  76. 76Rymer JA, Frazier-Mills CG, Jackson LR 2nd., Thomas KL, Douglas PS, Wang A, et al. Evaluation of Women and Underrepresented Racial and Ethnic Group Representation in a General Cardiology Fellowship After a Systematic Recruitment Initiative. JAMA Netw Open. 2021;4(1):e2030832. DOI: 10.1001/jamanetworkopen.2020.30832
    Back to article
  77. 77Paterson QS, Hartmann R, Woods R, Martin LJ, Thoma B. A transparent and defensible process for applicant selection within a Canadian emergency medicine residency program. Cjem. 2020;22(2):215–23. DOI: 10.1017/cem.2019.460
    Back to article
  78. 78Jones AC, Nichols AC, McNicholas CM, Stanford FC. Admissions Is Not Enough: The Racial Achievement Gap in Medical Education. Acad Med. 2021;96(2):176–81. DOI: 10.1097/ACM.0000000000003837
    Back to article
  79. 79Stoesser K, Frame KA, Sanyer O, Leiser JP, Moreno LE, Bosch C, et al. Increasing URiM Family Medicine Residents at University of Utah Health. PRiMER. 2021;5:42. DOI: 10.22454/PRiMER.2021.279738
    Back to article
  80. 80Ogunyemi D. Defeating Unconscious Bias: The Role of a Structured, Reflective, and Interactive Workshop. J Grad Med Educ. 2021;13(2):189–94. DOI: 10.4300/JGME-D-20-00722.1
    Back to article
  81. 81Harris KD. Chapter 6- Education. San Francisco, CA: State of California – Department of Justice; 2015.
    Back to article
  82. 82Bryant JA, Chloe. These States’ Anti-DEI Legislation May Impact Higher Education 2024. Available from: https://www.bestcolleges.com/news/anti-dei-legislation-tracker/.
    Back to article
  83. 83Libraries M. Affirmative Action: Supreme Court 2023 Decision 2023. Available from: https://libguides.mit.edu/c.php?g=1336858&p=9862991.
    Back to article
DOI: https://doi.org/10.5334/pme.1716 | Journal eISSN: 2212-277X
Journal RSS Feed
Language: English
Submitted on: Jan 29, 2025
Accepted on: Feb 10, 2025
Published on: Mar 3, 2025
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2025 Kristin E. Mangalindan, Tasha R. Wyatt, Kirsten R. Brown, Marina Shapiro, Lauren A. Maggio, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.

Previous articleVolume 14 (2025): Issue 1Next article