Have a personal or library account? Click to login
Fairness: the hidden challenge for competency-based postgraduate medical education programs Cover

Fairness: the hidden challenge for competency-based postgraduate medical education programs

Open Access
|May 2017

References

  1. Ramani S Post SE Konings K Mann K Katz JT van der Vleuten C “It’s not just the culture”: a qualitative study exploring residents’ perceptions of the impact of institutional culture on feedback Teach Learn Med 2016 21 1 9
  2. Hawkins RE Welcher CM Holmboe ES Implementation of competency-based medical education: are we addressing the concerns and challenges? Med Educ 2015 49 1086 1102 10.1111/medu.12831
  3. Chan T Sherbino J The McMaster modular assessment program (McMap). A theoretically grounded work-based assessment system for an emergency medicine resident program Acad Med 2015 90 900 905 10.1097/ACM.0000000000000707
  4. Frank JF Mungroo R Ahmad Y Wang M De Rossi S Horsley T Toward a definition of competency-based education in medicine: a systematic review of published definitions Med Teach 2010 32 631 637 10.3109/0142159X.2010.500898
  5. Holmboe ES Sherbino J Long DM Swing SR Frank JR The role of assessment in competency-based medical education Med Teach 2010 32 676 682 10.3109/0142159X.2010.500704
  6. Morcke AM Dornan T Eika B Outcome (competency) based education: an exploration of its origins, theoretical basis, and empirical evidence Adv Health Sci Educ Theory Pract 2013 18 851 863 10.1007/s10459-012-9405-9
  7. Frank JR Snell LS Cate OT Competency-based medical education: theory to practice Med Teach 2010 32 638 645 10.3109/0142159X.2010.501190
  8. Spady WG The concept and implications of competency based education Educ Leadersh 1978 36 16 22
  9. Nasca TJ Philibert I Brigham T Flynn TC The next GME accreditation system – rationale and benefits N Engl J Med 2012 366 1051 1056 10.1056/NEJMsr1200117
  10. Altahawi F Sisk B Poloskey S Hicks C Dannefer EF Student perspectives on assessment: experience in a competency-based portfolio system Med Teach 2012 34 221 225 10.3109/0142159X.2012.652243
  11. van der Vleuten CP Dannefer EF Toward a systems approach to assessment Med Teach 2012 34 185 186 10.3109/0142159X.2012.652240
  12. Greene J Resident dismissal: Suing the system. Amednews.com. American Medical News 2000
  13. Jamieson T Hemmer P Pangaro LN Pangaro LN McGaphie WC Legal aspects of assigning failing grades Handbook on medical student evaluation and assessment. Alliance for Clinical Education 2015 North Syracuse Gegensatz 251 262
  14. Wilkerson JR Lang WS Portfolios, the pied piper of teacher certification assessments: legal and psychometric issues Educ Policy Anal Arch 2003 11 1 30 10.14507/epaa.v11n1.2003
  15. Gammell C Black medical student who claims she was bullied by racists sues for 300,000. The Telegraph 2009
  16. Andolsek K Padmore J Hauer KE Holmboe E Clinical Competency Committees. A guidebook for programs. Accreditation Council for Graduate Medical Education 2015
  17. Nabors C Peterson SJ Forman L Operationalizing the internal medicine milestones – an early status report J Grad Med Educ 2013 5 130 137 10.4300/JGME-D-12-00130.1
  18. Cole NS Zieky MJ The new faces of fairness J Educ Meas 2001 38 369 382 10.1111/j.1745-3984.2001.tb01132.x
  19. American Educational Research Association Standards for educational and psychological testing/American Educational Research Association, American Psychological Association, National Council on Measurement in Education 2014 Washington American Educational Research Association
  20. Bierer SB Dannefer E Does students’ gender, citizenship, or verbal ability affect fairness of portfolio-based promotion decisions? Results from one medical school Acad Med 2011 86 773 777 10.1097/ACM.0b013e318217e14b
  21. Lam TCM Fairness in performance assessment. ERIC Digest. ED 391982 1995
  22. Gipps CV Beyond testing: towards a theory of educational assessment 1994 London The Falmer Press 148 157
  23. Suskie L Fair assessment practices: giving students equitable opportunities to demonstrate learning AAHE Bull 2000 52 1 6
  24. Barr KP Massagli TL New challenges for the graduate medical educator: implementing the milestones Am J Phys Med Rehabil 2014 93 624 631 10.1097/PHM.0000000000000073
  25. Armstrong EG Mackey M Spear S Medical education as a process management problem Acad Med 2004 79 8 728 10.1097/00001888-200408000-00002
  26. Holmboe E Pangaro LN McGaphie WC Direct observation of students’ clinical skills Handbook on medical student evaluation and assessment. Alliance for Clinical Education 2015 North Syracuse Gegensatz 97 112
  27. French JC Dannefer EF Colbert CY A systematic approach to building a fully operational clinical competency committee J Surg Educ 2014 71 e22 e27 10.1016/j.jsurg.2014.04.005
  28. Royal College of Physicians and Surgeons of Canada. Competence by Design. Competence committees: A critical component of competency-based assessment. Available at: http://www.royalcollege.ca/rcsite/cbd/competence-committee-e. Accessed: 15 Feb 2017
  29. Kogan JR Conforti LN Iobst WF Holmboe ES Reconceptualizing variable rater assessments as both an educational and clinical care problem Acad Med 2014 89 721 727 10.1097/ACM.0000000000000221
  30. Linn RL Baker EL Dunbar SB Complex, performance-based assessment: expectations and validation criteria Educ Res 1991 20 15 21 10.3102/0013189X020008015
  31. Downing SM Threats to the validity of clinical teaching assessments: What about rater error? Med Educ 2005 39 350 355 10.1111/j.1365-2929.2005.02138.x
  32. Pope G Shepher E Kleeman J McNamara B Phaup J The legal defensibility of assessments: What you need to know. Questionmark White Paper 2007
  33. Pedhazur EJ Schmelkin LP Pedhazur EJ Construct validation Measurement, design, and analysis. An integrated approach 1991 Hillsdale Erlbaum 52 80
  34. Schouten BC Meeuwesen L Cultural differences in medical communication: a review of the literature Patient Educ Couns 2006 64 21 34 10.1016/j.pec.2005.11.014
  35. Williams RG Klamen DA McGaghie WC Cognitive, social and environmental sources of bias in clinical performance ratings Teach Learn Med 2003 15 270 292 10.1207/S15328015TLM1504_11
  36. Hays RB Hamlin G Crane L Twelve tips for increasing the defensibility of assessment decisions Med Teach 2015 37 433 436 10.3109/0142159X.2014.943711
  37. Gingerich A Regehr G Eva KW Rater-based assessments as social judgments: rethinking the etiology of rater errors Acad Med 2011 86 S1 S7 10.1097/ACM.0b013e31822a6cf8
  38. Thomas MR Beckman TJ Mauck KF Cha SS Thomas KG Group assessments of resident physicians improve reliability and decrease halo error J Gen Intern Med 2011 7 759 764 10.1007/s11606-011-1670-4
  39. Hodges B Assessment in the post-psychometric era: learning to love the subjective and collective Med Teach 2013 35 564 568 10.3109/0142159X.2013.789134
  40. Eva KW Hodges BD Scylla or Charybdis? Can we navigate between objectification and judgment in assessment? Med Educ 2012 46 914 919 10.1111/j.1365-2923.2012.04310.x
  41. Brateanu A Thomascik J Koncilja K Spencer AL Colbert CY Using continuous quality improvement techniques to evaluate and enhance an internal medicine residency program’s assessment system Am J Med 2017
  42. Hauer KE Chesluk B Iobst W Reviewing residents’ competence: a qualitative study of the role of clinical competency committees in performance assessment Acad Med 2015 90 1084 1092 10.1097/ACM.0000000000000736
  43. Colbert CY Dannefer EF French JC Clinical Competency Committees and assessment: changing the conversation in graduate medical education J Grad Med Educ 2015 7 162 165 10.4300/JGME-D-14-00448.1
  44. van der Vleuten CPM Schuwirth LWT Assessing professional competence: from methods to programmes Med Educ 2005 39 309 317 10.1111/j.1365-2929.2005.02094.x
  45. Univ. of Mich. v. Ewing 474 U.S. 214, 106 S. Ct. 507, 88 L. Ed. 2d 523 1985
  46. Univ. of Missouri v. Horowitz 435 U.S. 78 (98 S. Ct. 948, 55 L.Ed.2d 124) 1978
  47. Nayer M Glover Takahashi S Martin D Probyn L Gold W “Supporting residents in difficulty – issues and options.” International conference on residency education. Royal College of Physicians and Surgeons 2014
  48. Hernandez v. Overlook Hospital, 149 N.J. 68, 692 A.2d 971 (N.J. S. Ct. 1997).
  49. Wayne SJ Fortner SA Kitzes JA Timm C Kalishman S Cause or effect? The relationship between student perception of the medical school learning environment and academic performance on USMLE Step 1 Med Teach 2013 35 376 380 10.3109/0142159X.2013.769678
  50. Bierer SB Dannefer EF The learning environment counts: longitudinal qualitative analysis of study strategies adopted by first-year medical students in a competency-based educational program Acad Med 2016 91 S44 S52 10.1097/ACM.0000000000001363
  51. Genn JM AMEE Medical Education Guide No. 23 (Part I): Curriculum, environment, climate, quality and change in medical education – a unifying perspective Med Teach 2001 23 337 344 10.1080/01421590120063330
  52. London M Smither JW Feedback orientation, feedback culture, and the longitudinal performance management process Hum Resour Manage Rev 2002 12 81 100 10.1016/S1053-4822(01)00043-2
  53. Carmeli A Brueller D Dutton JE Learning behaviours in the workplace: the role of high-quality interpersonal relationships and psychological safety Syst Res Behav Sci 2009 26 81 98 10.1002/sres.932
  54. Kost A Combs H Smith S A proposed conceptual framework and investigation of upward feedback receptivity in medical education Teach Learn Med 2015 27 359 361 10.1080/10401334.2015.1077134
  55. Accreditation Council for Graduate Medical Education. Clinical Learning Environment Review. Clinical Pathways to Excellence. Available at: https://www.acgme.org/Portals/0/PDFs/CLER/CLER_Brochure.pdf. Accessed May 26, 2016.
  56. Jennings ML Slavin SJ Resident wellness matters: optimizing resident education and wellness through the learning environment Acad Med 2015 90 1246 1250 10.1097/ACM.0000000000000842
  57. Accreditation Council for Graduate Medical Education ACGME common program requirements 2015
  58. Royal College of Physicians and Surgeons of Canada. General Standards Applicable to All Residency Programs. B Standards. Standard B3. Structure and Organization of the Program. Available at: http://www.royalcollege.ca/rcsite/education-strategy-accreditation/pgme-training-programs/accreditation-residency-programs-e
  59. Association of American Medical Colleges. Medical School Graduation Questionnaire. 2015 All Schools Summary Report. Available at: https://www.aamc.org/download/440552/data/2015gqallschoolssummaryreport.pdf. Accessed June 2, 2016.
  60. Crutcher RA Szafran O Woloschuk W Family medicine graduates’ perceptions of intimidation, harassment, and discrimination during residency training BMC Med Educ 2011 11 1 7 10.1186/1472-6920-11-88
  61. Stratton T McLaughlin MA Witte FM Does students’ exposure to gender discrimination and sexual harassment in medical school affect specialty choice and residency program selection? Acad Med 2005 80 400 408 10.1097/00001888-200504000-00020
  62. Fnais N Soobiah C Chen MH Harassment and discrimination in medical training: a systematic review and meta-analysis Acad Med 2014 89 817 827 10.1097/ACM.0000000000000200
  63. Lee KP Kelz RR Dube B Morris JB Attitude and perceptions of the other underrepresented minority in surgery J Surg Educ 2014 71 e47 e52 10.1016/j.jsurg.2014.05.008
  64. Mansh M Garcia G Lunn MR From patients to providers: changing the culture in medicine toward sexual and gender minorities Acad Med 2015 90 574 580 10.1097/ACM.0000000000000656
  65. Bowe CM Armstrong E Assessment for systems learning: a holistic assessment framework to support decision-making across the medical education continuum Acad Med 2016
  66. Desimone LM LeFloch KC Are we asking the right questions? Using cognitive interviews to improve surveys in education research Educ Eval Policy Anal 2004 26 1 22 10.3102/01623737026001001
  67. Groves RM Fowler FJ Jr Couper MP Lepkowski JM Singer E Tourangeau R Survey Methodology 2009 2 Hoboken John Wiley and Sons
  68. Willis GB Cognitive interviewing. A “how to” guide. Research triangle institute. Presented at the Meeting of the American Statistical Association 1999
  69. Presser S Couper MP Lessler JT Methods for testing and evaluating survey questions Public Opin Q 2004 68 109 130 10.1093/poq/nfh008
  70. Ginsburg S van der Vleuten C Eva KW Lingard L Hedging to save face: a linguistic analysis of written comments on in-training evaluation reports. Adv Health Sci Educ 2016 21 175 188
  71. Pien L Taylor CA Traboulsi E Nielsen CA A pilot study of a “resident educator and life-long learner” program: using a faculty train-the-trainer program J Grad Med Educ 2011 3 332 336 10.4300/JGME-03-03-33
  72. Hattie J Temperley H The power of feedback Rev Educ Res 2007 77 81 112 10.3102/003465430298487
  73. French JC Colbert CY Pien LC Targeted feedback in the milestones era: utilization of the ask-tell-ask feedback model to promote reflection and self-assessment J Surg Educ 2015 72 e274 e279 10.1016/j.jsurg.2015.05.016
  74. Bierer SB Dannefer EF Tetzlaff JE Time to loosen the apron strings: cohort-based evaluation of a learner driven remediation model at one medical school J Gen Intern Med 2015 30 1339 1343 10.1007/s11606-015-3343-1
Language: English
Published on: May 17, 2017
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2017 Colleen Y. Colbert, Judith C. French, Mary Elizabeth Herring, Elaine F. Dannefer, published by Bohn Stafleu van Loghum
This work is licensed under the Creative Commons Attribution 4.0 License.