References
- Wass V Van der Vleuten C Shatzer J Jones R Assessment of clinical competence Lancet 2001 357 945 949 10.1016/S0140-6736(00)04221-5
- Holmboe ES Sherbino J Long DM Swing SR Frank JR The role of assessment in competency-based medical education Med Teach 2010 32 676 682 10.3109/0142159X.2010.500704
- Frank JR Snell LS Cate OT Competency-based medical education: theory to practice Med Teach 2010 32 638 645 10.3109/0142159X.2010.501190
- Sebok-Syer SS Klinger DA Sherbino J Chan TM Mixed messages or miscommunication? Investigating the relationship between assessors’ workplace-based assessment scores and written comments Acad Med 2017 92 1774 1779 10.1097/ACM.0000000000001743
- Eva KW Hodges BD Scylla or Charybdis? Can we navigate between objectification and judgement in assessment? Med Educ 2012 46 914 919 10.1111/j.1365-2923.2012.04310.x
- Kogan JR Conforti L Bernabeo E Iobst W Holmboe E Opening the black box of clinical skills assessment via observation: a conceptual model Med Educ 2011 45 1048 1060 10.1111/j.1365-2923.2011.04025.x
- Hodges B Assessment in the post-psychometric era: learning to love the subjective and collective Med Teach 2013 35 564 568 10.3109/0142159X.2013.789134
- Govaerts MJ van der Vleuten CP Schuwirth LW Muijtjens AM Broadening perspectives on clinical performance assessment: rethinking the nature of in-training assessment Adv Health Sci Educ Theory Pract 2007 12 239 260 10.1007/s10459-006-9043-1
- Uijtdehaage S Schuwirth LWT Assuring the quality of programmatic assessment: moving beyond psychometrics Perspect Med Educ 2018 7 350 351 10.1007/s40037-018-0485-y
- Bartels J Mooney CJ Stone RT Numerical versus narrative: a comparison between methods to measure medical student performance during clinical clerkships Med Teach 2017 39 1154 1158 10.1080/0142159X.2017.1368467
- Hanson JL Rosenberg AA Lane JL Narrative descriptions should replace grades and numerical ratings for clinical performance in medical education in the United States Front Psychol 2013 4 668 10.3389/fpsyg.2013.00668
- Ginsburg S Gold W Cavalcanti RB Kurabi B McDonald-Blumer H Competencies “plus”: the nature of written comments on internal medicine residents’ evaluation forms Acad Med 2011 86 10 Suppl S30 S34 10.1097/ACM.0b013e31822a6d92
- Marcotte L Egan R Soleas E Assessing the quality of feedback to general internal medicine residents in a competency-based environment Can Med Educ J 2019 10 e32 e47 10.36834/cmej.57323
- Williams RG Roberts NK Schwind CJ Dunnington GL The nature of general surgery resident performance problems Surgery 2009 145 651 658 10.1016/j.surg.2009.01.019
- Guerrasio J Cumbler E Trosterman A Determining need for remediation through postrotation evaluations J Grad Med Educ 2012 4 47 51 10.4300/JGME-D-11-00145.1
- Reamy BV Harman JH Residents in trouble: an in-depth assessment of the 25-year experience of a single family medicine residency Fam Med 2006 38 252 257
- Park YS Riddle J Tekian A Validity evidence of resident competency ratings and the identification of problem residents Med Educ 2014 48 614 622 10.1111/medu.12408
- Ginsburg S van der Vleuten CPM Eva KW The hidden value of narrative comments for assessment: a quantitative reliability analysis of qualitative data Acad Med 2017 92 1617 1621 10.1097/ACM.0000000000001669
- Tremblay G Carmichael PH Maziade J Gregoire M Detection of residents with progress issues using a keyword-specific algorithm J Grad Med Educ 2019 11 656 662 10.4300/JGME-D-19-00386.1
- Hatala R Sawatsky AP Dudek N Ginsburg S Cook DA Using in-training evaluation report (ITER) qualitative comments to assess medical students and residents: a systematic review Acad Med 2017 92 868 879 10.1097/ACM.0000000000001506
- Ginsburg S Kogan JR Gingerich A Lynch M Watling CJ Taken out of context: hazards in the interpretation of written assessment comments Acad Med 2020 95 1082 1088 10.1097/ACM.0000000000003047
- Ginsburg S van der Vleuten CP Eva KW Lingard L Cracking the code: residents’ interpretations of written assessment comments Med Educ 2017 51 401 410 10.1111/medu.13158
- Ginsburg S Regehr G Lingard L Eva KW Reading between the lines: faculty interpretations of narrative evaluation comments Med Educ 2015 49 296 306 10.1111/medu.12637
- Ginsburg S van der Vleuten C Eva KW Lingard L Hedging to save face: a linguistic analysis of written comments on in-training evaluation reports Adv Health Sci Educ Theory Pract 2016 21 175 188 10.1007/s10459-015-9622-0
- Richards SH Campbell JL Walshaw E Dickens A Greco M A multi-method analysis of free-text comments from the UK general medical council colleague questionnaires Med Educ 2009 43 757 766 10.1111/j.1365-2923.2009.03416.x
- Kelleher M Kinnear B Sall D A reliability analysis of entrustment-derived workplace-based assessments Acad Med 2020 95 616 622 10.1097/ACM.0000000000002997
- Warm EJ Held JD Hellmann M Entrusting observable practice activities and milestones over the 36 months of an internal medicine residency Acad Med 2016 91 1398 1405 10.1097/ACM.0000000000001292
- Warm EJ Kinnear B Kelleher M Variation in entrustment when sharing a single assessment system between university- and community-based residency programs: a comparison Acad Med 2020 95 590 598 10.1097/ACM.0000000000002972
- Warm EJ Mathis BR Held JD Entrustment and mapping of observable practice activities for resident assessment J Gen Intern Med 2014 29 1177 1182 10.1007/s11606-014-2801-5
- Hauer KE Ten Cate O Boscardin C Understanding trust as an essential element of trainee supervision and learning in the workplace Adv Health Sci Educ Theory Pract 2014 19 435 456
- Warm EJ Kinnear B Kelleher M Sall D Holmboe E Transforming resident assessment: an analysis using Deming’s system of profound knowledge Acad Med 2019 94 195 201 10.1097/ACM.0000000000002499
- Kiger ME Varpio L Thematic analysis of qualitative data: AMEE guide No. 131 Med Teach 2020 42 846 854 10.1080/0142159X.2020.1755030
- Braun V Clarke V Research designs: Quantitative, qualitative, neuropsychological, and biological. APA handbooks in psychology 2012 Washington, DC American Psychological Association 57 71
- Schumacher DJ Michelson C Poynter S Thresholds and interpretations: how clinical competency committees identify pediatric residents with performance concerns Med Teach 2018 40 70 79 10.1080/0142159X.2017.1394576
- Chan T Sebok-Syer S Thoma B Learning analytics in medical education assessment: the past, the present, and the future AEM Educ Train 2018 2 178 187 10.1002/aet2.10087
- Ten Cate O Schwartz A Chen HC Assessing trainees and making entrustment decisions: on the nature and use of entrustment-supervision scales Acad Med 2020 95 1662 1669 10.1097/ACM.0000000000003427
- Watling CJ Ginsburg S Assessment, feedback and the alchemy of learning Med Educ 2019 53 76 85 10.1111/medu.13645
- Ginsburg S Gingerich A Kogan JR Watling CJ Eva KW Idiosyncrasy in assessment comments: do faculty have distinct writing styles when completing in-training evaluation reports? Acad Med 2020 95 S81 S8 10.1097/ACM.0000000000003643