Reframing Validity: How Values Shape Assessment in Postgraduate Medical Education
References
- Messick S. Validity of Psychological Assessment. Am Psychol. Published online 1995;9.
- Norman GR, Van Der Vleuten CPM, De Graaff E. Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability. Med Educ. 1991;25(2):119–126. DOI: 10.1111/j.1365-2923.1991.tb00037.x
- Van Der Vleuten CPM, Norman GR, De Graaff E. Pitfalls in the pursuit of objectivity: issues of reliability. Med Educ. 1991;25(2):110–118. DOI: 10.1111/j.1365-2923.1991.tb00036.x
- Kane MT. An argument-based approach to validity. Psychol Bull. 1992;112(3):527. DOI: 10.1037/0033-2909.112.3.527
- Valentine N, Durning S, Shanahan EM, Schuwirth L. Fairness in human judgement in assessment: a hermeneutic literature review and conceptual framework. Adv Health Sci Educ. 2021;26(2):713–738. DOI: 10.1007/s10459-020-10002-1
- Marceau M, Gallagher F, Young M, St-Onge C. Validity as a social imperative for assessment in health professions education: a concept analysis. Med Educ. 2018;52(6):641–653. DOI: 10.1111/medu.13574
- Young ME, Shankar S, St-Onge C. An exploration of values in medical school admissions processes: the interplay between contextual factors, admissions practices, and validity. Adv Health Sci Educ. 2024;29(4):1285–1308. DOI: 10.1007/s10459-023-10307-x
- Li S, Acai A, Sherbino J, Chan TM. The Teacher, the Assessor, and the Patient Protector: A Conceptual Model Describing How Context Interfaces With the Supervisory Roles of Academic Emergency Physicians. Coates WC, ed. AEM Educ Train. 2021;5(1):52–62. DOI: 10.1002/aet2.10431
- Kogan JR, Conforti L, Bernabeo E, Iobst W, Holmboe E. Opening the black box of clinical skills assessment via observation: a conceptual model. Med Educ. 2011;45(10):1048–1060. DOI: 10.1111/j.1365-2923.2011.04025.x
- Gingerich A, Kogan J, Yeates P, Govaerts M, Holmboe E. Seeing the ‘black box’ differently: assessor cognition from three research perspectives. Med Educ. 2014;48(11):1055–1068. DOI: 10.1111/medu.12546
- Tavares W, Kuper A, Kulasegaram K, Whitehead C. The compatibility principle: on philosophies in the assessment of clinical competence. Adv Health Sci Educ. 2020;25(4):1003–1018. DOI: 10.1007/s10459-019-09939-9
- Tavares W, Hodwitz K, Rowland P, et al. Implicit and inferred: on the philosophical positions informing assessment science. Adv Health Sci Educ. 2021;26(5):1597–1623. DOI: 10.1007/s10459-021-10063-w
- Ginsburg S, Watling CJ, Schumacher DJ, Gingerich A, Hatala R. Numbers encapsulate, words elaborate: toward the best use of comments for assessment and feedback on entrustment ratings. Acad Med. 2021;96(7S):S81–S86. DOI: 10.1097/ACM.0000000000004089
- Gingerich A, Regehr G, Eva KW. Rater-based assessments as social judgments: rethinking the etiology of rater errors. Acad Med. 2011;86(10):S1–S7. DOI: 10.1097/ACM.0b013e31822a6cf8
- Gingerich A. What if the’trust’in entrustable were a social judgement? Med Educ. 2015;49(8). DOI: 10.1111/medu.12772
- Poncelet A, Collins S, Fiore D, et al. Identifying value factors in institutional leaders’ perspectives on investing in health professions educators. JAMA Netw Open. 2023;6(2):
e2256193 . DOI: 10.1001/jamanetworkopen.2022.56193 - Acai A. Understanding Competence Committee Implementation and Decision-Making Practices in the Era of Competency-Based Medical Education. PhD Thesis. 2021.
https://macsphere.mcmaster.ca/handle/11375/26182 (Accessed November 29, 2025). - Kaufman DM. Teaching and learning in medical education: how theory can inform practice. Underst Med Educ Evid Theory Pract. Published online 2018:37–69. DOI: 10.1002/9781119373780.ch4
- Rees CE, Monrouxe LV. Theory in medical education research: how do we get there? Med Educ. 2010;44(4):334–339. DOI: 10.1111/j.1365-2923.2009.03615.x
- Varpio L, Ellaway RH. Shaping our worldviews: a conversation about and of theory. Adv Health Sci Educ. 2021;26(1):339–345. DOI: 10.1007/s10459-021-10033-2
- Kahlke R, Lee M, Eva KW. Building Blocks for Critical Reviews in Health Professions Education. J Grad Med Educ. 2023;15(2):186–189. DOI: 10.4300/JGME-D-23-00155.1
- Kahlke R, Lee M, Eva KW. Critical reviews in health professions education research. J Grad Med Educ. 2023;15(2):180–185. DOI: 10.4300/JGME-D-23-00154.1
- St-Onge C, Young M, Eva KW, et al. Validity: one word with a plurality of meanings. Adv Health Sci Educ. 2017;22(4):853–867. DOI: 10.1007/s10459-016-9716-3
- St-Onge C. Evolving conceptualizations of validity: impact on the process and outcome of assessment? Published online 2015.
https://usherbrooke.scholaris.ca/items/b87df0dd-159e-4a3f-afd5-0ddd5ee9a8c9 (Accessed November 13, 2025). - Cook DA, Lineberry M. Consequences validity evidence: evaluating the impact of educational assessments. Acad Med. 2016;91(6):785–795. DOI: 10.1097/ACM.0000000000001114
- Marceau M, St-Onge C, Gallagher F, Young M. Validity as a social imperative: users’ and leaders’ perceptions. Can Med Educ J. 2022;13(3):22–36. DOI: 10.36834/cmej.73518
- Yeates P, Moult A, Cope N, et al. Measuring the effect of examiner variability in a multiple-circuit objective structured clinical examination (OSCE). Acad Med. 2021;96(8):1189. DOI: 10.1097/ACM.0000000000004028
- Holmboe ES. Realizing the Promise of Competency-Based Medical Education: Acad Med. 2015;90(4):411–413. DOI: 10.1097/ACM.0000000000000515
- Chan T, Sebok-Syer S, Thoma B, Wise A, Sherbino J, Pusic M. Learning analytics in medical education assessment: the past, the present, and the future. AEM Educ Train. 2018;2(2):178–187. DOI: 10.1002/aet2.10087
- Thoma B, Caretta-Weyer H, Schumacher DJ, et al. Becoming a deliberately developmental organization: Using competency based assessment data for organizational development. Med Teach. 2021;43(7):801–809. DOI: 10.1080/0142159X.2021.1925100
- Sargeant J, Mann K, Manos S, et al. R2C2 in Action: Testing an Evidence-Based Model to Facilitate Feedback and Coaching in Residency. J Grad Med Educ. 2017;9(2):165–170. DOI: 10.4300/JGME-D-16-00398.1
- Norman G, Norcini J, Bordage G. Competency-based education: milestones or millstones? Journal of graduate medical education. 2014;6(1):1. DOI: 10.4300/JGME-D-13-00445.1
- Schuwirth LWT, van der Vleuten CPM. A history of assessment in medical education. Adv Health Sci Educ. 2020;25(5):1045–1056. DOI: 10.1007/s10459-020-10003-0
- Schuwirth LWT, van der Vleuten CPM. Programmatic assessment and Kane’s validity perspective. Med Educ. 2012;46(1):38–48. DOI: 10.1111/j.1365-2923.2011.04098.x
- Okuyama A, Martowirono K, Bijnen B. Assessing the patient safety competencies of healthcare professionals: a systematic review. BMJ Qual Saf. 2011;20(11):991–1000. DOI: 10.1136/bmjqs-2011-000148
- Tamblyn R, Abrahamowicz M, Brailovsky C, et al. Association Between Licensing Examination Scores and Resource Use and Quality of Care in Primary Care Practice. JAMA. 1998;280(11):989–996. DOI: 10.1001/jama.280.11.989
- Wenghofer E, Klass D, Abrahamowicz M, et al. Doctor scores on national qualifying examinations predict quality of care in future practice. Med Educ. 2009;43(12):1166–1173. DOI: 10.1111/j.1365-2923.2009.03534.x
- Asch DA, Nicholson S, Srinivas S, Herrin J, Epstein AJ. Evaluating obstetrical residency programs using patient outcomes. Jama. 2009;302(12):1277–1283. DOI: 10.1001/jama.2009.1356
- Asch DA, Epstein A, Nicholson S. Evaluating medical training programs by the quality of care delivered by their alumni. Jama. 2007;298(9):1049–1051. DOI: 10.1001/jama.298.9.1049
- Sebok-Syer SS, Chahine S, Watling CJ, Goldszmidt M, Cristancho S, Lingard L. Considering the interdependence of clinical performance: implications for assessment and entrustment. Med Educ. 2018;52(9):970–980. DOI: 10.1111/medu.13588
- Ott MC, Pack R, Cristancho S, Chin M, Van Koughnett JA, Ott M. “The Most Crushing Thing”: Understanding Resident Assessment Burden in a Competency-Based Curriculum. J Grad Med Educ. 2022;14(5):583–592. DOI: 10.4300/JGME-D-22-00050.1
- Van Melle E, Hall AK, Schumacher DJ, et al. Capturing outcomes of competency-based medical education: The call and the challenge. Med Teach. 2021;43(7):794–800. DOI: 10.1080/0142159X.2021.1925640
- Chan T, Oswald A, Hauer KE, et al. Diagnosing conflict: Conflicting data, interpersonal conflict, and conflicts of interest in clinical competency committees. Med Teach. 2021;43(7):765–773. DOI: 10.1080/0142159X.2021.1925101
- Ark TK, Brooks LR, Eva KW. Giving learners the best of both worlds: do clinical teachers need to guard against teaching pattern recognition to novices? Acad Med. 2006;81(4):405–409. DOI: 10.1097/00001888-200604000-00017
- Bynum WE
IV , Goodie JL. Shame, guilt, and the medical learner: ignored connections and why we should care. Med Educ. 2014;48(11):1045–1054. DOI: 10.1111/medu.12521 - Bynum WE
IV , Varpio L, Lagoo J, Teunissen PW. ‘I’m unworthy of being in this space’: The origins of shame in medical students. Med Educ. 2021;55(2):185–197. DOI: 10.1111/medu.14354 - Sánchez NF, Poll-Hunter N, Spencer DJ, et al. Attracting Diverse Talent to Academia: Perspectives of Medical Students and Residents. J Career Dev. 2018;45(5):440–457. DOI: 10.1177/0894845317709997
- Dhaliwal G, Hauer KE. Excellence in medical training: developing talent—not sorting it. Perspect Med Educ. 2021;10(6):356–361. DOI: 10.1007/S40037-021-00678-5
- Tamblyn R, Abrahamowicz M, Dauphinee WD, et al. Association between licensure examination scores and practice in primary care. Jama. 2002;288(23):3019–3026. DOI: 10.1001/jama.288.23.3019
- Wenghofer EF, Williams AP, Klass DJ. Factors Affecting Physician Performance: Implications for Performance Improvement and Governance. Healthc Policy. 2009;5(2):e141–e160. DOI: 10.12927/hcpol.2013.21178
- Davies DJ, Sam AH, Murphy KG, Khan SA, Choe R, Cleland J. BMAT’s predictive validity for medical school performance: A retrospective cohort study. Med Educ. 2022;56(9):936–948. DOI: 10.1111/medu.14819
- Elks M, Lazzarini Z, Bradley C. How to Eliminate a Deficit-Centered Mindset About Medical Students of Color. AMA J Ethics. 2021;23(12):975–980. DOI: 10.1001/amajethics.2021.975
- Chan TM, Sebok-Syer SS, Sampson C, Monteiro S. The Quality of Assessment of Learning (Qual) score: validity evidence for a scoring system aimed at rating short, workplace-based comments on trainee performance. Teach Learn Med. 2020;32(3):319–329. DOI: 10.1080/10401334.2019.1708365
- Dijksterhuis MG, Schuwirth LW, Braat DD, Teunissen PW, Scheele F. A qualitative study on trainees’ and supervisors’ perceptions of assessment for learning in postgraduate medical education. Med Teach. 2013;35(8):e1396–e1402. DOI: 10.3109/0142159X.2012.756576
- Dannefer EF. Beyond assessment of learning toward assessment for learning: educating tomorrow’s physicians. Med Teach. 2013;35(7):560–563. DOI: 10.3109/0142159X.2013.787141
- Sargeant J, Lockyer J, Mann K, et al. Facilitated Reflective Performance Feedback: Developing an Evidence- and Theory-Based Model That Builds Relationship, Explores Reactions and Content, and Coaches for Performance Change (R2C2). Acad Med. 2015;90(12):1698–1706. DOI: 10.1097/ACM.0000000000000809
- Greenberg CC, Ghousseini HN, Quamme SRP, et al. A statewide surgical coaching program provides opportunity for continuous professional development. Ann Surg. 2018;267(5):868–873. DOI: 10.1097/SLA.0000000000002341
- Development and Assessment of the Wisconsin Surgical Coaching Rubric | Continuing Medical Education and Maintenance of Certification | JAMA Surgery | JAMA Network.
https://jamanetwork.com/journals/jamasurgery/article-abstract/2764256 (Accessed December 3, 2022). - Cooke LJ, Duncan D, Rivera L, Dowling SK, Symonds C, Armson H. How do physicians behave when they participate in audit and feedback activities in a group with their peers? Implement Sci. 2018;13(1):1–9. DOI: 10.1186/s13012-018-0796-8
- Cooke LJ, Duncan D, Rivera L, Dowling SK, Symonds C, Armson H. The Calgary Audit and Feedback Framework: a practical, evidence-informed approach for the design and implementation of socially constructed learning interventions using audit and group feedback. Implement Sci. 2018;13(1):1–18. DOI: 10.1186/s13012-018-0829-3
- Watling CJ, Ginsburg S. Assessment, feedback and the alchemy of learning. Med Educ. 2019;53(1):76–85. DOI: 10.1111/medu.13645
- Hodges B. Assessment in the post-psychometric era: Learning to love the subjective and collective. Med Teach. 2013;35(7):564–568. DOI: 10.3109/0142159X.2013.789134
- Holland C. Critical review: medical students’ motivation after failure. Adv Health Sci Educ. 2016;21(3):695–710. DOI: 10.1007/s10459-015-9643-8
- Kandasamy S, Vanstone M, Colvin E, Chan T, Sherbino J, Monteiro S. “I made a mistake!”: A narrative analysis of experienced physicians’ stories of preventable error. J Eval Clin Pract. 2021;27(2):236–245. DOI: 10.1111/jep.13531
- Bynum WE
IV , Teunissen PW, Varpio L. In the “Shadow of Shame”: a phenomenological exploration of the nature of shame experiences in medical students. Acad Med. 2021;96(11S):S23–S30. DOI: 10.1097/ACM.0000000000004261 - Bynum WE
IV , Artino ARJr , Uijtdehaage S, Webb AM, Varpio L. Sentinel emotional events: the nature, triggers, and effects of shame experiences in medical residents. Acad Med. 2019;94(1):85–93. DOI: 10.1097/ACM.0000000000002479 - Acai A, Li SA, Sherbino J, Chan TM. Attending emergency physicians’ perceptions of a programmatic workplace-based assessment system: the McMaster Modular Assessment Program (McMAP). Teach Learn Med. 2019;31(4):434–444. DOI: 10.1080/10401334.2019.1574581
- Li SA, Sherbino J, Chan TM. McMaster Modular Assessment Program (McMAP) through the years: residents’ experience with an evolving feedback culture over a 3-year period. AEM Educ Train. 2017;1(1):5–14. DOI: 10.1002/aet2.10009
- Chou CL, Kalet A, Costa MJ, Cleland J, Winston K. Guidelines: The dos, don’ts and don’t knows of remediation in medical education. Perspect Med Educ. 2019;8(6):322–338. DOI: 10.1007/S40037-019-00544-5
- Kalet A, Chou CL, Ellaway RH. To fail is human: remediating remediation in medical education. Perspect Med Educ. 2017;6(6):418–424. DOI: 10.1007/S40037-017-0385-6
- Sklar D, Yilmaz Y, Chan TM. What the COVID-19 Pandemic Can Teach Health Professionals About Continuing Professional Development. Acad Med. 2021;96(10):1379–1382. DOI: 10.1097/ACM.0000000000004245
- Thoma B, Monteiro S, Pardhan A, Waters H, Chan T. Replacing high-stakes summative examinations with graduated medical licensure in Canada. CMAJ. 2022;194(5):E168–E170. DOI: 10.1503/cmaj.211816
- Susman J. Where medical education goes wrong. J Fam Pract. 2012;61(7):382–384.
- Curry RH, Meeks LM, Iezzoni LI. Beyond Technical Standards: A Competency-Based Framework for Access and Inclusion in Medical Education. Acad Med. 2020;95(12S):S109. DOI: 10.1097/ACM.0000000000003686
- Flotte TR, Larkin AC, Fischer MA, et al. Accelerated graduation and the deployment of new physicians during the COVID-19 pandemic. Acad Med. 2020;95(10):1492–1494. DOI: 10.1097/ACM.0000000000003540
- Alexander L, Ashcroft J, Byrne MH, Wan J. All hands on deck: early graduation of senior medical students in the COVID-19 pandemic. MedEdPublish. 2020;9:96. DOI: 10.15694/mep.2020.000096.1
- Birhane A, Kalluri P, Card D, Agnew W, Dotan R, Bao M. The Values Encoded in Machine Learning Research. In: 2022 ACM Conference on Fairness Accountability and Transparency.
ACM ; 2022. pp. 173–184. DOI: 10.1145/3531146.3533083 - Monteiro SD. Capsule Commentary on Post et al., Rating the Quality of Entrustable Professional Activities: Content Validation and Associations with the Clinical Context. Journal of General Internal Medicine. 2016;31(5):537–537. DOI: 10.1007/s11606-016-3662-x
- van der Vleuten CPM. When I say … context specificity. Med Educ. 2014;48(3):234–235. DOI: 10.1111/medu.12263
- Kassam A, de Vries I, Zabar S, et al. The Next Era of Assessment Within Medical Education: Exploring Intersections of Context and Implementation. Perspect Med Educ. 13(1):496–506. DOI: 10.5334/pme.1128
- Sinz E, Banerjee A, Steadman R, et al. Reliability of simulation-based assessment for practicing physicians: performance is context-specific. BMC Med Educ. 2021;21(1):207. DOI: 10.1186/s12909-021-02617-8
- Kogan JR, Conforti LN, Iobst WF, Holmboe ES. Reconceptualizing variable rater assessments as both an educational and clinical care problem. Acad Med. 2014;89(5). DOI: 10.1097/ACM.0000000000000221
- Chan T, Li-Sauerwine S, Monteiro S, Ngo Q. Vigilance and validity: the necessity of assessment system surveillance to ensure equity in emergency medicine. Can J Emerg Med. Published online 2023:1–3. DOI: 10.32920/27931779.v1
- Hart SL. Axiology--Theory of Values. Philos Phenomenol Res. 1971;32(1):29–41. DOI: 10.2307/2105883
- Boer D, Fischer R. How and when do personal values guide our attitudes and sociality? Explaining cross-cultural variability in attitude–value linkages. Psychol Bull. 2013;139(5):1113–1147. DOI: 10.1037/a0031347
- Arieli S, Sagiv L, Roccas S. Values at Work: The Impact of Personal Values in Organisations. Appl Psychol. 2020;69(2):230–275. DOI: 10.1111/apps.12181
- Van Schaik S, Plant J, O’Sullivan P. Promoting self-directed learning through portfolios in undergraduate medical education: The mentors’ perspective. Med Teach. 2013;35(2):139–144. DOI: 10.3109/0142159X.2012.733832
- Strategies for Building Peer Surgical Coaching Relationships | Surgery | JAMA Surgery | JAMA Network.
https://jamanetwork.com/journals/jamasurgery/article-abstract/2599169 (Accessed December 3, 2022). - Smirnova A, Barone MA, Zabar S, Kalet A. Introducing the Next Era in Assessment. Perspect Med Educ. 2025;14(1):1–8. DOI: 10.5334/pme.1551
- Caretta-Weyer HA, Smirnova A, Barone MA, et al. The Next Era of Assessment: Building a Trustworthy Assessment System. Perspect Med Educ. 2024;13(1):12–23. DOI: 10.5334/pme.1110
- Kinnear B, Martini A, Varpio L, Driessen EW, Schumacher DJ. How do validity experts conceptualise argumentation? It’s a rhetorical question. Med Educ. 2024;58(8):989–997. DOI: 10.1111/medu.15311
- Pearce J, Chiavaroli NG. The line we draw: shifting epistemic regimes of standard setting in health professions education. Adv Health Sci Educ Theory Pract. Published online May 6, 2026. DOI: 10.1007/s10459-026-10542-y
- Ryan MS, Teunissen PW, Parsons AS, et al. Inside Their Minds: A Multi-Institutional Exploration into the Decision-Making of Medical School Competency Committee Members. Perspect Med Educ. 2026;15(1):53–64. DOI: 10.5334/pme.2361
- Ekpenyong A, Holmboe ES, Govaerts M, Heeneman S. Investigating the Roles and Impact of Clinical Competency Committees in Graduate Medical Education: A Narrative Review. J Grad Med Educ. 2024;16(6):662–683. DOI: 10.4300/JGME-D-24-00017.1
- Torre D, Schuwirth L. Programmatic assessment for learning: a programmatically designed assessment for the purpose of learning: AMEE Guide No. 174. Med Teach. 2025;47(6):918–933. DOI: 10.1080/0142159X.2024.2409936
- Ramani S, Armson H, Hanmore T, et al. Could the R2C2 Feedback and Coaching Model Enhance Feedback Literacy Behaviors: A Qualitative Study Exploring Learner-Preceptor Feedback Conversations. Perspect Med Educ. 2025;14(1):9–19. DOI: 10.5334/pme.1368
- Ismaeel R, Riggs J, Ott M, et al. Assessment burden by design: exploring the variability in competence by design assessment forms. Can Med Educ J. Published online December 8, 2025. DOI: 10.36834/cmej.81428
- Ott MC, Dengler L, Hibbert K, Ott M. Fixing disconnects: exploring the emergence of principled adaptations in a competency-based curriculum. Med Educ. 2025;59(4):428–438. DOI: 10.1111/medu.15475
- Ismaeel R, Pusic L, Gottlieb M, Chan TM, Oyedokun TO, Thoma B. Bias in Observed Assessments in Medical Education: A Scoping Review. Acad Med. 2024;99(12):1438–1450. DOI: 10.1097/ACM.0000000000005794
- Mangalindan KE, Wyatt TR, Brown KR, Shapiro M, Maggio LA. Investigating the Road to Equity: A Scoping Review of Solutions to Mitigate Implicit Bias in Assessment within Medical Education. Perspect Med Educ. 2025;14(1):92–106. DOI: 10.5334/pme.1716
- Desai SV, Burk-Rafel J, Lomis KD, et al. Precision Education: The Future of Lifelong Learning in Medicine. Acad Med. 2024;99(4S):S14–S20. DOI: 10.1097/ACM.0000000000005601
- Preyra R, Mishra S, Khan H, et al. Exploring “Talent” in Medical Education: A Scoping Review. Perspect Med Educ. 2026;15(1):75–92. DOI: 10.5334/pme.1859
- Plastino E, Purdy M. Game changing value from artificial intelligence: eight strategies. Strategy Leadersh. Published online 2018. DOI: 10.1108/SL-11-2017-0106
- Morrison M, Lăzăroiu G. Cognitive Internet of Medical Things, big healthcare data analytics, and artificial intelligence-based diagnostic algorithms during the COVID-19 pandemic. Am J Med Res. 2021;8(2):23–36. DOI: 10.22381/ajmr8220212
- Duan Y, Edwards JS, Dwivedi YK. Artificial intelligence for decision making in the era of Big Data–evolution, challenges and research agenda. Int J Inf Manag. 2019;48:63–71. DOI: 10.1016/j.ijinfomgt.2019.01.021
- Carey R, Wilson G, Bandi V, et al. Developing a dashboard to meet the needs of residents in a competency-based training program: a design-based research project. Can Med Educ J. 2020;11(6):
e31 . DOI: 10.36834/cmej.69682 - Yilmaz Y, Carey R, Chan TM, et al. Developing a dashboard for faculty development in competency-based training programs: a design-based research project. Can Med Educ J Rev Can Léducation Médicale. 2021;12(4):48–64. DOI: 10.36834/cmej.72067
- Thoma B, Bandi V, Carey R, et al. Developing a dashboard to meet Competence Committee needs: a design-based research project. Can Med Educ J. Published online January 7, 2020. DOI: 10.36834/cmej.68903
- Schoenherr JR, Hamstra SJ. Psychometrics and its discontents: An historical perspective on the discourse of the measurement tradition. Adv Health Sci Educ. 2016;21:719–729. DOI: 10.1007/s10459-015-9623-z
- Symonds PM. Factors influencing test reliability. J Educ Psychol. 1928;19(2):73–87. DOI: 10.1037/h0071867
- McConnell M, Sherbino J, Chan TM. Mind the gap: the prospects of missing data. J Grad Med Educ. 2016;8(5):708–712. DOI: 10.4300/JGME-D-16-00142.1
- The Core Entrustable Professional Activities (EPAs) for Entering Residency. AAMC.
https://www.aamc.org/about-us/mission-areas/medical-education/cbme/core-epas (Accessed July 10, 2024). - Duran RP, Eisenhart MA, Erickson FD, et al. Standards for reporting on empirical social science research in AERA publications: American Educational Research Association. Educ Res. 2006;35(6):33–40. DOI: 10.3102/0013189X035006033
- Messick S. Test validity and the ethics of assessment. American Psychologist, 35(11);1012–1027. DOI: 10.1037/0003-066X.35.11.1012
- Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A Practical Guide to Their Development and Use. Oxford University Press; 2015. DOI: 10.1093/med/9780199685219.001.0001
- Pusic M, Pecaric M, Boutis K. How much practice is enough? Using learning curves to assess the deliberate practice of radiograph interpretation. Acad Med. 2011;86(6):731–736. DOI: 10.1097/ACM.0b013e3182178c3c
- Pusic MV, Boutis K, Hatala R, Cook DA. Learning curves in health professions education. Acad Med. 2015;90(8):1034–1042. DOI: 10.1097/ACM.0000000000000681
- Chan TM, Dowling S, Tastad K, Chin A, Thoma B. Integrating training, practice, and reflection within a new model for Canadian medical licensure: A concept paper prepared for the Medical Council of Canada. Can Med Educ J Rev Can Léducation Médicale. 2022;13(4):68–81. DOI: 10.36834/cmej.73717
- Cheung WJ, Bhanji F, Gofton W, et al. Design and Implementation of a National Program of Assessment Model – Integrating Entrustable Professional Activity Assessments in Canadian Specialist Postgraduate Medical Education. Perspect Med Educ. 13(1):44–55. DOI: 10.5334/pme.956
- Warm EJ, Kinnear B, Knopp MI, et al. Ambulatory Long Block: A Model of Precision Education and Assessment for Internal Medicine Residents. Acad Med. 2024;99(4S):S57–S63. DOI: 10.1097/ACM.0000000000005610
DOI: https://doi.org/10.5334/pme.2818 | Journal eISSN: 2212-277X
Language: English
Page range: 830 - 844
Submitted on: May 22, 2026
Accepted on: Aug 19, 2026
Published on: Sep 16, 2026
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
© 2026 Sandra Monteiro, Matthew Sibbald, Matthew Lineberry, Teresa M. Chan, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.