References
- 1Schuwirth LW, van der Vleuten CM. A history of assessment in medical education. Adv Health Sci Educ Theory Pract. 2020; 25(5): 1045–56. DOI: 10.1007/s10459-020-10003-0
- 2Schuwirth LW, van der Vleuten CM. A plea for new psychometric models in educational assessment. Med Educ. 2006; 40(4): 296–300. DOI: 10.1111/j.1365-2929.2006.02405.x
- 3Gingerich A, et al. Seeing the ‘black box’ differently: assessor cognition from three research perspectives. Med Educ. 2014; 48(11): 1055–68. DOI: 10.1111/medu.12546
- 4Jones A. The place of judgement in competency-based assessment. J Vocat Educ Train. 1999; 51(1): 145–60. DOI: 10.1080/13636829900200073
- 5Bacon R, et al. Competency-based assessment for clinical supervisors: design-based research on a web-delivered program. JMIR Res Protoc. 2015; 4(1):
e26 . DOI: 10.2196/resprot.3893 - 6Govaerts M, van der Vleuten CM. Validity in work-based assessment: expanding our horizons. Med Educ. 2013; 47(12): 1164–74. DOI: 10.1111/medu.12289
- 7Hodges B. Assessment in the post-psychometric era: learning to love the subjective and collective. Med Teach. 2013; 35(7): 564–8. DOI: 10.3109/0142159X.2013.789134
- 8Ten Cate O, Regehr G. The Power of Subjectivity in the Assessment of Medical Trainees. Acad Med. 2019; 94(3): 333–37. DOI: 10.1097/ACM.0000000000002495
- 9Rotthoff T. Standing up for Subjectivity in the Assessment of Competencies. GMS J Med Educ. 2018; 35(3): Doc29.
- 10Gipps C, Stobart G.
Fairness in Assessment . In: Wyatt-Smith C, Cumming JJ (eds.), Educational Assessment in the 21st Century: Connecting Theory and Practice. Netherlands: Dordrecht: Springer; 2009. 105–18. DOI: 10.1007/978-1-4020-9964-9_6 - 11Dijkstra J, et al. Expert validation of fit-for-purpose guidelines for designing programmes of assessment. BMC Med Educ. 2012; 12: 20. DOI: 10.1186/1472-6920-12-20
- 12Schuwirth LW, et al. When enough is enough: a conceptual basis for fair and defensible practice performance assessment. Med Educ. 2002; 36(10): 925–30. DOI: 10.1046/j.1365-2923.2002.01313.x
- 13Boursicot K, et al. Performance assessment: Consensus statement and recommendations from the 2020 Ottawa Conference. Med Teach. 2021; 43(1): 58–67. DOI: 10.1080/0142159X.2020.1830052
- 14Gingerich A, Regehr G, Eva KW. Rater-based assessments as social judgments: rethinking the etiology of rater errors. Acad Med. 2011; 86(10 Suppl): S1–7. DOI: 10.1097/ACM.0b013e31822a6cf8
- 15Govaerts MJ, et al. Workplace-based assessment: effects of rater expertise. Adv Health Sci Educ Theory Pract. 2011; 16(2): 151–65. DOI: 10.1007/s10459-010-9250-7
- 16Valentine N, et al. Fairness in human judgement in assessment: a hermeneutic literature review and conceptual framework. Adv Health Sci Educ Theory Pract. 2021; 26(2): 713–38. DOI: 10.1007/s10459-020-10002-1
- 17Valentine N, et al. Making it fair: Learners’ and assessors’ perspectives of the attributes of fair judgement. Med Educ. 2021; 55(9): 1056–66. DOI: 10.1111/medu.14574
- 18Varpio L, et al. The distinctions between theory, theoretical framework, and conceptual framework. Acad Med. 2020; 95(7): 989–94. DOI: 10.1097/ACM.0000000000003075
- 19Olmos-Vega FM, et al. A practical guide to reflexivity in qualitative research: AMEE Guide No. 149. Med Teach. 2022; 1–11. DOI: 10.1080/0142159X.2022.2057287
- 20Varpio L, et al. Shedding the cobra effect: problematising thematic emergence, triangulation, saturation and member checking. Med Educ. 2017; 51(1): 40–50. DOI: 10.1111/medu.13124
- 21Stalmeijer RE, McNaughton N, Van Mook WN. Using focus groups in medical education research: AMEE Guide No. 91. Med Teach. 2014; 36(11): 923–39. DOI: 10.3109/0142159X.2014.917165
- 22Lipsitz LA, Goldberger AL. Loss of ‘complexity’ and aging: potential applications of fractals and chaos theory to senescence. JAMA. 1992; 267(13): 1806–09. DOI: 10.1001/jama.1992.03480130122036
- 23Holbrook MB. Adventures in complexity: An essay on dynamic open complex adaptive systems, butterfly effects, self-organizing order, coevolution, the ecological perspective, fitness landscapes, market spaces, emergent beauty at the edge of chaos, and all that jazz. Acad Mark Sci. 2003; 6(1): 1–184.
- 24Tsoukas H, Dooley KJ. Introduction to the special issue: Towards the ecological style: Embracing complexity in organizational research. Organ Stud. 2011; 32(6) 729–35. DOI: 10.1177/0170840611410805
- 25Plsek PE, Greenhalgh T. Complexity science: The challenge of complexity in health care. BMJ. 2001; 323(7313): 625–8. DOI: 10.1136/bmj.323.7313.625
- 26Mennin S. Self-organisation, integration and curriculum in the complex world of medical education. Med Educ. 2010; 44(1): 20–30. DOI: 10.1111/j.1365-2923.2009.03548.x
- 27Durning SJ, et al. Perspective: Redefining Context in the Clinical Encounter: Implications for Research and Training in Medical Education. Acad Med. 2010; 85(5): 894–901. DOI: 10.1097/ACM.0b013e3181d7427c
- 28Reed JE, et al. Simple rules for evidence translation in complex systems: A qualitative study. BMC Med. 2018; 16(1): 92. DOI: 10.1186/s12916-018-1076-9
- 29Fraser SW, Greenhalgh T. Coping with complexity: educating for capability. BMJ. 2001; 323(7316): 799–803. DOI: 10.1136/bmj.323.7316.799
- 30Bowe CM, Armstrong E. Assessment for Systems Learning: A Holistic Assessment Framework to Support Decision Making Across the Medical Education Continuum. Acad Med. 2017; 92(5): 585–92. DOI: 10.1097/ACM.0000000000001321
- 31Van Beurden EK, et al. Making sense in a complex landscape: how the Cynefin Framework from Complex Adaptive Systems Theory can inform health promotion practice. Health Promot Int. 2013; 28(1): 73–83. DOI: 10.1093/heapro/dar089
- 32Greenhalgh T, Papoutsi C. Studying complexity in health services research: desperately seeking an overdue paradigm shift. BMC Med. 2018; 16(1): 95. DOI: 10.1186/s12916-018-1089-4
- 33Kurtz CF, Snowden DJ. The new dynamics of strategy: Sense-making in a complex and complicated world. IBM Syst J. 2003; 42(3): 462–83. DOI: 10.1147/sj.423.0462
- 34Norman G. Chaos, complexity and complicatedness: lessons from rocket science. Med Educ. 2011; 45(6): 549–59. DOI: 10.1111/j.1365-2923.2011.03945.x
- 35Roberts C, et al. Exploring complexities in the reform of assessment practice: a critical realist perspective. Adv Health Sci Educ Theory Pract. 2021; 26(5): 1641–57. DOI: 10.1007/s10459-021-10065-8
- 36Schuwirth LW, van der Vleuten CM. Programmatic assessment: from assessment of learning to assessment for learning. Med Teach. 2011; 33(6): 478–85. DOI: 10.3109/0142159X.2011.565828
- 37Woodruff JN. Solutionism: A study of rigour in complex systems. Med Educ. 2021; 55(1): 12–5. DOI: 10.1111/medu.14377
- 38Wakefield TH.
An ontology of storytelling systemicity: Management, fractals and the Waldo Canyon fire . 2013; Doctorate of Management Doctoral dissertation. Colorado Springs, Colorado: Colorado Technical University.