Have a personal or library account? Click to login
How We Built Workplace Based Assessment-for-Learning in Irish GP Training Cover

How We Built Workplace Based Assessment-for-Learning in Irish GP Training

Open Access
|Jul 2025

References

  1. Schuwirth LW, Van der Vleuten CP. Programmatic assessment: From assessment of learning to assessment for learning. Med Teach. 2011;33(6):47885. DOI: 10.3109/0142159X.2011.565828
  2. Bok H, Teunissen T, Favier Rea. Programmatic Assessment of Competency Based Workplace Learning: where theory meets practice. Med Educ. 2013;13:123. DOI: 10.1186/1472-6920-13-123
  3. van der Vleuten CP, Schuwirth LW, Driessen EW, Dijkstra J, Tigelaar D, Baartman LK, et al. A model for programmatic assessment fit for purpose. Med Teach. 2012;34(3):20514. DOI: 10.3109/0142159X.2012.652239
  4. van der Vleuten CP, Heeneman S. On the issue of costs in programmatic assessment. Perspect Med Educ. 2016;5(5):3037. DOI: 10.1007/S40037-016-0295-Z
  5. Jackson D, Davison I, Adams R, Edordu A, Picton A. A systematic review of supervisory relationships in general practitioner training. Med Educ. 2019;53(9):87485. DOI: 10.1111/medu.13897
  6. O’Dowd E, Lydon S, O’Connor P, Madden C, Byrne D. A systematic review of 7 years of research on entrustable professional activities in graduate medical education, 2011–2018. Med Educ. 2019;53(3):23449. DOI: 10.1111/medu.13792
  7. Schultz K, Griffiths J, Lacasse M. The Application of Entrustable Professional Activities to Inform Competency Decisions in a Family Medicine Residency Program. Acad Med. 2015;90(7):88897. DOI: 10.1097/ACM.0000000000000671
  8. Ten Cate O, Chen HC, Hoff RG, Peters H, Bok H, Van Der Schaaf M. Curriculum development for the workplace using Entrustable Professional Activities (EPAs): AMEE Guide No. 99. Med Teach. 2015;37(11):9831002. DOI: 10.3109/0142159X.2015.1060308
  9. De Jonge LPJWM, Timmerman AA, Govaerts MJB, Muris JWM, Muijtjens AMM, Kramer AWM, et al. Stakeholder perspectives on workplace-based performance assessment: towards a better understanding of assessor behaviour. Adv Health Sci Educ. 2017;22(5):121343. DOI: 10.1007/s10459-017-9760-7
  10. Torre D, Schuwirth L, Van der Vleuten C, Heeneman S. An international study on the implementation of programmatic assessment: Understanding challenges and exploring solutions. Med Teach. 2022;44(8):92837. DOI: 10.1080/0142159X.2022.2083487
  11. Barrett A, Galvin R, Steinert Y, Scherpbier A, O’Shaughnessy A, Horgan M, et al. A BEME (Best Evidence in Medical Education) review of the use of workplace-based assessment in identifying and remediating underperformance among postgraduate medical trainees: BEME Guide No. 43. Med Teach. 2016;38(12):118898. DOI: 10.1080/0142159X.2016.1215413
  12. Jackson D, Davison I. Tensions in postgraduate training: Meaningful engagement or ‘tick-box’ supervision? Med Educ. 2020;54(11):9702. DOI: 10.1111/medu.14300
  13. Toale C, Nally DM, Ryan DM, Morris M, Kavanagh DO. How do Trainers and Trainees use Formative Workplace-based Assessments of Operative Competence to Deliver and Receive Structured Feedback? J Surg Educ. 2022;79(2):48591. DOI: 10.1016/j.jsurg.2021.08.023
  14. Prentice S, Benson J, Kirkpatrick E, Schuwirth L. Workplace-based assessments in postgraduate medical education: A hermeneutic review. Med Educ. 2020;54(11):98192. DOI: 10.1111/medu.14221
  15. Govaerts M. Workplace-Based Assessment and Assessment for Learning: Threats to Validity. J Grad Med Educ. 2015;7(2):2657. DOI: 10.4300/JGME-D-15-00101.1
  16. Prins SH, Brondt SG, Malling B. Implementation of workplace-based assessment in general practice. Educ Prim Care. 2019;30(3):13344. DOI: 10.1080/14739879.2019.1588788
  17. Barrett A, Hanley K. Myths and legends in workplace-based assessment; it’s all about perspective? Educ Prim Care. 2020;31(2):7480. DOI: 10.1080/14739879.2020.1712664
  18. Jamieson J, Hay M, Gibson S, Palermo C. Implementing programmatic assessment transforms supervisor attitudes: An explanatory sequential mixed methods study. Med Teach. 2021;43(6):70917. DOI: 10.1080/0142159X.2021.1893678
  19. McEllistrem B, Barrett A, Hanley K. Performance in practice; exploring trainer and trainee experiences of user-designed formative assessment tools. Educ Prim Care. 2021;32(1):2733. DOI: 10.1080/14739879.2020.1815085
  20. Taylor DR, Park YS, Egan R, Chan MK, Karpinski J, Touchie C, et al. EQual, a Novel Rubric to Evaluate Entrustable Professional Activities for Quality and Structure. Acad Med. 2017;92(11S)S110S7. Association of American Medical Colleges Learn Serve Lead: Proceedings of the 56th Annual Research in Medical Education Sessions. DOI: 10.1097/ACM.0000000000001908
  21. Windak A, Rochfort A, Jacquet J. The revised European Definition of General Practice/Family Medicine. A pivotal role of One Health, Planetary Health and Sustainable Development Goals. Eur J Gen Pract. 2024;30(1):2306936. DOI: 10.1080/13814788.2024.2306936
  22. Family Medicine Milestones US. The Accrediation Council for Graduate Medical Education; 2019.
  23. WPBA capabilities with IPUs RCGP: Royal College of General Practitioners; 2021 Available from: https://www.rcgp.org.uk/mrcgp-exams/wpba/capability-framework.
  24. EPAs in Medical Education: Competency based training with MyProgress: MyKnowledgeMap; 2024 Available from: https://www.myknowledgemap.com/news-events/posts/epas-in-medical-education-competency-based-training-with-myprogress/.
  25. Biggs JB. Aligning teaching for constructive learning: The Higher Education Academy; 2003 Available from: https://www.biol.uzh.ch/education/pdf/ConstructiveAlignment_Biggs.pdf.
  26. McEllistrem B, Hennus M, Fawns T, Hanley K. Dashboard Implementation Exploring the Irish General Practice training community’s perceptions on how an Entrustable Professional Activities could facilitate the delivery of General Practice training in Ireland. Educ Prim Care. 2022;34(3):19. DOI: 10.1080/14739879.2023.2191340
  27. Rothwell C, Kehoe A, Farook SF, Illing J. Enablers and barriers to effective clinical supervision in the workplace: a rapid evidence review. BMJ Open. 2021;11(9):e052929. DOI: 10.1136/bmjopen-2021-052929
  28. Schut S, Maggio LA, Heeneman S, van Tartwijk J, van der Vleuten C, Driessen E. Where the rubber meets the road – An integrative review of programmatic assessment in health care professions education. Perspect Med Educ. 2021;10(1):613. DOI: 10.1007/S40037-020-00625-W
  29. Govaerts M, Van Der Vleuten CP. Validity in work-based assessment: expanding our horizons. Med Educ. 2013;47(12):116474. DOI: 10.1111/medu.12289
  30. Driessen E, Scheele F. What is wrong with assessment in postgraduate training? Lessons from clinical practice and educational research. Med Teach. 2013;35(7):56974. DOI: 10.3109/0142159X.2013.798403
  31. Ben David MF, Davis MH, Harden RM, Howie PW, Ker J, Pippard MJ. AMEE Medical Education Guide No. 24: Portfolios as a method of student assessment. Med Teach. 2001;23(6):53551. DOI: 10.1080/01421590120090952
  32. Duitsman ME, Fluit CRMG, Van Alfen-Van Der Velden JAEM, De Visser M, Ten Kate-Booij M, Dolmans DHJM, et al. Design and evaluation of a clinical competency committee. Perspect Med Educ. 2019;8(1):18. DOI: 10.1007/S40037-018-0490-1
  33. Norcini J, Anderson B, Bollela V, Burch V, Costa MJ, Duvivier R, et al. Criteria for good assessment: Consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach. 2011;33(3):20614. DOI: 10.3109/0142159X.2011.551559
  34. Colbert CY, French JC, Herring ME, Dannefer EF. Fairness: the hidden challenge for competency-based postgraduate medical education programs. Perspect Med Educ. 2017;6(5):34755. DOI: 10.1007/S40037-017-0359-8
  35. Promes SB, Wagner MJ. Starting a Clinical Competency Committee. J Grad Med Educ. 2014;6(1):1634. DOI: 10.4300/JGME-D-13-00444.1
  36. Noble C, Billett S, Armit L, Collier L, Hilder J, Sly C, et al. “It’s yours to take”: generating learner feedback literacy in the workplace. Adv Health Sci Educ. 2020;25(1):5574. DOI: 10.1007/s10459-019-09905-5
  37. Carless D. Double duty, shared responsibilities and feedback literacy. Perspect Med Educ; 2020. DOI: 10.1007/S40037-020-00599-9
  38. Xu Y, Carless D. ‘Only true friends could be cruelly honest’: cognitive scaffolding and social-affective support in teacher feedback literacy. Assess Eval High Educ. 2017;42(7):108294. DOI: 10.1080/02602938.2016.1226759
  39. Richardson D, Kinnear B, Hauer KE, Turner TL, Warm EJ, Hall AK, et al. Growth mindset in competency-based medical education. Med Teach. 2021:17. DOI: 10.1080/0142159X.2021.1928036
  40. Cook DA, Zendejas B, Hamstra SJ, Hatala R, Brydges R. What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment. Adv Health Sci Educ. 2014;19(2):23350. DOI: 10.1007/s10459-013-9458-4
  41. Ten Cate O, Taylor DR. The recommended description of an entrustable professional activity: AMEE Guide No. 140. Med Teach. 2021;43(10):110614. DOI: 10.1080/0142159X.2020.1838465
  42. McEllistrem B, Hennus MP, Fawns T, Hanley K. Exploring the Irish general practice training community’s perceptions on how an entrustable professional activities dashboard implementation could facilitate general practice training in Ireland. Educ Prim Care. 2023:19. DOI: 10.1080/14739879.2023.2191340
  43. Schuwirth L, van der Vleuten CP. How to design a useful test : The Principles of Assessment. In: Swanwick T, editor. Understanding Medical Education. Hoboken, New Jersey, USA: Wiley Blackwell; 2019.
  44. Heeneman S, De Jong LH, Dawson LJ, Wilkinson TJ, Ryan A, Tait GR, et al. Ottawa 2020 consensus statement for programmatic assessment – 1. Agreement on the principles. Med Teach. 2021;43(10):113948. DOI: 10.1080/0142159X.2021.1957088
  45. Hoffman BD. Using self-determination theory to improve residency training: learning to make omelets without breaking eggs. Acad Med. 2015;90(4):40810. DOI: 10.1097/ACM.0000000000000523
  46. Crockett C, Joshi C, Rosenbaum M, Suneja M. Learning to drive: resident physicians’ perceptions of how attending physicians promote and undermine autonomy. BMC Med Educ. 2019;19(1):293. DOI: 10.1186/s12909-019-1732-6
  47. Schumacher DJ, Cate OT, Damodaran A, Richardson D, Hamstra SJ, Ross S, et al. Clarifying essential terminology in entrustment. Med Teach. 2021:18.
  48. St-Onge C, Young M, Eva KW, Hodges B. Validity: one word with a plurality of meanings. Adv Health Sci Educ Theory Pract. 2017;22(4):85367. DOI: 10.1007/s10459-016-9716-3
  49. Ginsburg S, Watling CJ, Schumacher DJ, Gingerich A, Hatala R. Numbers Encapsulate, Words Elaborate: Toward the Best Use of Comments for Assessment and Feedback on Entrustment Ratings. Acad Med. 2021;96(7S):S81S6. DOI: 10.1097/ACM.0000000000004089
DOI: https://doi.org/10.5334/pme.1428 | Journal eISSN: 2212-277X
Language: English
Submitted on: Jun 6, 2024
|
Accepted on: Dec 21, 2024
|
Published on: Jul 22, 2025
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2025 Karena Hanley, Edward McSwiney, Brian O. Malley, Aileen Barrett, Brian McEllistrem, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.