Guidelines: the do’s, don’ts and don’t knows of feedback for clinical education

Evans C Making sense of assessment feedback in higher education Rev Educ Res 2013 83 70 120 10.3102/0034654312474350

Eva KW Armson H Holmboe E Factors influencing responsiveness to feedback: on the interplay between fear, confidence, and reasoning processes Adv Health Sci Educ Theory Pract 2012 17 15 26 10.1007/s10459-011-9290-7

Sargeant J Mann K van der Vleuten C Metsemakers J “Directed” self-assessment: practice and feedback within a social context J Contin Educ Health Prof 2008 28 47 54 10.1002/chp.155

Watling C Driessen E Van der Vleuten CPM Vanstone M Lingard L. Beyond individualism: professional culture and its influence on feedback Med Educ 2013 47 585 94 10.1111/medu.12150

Van de Ridder JMM Stokking KM McGaghie WC ten Cate OTJ What is feedback in clinical education? Med Educ 2008 42 189 97 10.1111/j.1365-2923.2007.02973.x

Teunissen PW Experience, trajectories, and reifications: an emerging framework of practice-based learning in healthcare workplaces Adv Heal Sci Educ 2015 20 843 56 10.1007/s10459-014-9556-y

Bing-You RG Paterson J Feedback falling on deaf ears: residents’ receptivity to feedback tempered by sender credibility Med Teach 1997 19 40 10.3109/01421599709019346

Sargeant J Mann K Ferrier S Exploring family physicians’ reactions to multisource feedback: perceptions of credibility and usefulness Med Educ 2005 39 497 504 10.1111/j.1365-2929.2005.02124.x

Sargeant J Mann K Sinclair D Van Der Vleuten C Metsemakers J Challenges in multisource feedback: intended and unintended outcomes Med Educ 2007 41 583 91 10.1111/j.1365-2923.2007.02769.x

Watling C Driessen E van der Vleuten CPM Lingard L Learning from clinical work: the roles of learning cues and credibility judgements Med Educ 2012 46 192 200 10.1111/j.1365-2923.2011.04126.x

Watling C Kenyon C Zibrowski E Rules of engagement: residents’ perceptions of the in-training evaluation process Acad Med 2008 83 10 S97 100 10.1097/ACM.0b013e318183e78c

Walsh C Ling S Carnahan H Concurrent versus terminal feedback: it may be better to wait Acad Med 2009 84 10 S54 7 10.1097/ACM.0b013e3181b38daf

Hattie J Timperley H The power of feedback Rev Educ Res 2007 77 81 112 10.3102/003465430298487

Ivers N Jamtvedt G Flottorp S Audit and feedback: effects on professional practice and healthcare outcomes Cochrane Database Syst Rev 2012 6 CD000259

Higgins E Zanna MP Promotion and prevention: regulatory focus as a motivational principle Advances in experimental social psychology 1998 San Diego Academic Press 1 46

Tuckey M Brewer N Williamson P The influence of motives and goal orientation on feedback seeking J Occup Organ Psychol 2002 75 195 216 10.1348/09631790260098677

Teunissen PW Bok HGJ Believing is seeing: how people’s beliefs influence goals, emotions and behaviour Med Educ 2013 47 1064 72 10.1111/medu.12228

Morrison E Cummings L The impact of feedback diagnosticity and performance expectations on feedback-seeking behaviour Hum Perform 1992 5 251 64 10.1207/s15327043hup0504_1

Tsui AS Ashford SJ Adaptive self-regulation: a process view of managerial effectiveness J Manage 1994 20 1 93 121

Teunissen PW Stapel DA van der Vleuten CPM Scherpbier AJJA Boor K Scheele F Who wants feedback? An investigation of the variables influencing residents’ feedback- seeking behavior in relation to night shifts Acad Med 2009 84 910 10.1097/ACM.0b013e3181a858ad

Molloy E Boud D. Seeking a different angle on feedback in clinical education: the learner as seeker, judge and user of performance information Med Educ 2013 47 227 9 10.1111/medu.12116

Boud D Molloy E. Rethinking models of feedback for learning: the challenge of design Assess Eval High Educ 2013 38 698 712 10.1080/02602938.2012.691462

Van de Ridder JMM McGaghie WC Stokking KM ten Cate OTJ Variables that affect the process and outcome of feedback, relevant for medical training: a meta-review Med Educ 2015 49 658 73 10.1111/medu.12744

Hewson M Little M Giving feedback in medical education J Gen Intern Med 1998 13 111 10.1046/j.1525-1497.1998.00027.x

Watling C Driessen E van der Vleuten CPM Vanstone M Lingard L Understanding responses to feedback: the potential and limitations of regulatory focus theory Med Educ 2012 46 593 603 10.1111/j.1365-2923.2012.04209.x

Lefroy J Hawarden A Gay SP McKinley RK Cleland J Grades in formative workplace-based assessment: a study of what works for whom and why Med Educ 2015 49 307 20 10.1111/medu.12659

Shute VJ Focus on formative feedback Rev Educ Res 2008 78 153 89 10.3102/0034654307313795

Kluger A DeNisi A The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory Psychol Bull 1996 119 254 10.1037/0033-2909.119.2.254

Weston PSJ Smith CA The use of mini-CEX in UK foundation training six years following its introduction: lessons still to be learned and the benefit of formal teaching regarding its utility Med Teach 2014 36 155 63 10.3109/0142159X.2013.836267

Goodman JS Wood RE Hendrickx M Feedback specificity, exploration, and learning J Appl Psychol 2004 89 248 62 10.1037/0021-9010.89.2.248

Sargeant J Mann K Sinclair D van der Vleuten C Metsemakers J Understanding the influence of emotions and reflection upon multi-source feedback acceptance and use Adv Heal Sci Educ Theory Pr 2008 13 275 88 10.1007/s10459-006-9039-x

Archer JC State of the science in health professional education: effective feedback Med Educ 2010 44 101 8 10.1111/j.1365-2923.2009.03546.x

Higgins E Making a good decision: value from fit Am Psychol 2000 55 1215 10.1037/0003-066X.55.11.1217

Kluger A Van Dijk A Feedback, the various tasks of the doctor, and the feedforward alternative Med Educ 2010 44 1166 10.1111/j.1365-2923.2010.03849.x

Bok HGJ Teunissen PW Spruijt A Clarifying students’ feedback-seeking behaviour in clinical clerkships Med Educ 2013 47 282 91 10.1111/medu.12054

Higgins R Hartley P Skelton A The Conscientious consumer: reconsidering the role of assessment feedback in student learning Stud High Educ 2002 27 53 64 10.1080/03075070120099368

Sadler DR Beyond feedback: developing student capability in complex appraisal Assess Eval High Educ 2010 35 535 50 10.1080/02602930903541015

Watling C Driessen E van der Vleuten CPM Lingard L Learning culture and feedback: an international study of medical athletes and musicians Med Educ 2014 48 713 23 10.1111/medu.12407

Wood D Bruner J Ross G The role of tutoring in problem-solving J Child Psychol Psychiatry 1976 17 89 100 10.1111/j.1469-7610.1976.tb00381.x

Vygotsky L Thought and language 1986 Cambridge MIT Press

Smith SE Tallentire VR Cameron HS Wood SM The effects of contributing to patient care on medical students’ workplace learning Med Educ 2013 47 1184 96 10.1111/medu.12217

Carless D Salter D Yang M Lam J Developing sustainable feedback practices Stud High Educ 2011 36 395 407 10.1080/03075071003642449

Lingard L Garwood K Schryer CF Spafford MM A certain art of uncertainty: case presentation and the development of professional identity Soc Sci Med 2003 56 603 16 10.1016/S0277-9536(02)00057-6

Sitzmann T Ely K A meta-analysis of self-regulated learning in work-related training and educational attainment: what we know and where we need to go Psychol Bull 2011 137 3 421 10.1037/a0022777

Overeem K “Paying it forward”: performance improvement through feedforward interviews Med Educ 2010 44 1159 61 10.1111/j.1365-2923.2010.03866.x

Dohrenwend A Serving up the feedback sandwich Fam Pract Manag 2002 9 43 6

Pendleton D Schofield T Tate P Havelock P The new consultation developing doctor-patient communication 2003 Oxford Oxford University Press 10.1093/med/9780192632883.001.0001

Cantillon P Sargeant J Giving feedback in clinical settings BMJ 2008 337 1292 4 10.1136/bmj.a1961

Kurtz S Silverman J Draper J Teaching and learning communication skills in medicine 2005 2 Oxford Radcliffe Publishing Ltd

Dijksterhuis MGK Schuwirth LWT Braat DDM Teunissen PW Scheele F A qualitative study on trainees’ and supervisors' perceptions of assessment for learning in postgraduate medical education Med Teach 2013 35 e1396 402 10.3109/0142159X.2012.756576

Telio S Ajjawi R Regehr G The “Educational Alliance” as a framework for reconceptualizing feedback in medical education Acad Med 2015 90 609 14 10.1097/ACM.0000000000000560

Sargeant JM Mann KV van der Vleuten CP Metsemakers JF Reflection: a link between receiving and using assessment feedback Adv Heal Sci Educ 2008 14 399 410 10.1007/s10459-008-9124-4

Schultz KW Kirby J Delva D Medical students’ and residents’ preferred site characteristics and preceptor behaviours for learning in the ambulatory setting: a cross-sectional survey BMC Med Educ 2004 4 12 10.1186/1472-6920-4-12

Minehart R Rudolph J Pian-Smith M Raemar D Improving faculty feedback to resident trainees during a simulated case Anesthesiology 2014 120 160 71 10.1097/ALN.0000000000000058

Sox CM Dell M Phillipi CA Cabral HJ Vargas G Lewin LO feedback on oral presentations during pediatric clerkships: a randomized controlled trial Pediatrics 2014 134 965 71 10.1542/peds.2014-1209

Norcini J Burch V Workplace-based assessment as an educational tool: AMEE Guide No. 31 Med Teach 2007 29 855 10.1080/01421590701775453

Lipnevich AA Smith JK Effects of differential feedback on students’ examination performance J Exp Psychol Appl 2009 15 319 33 10.1037/a0017841

Driessen E Scheele F What is wrong with assessment in postgraduate training? Lessons from clinical practice and educational research Med Teach 2013 35 569 74 10.3109/0142159X.2013.798403

Van Merriënboer JJG Sweller J Cognitive load theory in health professional education: design principles and strategies Med Educ 2010 44 85 93 10.1111/j.1365-2923.2009.03498.x

Kalyuga S Instructional benefits of spoken words: a review of cognitive load factors Educ Res Rev 2012 7 145 59 10.1016/j.edurev.2011.12.002

Eraut M Learning from other people in the workplace Oxford Rev Educ 2007 33 403 22 10.1080/03054980701425706

Billett S Toward a workplace pedagogy: guidance, participation, and engagement Adult Educ Q 2002 53 27 43 10.1177/074171302237202

GMC. Tomorrow’s doctors the duties of a doctor registered with the General Medical Council. 2009.

Eva K Regehr G Self-assessment in the health professions: a reformulation and research agenda Acad Med 2005 80 46 10.1097/00001888-200510001-00015

Raat J Kuks J Cohen-Schotanus J Learning in clinical practice: stimulating and discouraging response to social comparison Med Teach 2010 32 899 904 10.3109/0142159X.2010.497820

Urquhart LM Rees CE Ker JS Making sense of feedback experiences: a multi-school study of medical students’ narratives Med Educ 2014 48 189 203 10.1111/medu.12304

Bates J Konkin J Suddards C Dobson S Pratt D Student perceptions of assessment and feedback in longitudinal integrated clerkships Med Educ 2013 47 362 74 10.1111/medu.12087

Veloski J Boex JR Grasberger J Evans A Wolfson DB Systematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME Guide No. 7 Med Teach 2006 28 2 117 10.1080/01421590600622665

Bok HG Teunissen PW Favier RP Programmatic assessment of competency-based workplace learning: when theory meets practice BMC Med Educ 2013 13 123 10.1186/1472-6920-13-123

Hägg-Martinell A Hult H Henriksson P Kiessling A Students perceive healthcare as a valuable learning environment when accepted as a part of the workplace community Educ Heal Chang Learn Pract 2014 27 15 23

Lefroy J Thomas A Harrison C Development and face validation of strategies for improving consultation skills Adv Heal Sci Educ 2014 19 661 85 10.1007/s10459-014-9493-9

Jippes E Steinert Y Pols J Achterkamp M van Engelen J Brand P How do social networks and faculty development courses affect clinical supervisors’ adoption of a medical education innovation? An exploratory study Acad Med 2013 88 398 404 10.1097/ACM.0b013e318280d9db

Jippes E Van Luijk SJ Pols J Achterkamp MC Brand PLP Van Engelen JML Facilitators and barriers to a nationwide implementation of competency-based postgraduate medical curricula: a qualitative study Med Teach 2012 34 e589 602 10.3109/0142159X.2012.670325

Van der Vleuten CPM Schuwirth LWT Assessing professional competence: from methods to programmes Med Educ 2005 39 309 17 10.1111/j.1365-2929.2005.02094.x

Schuwirth LWT Van der Vleuten CPM Programmatic assessment: from assessment of learning to assessment for learning Med Teach 2011 33 478 85 10.3109/0142159X.2011.565828

Driessen EW van Tartwijk J Govaerts M Teunissen P van der Vleuten CPM The use of programmatic assessment in the clinical workplace: a Maastricht case report Med Teach 2012 34 226 31 10.3109/0142159X.2012.652242

Bok HGJ Jaarsma ADC Spruijt A Van Beukelen P Van Der Vleuten CPM Teunissen PW Feedback-giving behaviour in performance evaluations during clinical clerkships Med Teach 2015 00 1 8 10.3109/0142159X.2015.1017448

Nasca TJ Weiss KB Bagian JP Improving clinical learning environments for for tomorrow ’ s physicians N Engl J Med 2014 370 2014 6 10.1056/NEJMp1314628

Wearne S Dornan T Teunissen PW Skinner T General practitioners as supervisors in postgraduate clinical education: an integrative review Med Educ 2012 46 1161 73 10.1111/j.1365-2923.2012.04348.x

Alves de Lima A Conde D Costabel J Corso J van der Vleuten C A laboratory study on the reliability estimations of the mini-CEX Adv Heal Sci Educ 2013 18 5 13 10.1007/s10459-011-9343-y

Hammoud MM Edwards ME Lyon JA White C Is video review of patient encounters an effective tool for medical student learning? A review of the literature Adv Med Educ Pract 2012 3 19 30 10.2147/AMEP.S20219

Fluit CV Bolhuis S Klaassen T Residents provide feedback to their clinical teachers: reflection through dialogue Med Teach 2013 35 e1485 92 10.3109/0142159X.2013.785631

Fokkema J Scheele F Westerman M Research reports perceived effects of innovations in postgraduate medical education: a q study focusing on workplace-based assessment Acad Med 2014 89 1259 66 10.1097/ACM.0000000000000394

Watling C Driessen E van der Vleuten CPM Vanstone M Lingard L Music lessons: revealing medicine’s learning culture through a comparison with that of music Med Educ 2013 47 842 50 10.1111/medu.12235

Boor K Teunissen PW Scherpbier AJJA van der Vleuten CPM van de Lande J Scheele F Residents’ perceptions of the ideal clinical teacher-a qualitative study Eur J Obstet Gynecol Reprod Biol 2008 140 152 7 10.1016/j.ejogrb.2008.03.010

Van der Vleuten CPM Schuwirth LWT Driessen EW A model for programmatic assessment fit for purpose Med Teach 2012 34 205 14 10.3109/0142159X.2012.652239

Massie J, Ali JM. Workplace-based assessment: a review of user perceptions and strategies to address the identified shortcomings. Adv Health Sci Educ Theory Pract. 2015. doi:10.1007/s10459-015-9614-0.

Eva KW Regehr G Exploring the divergence between self-assessment and self-monitoring Adv Health Sci Educ Theory Pract 2011 16 311 29 10.1007/s10459-010-9263-2

Gabelica C Van Den Bossche P Segers M Gijselaers W Feedback, a powerful lever in teams: a review Educ Res Rev 2012 7 123 44 10.1016/j.edurev.2011.11.003

Rowe AD, Wood LN. What feedback do students want? Australian Educational Researcher. 2007. http://www.aare.edu.au/publications-database.php/5501/what-feedback-do-students-want. Accessed 6 Aug 2015.

Cavalcanti RB Detsky AS The education and training of future physicianswhy coaches can’t be judges JAMA 2011 306 993 4

Kogan JR Conforti LN Bernabeo EC Durning SJ Hauer KE Holmboe ES Faculty staff perceptions of feedback to residents after direct observation of clinical skills Med Educ 2012 46 201 15 10.1111/j.1365-2923.2011.04137.x