Have a personal or library account? Click to login
Optimizing assessors’ mental workload in rater-based assessment: a critical narrative review Cover

Optimizing assessors’ mental workload in rater-based assessment: a critical narrative review

Open Access
|Nov 2019

References

  1. 1.
    Lockyer J Carraccio C Chan M Core principles of assessment in competency-based medical education Med Teach 2017 39 609 616 10.1080/0142159X.2017.1315082
  2. 2.
    Holmboe ES Sherbino J Long DM Swing SR Frank JR International CBME Collaborators The role of assessment in competency-based medical education Med Teach 2010 32 676 682 10.3109/0142159X.2010.500704
  3. 3.
    Eva K Cognitive influences on complex performance assessment: lessons from the interplay between medicine and psychology J App Res Mem Cogn 2018 7 177 188 10.1016/j.jarmac.2018.03.008
  4. 4.
    Govaerts MJ van der Vleuten CP Schuwirth LW Muijtens AM Broadening perspectives on clinical performance assessment: rethinking the nature of in-training assessment Adv Health Sci Educ Theory Pract 2007 12 239 260 10.1007/s10459-006-9043-1
  5. 5.
    Tavares W Eva KW Exploring the impact of mental workload on rater-based assessments Adv Health Sci Educ Theory Pract 2013 18 291 303 10.1007/s10459-012-9370-3
  6. 6.
    Epstein RM Assessment in medical education N Engl J Med 2007 356 387 396 10.1056/NEJMra054784
  7. 7.
    Watkins S Roberts DA Boulet JR McEvoy MD Weinger MB Evaluation of a simpler tool to assess nontechnical skills during simulated critical events Simul Healthc 2017 12 69 75 10.1097/SIH.0000000000000199
  8. 8.
    Gauthier G St-Onge C Tavares. Rater cognition: review and integration of research findings Med Educ 2016 50 511 522 10.1111/medu.12973
  9. 9.
    Whitehead CR Kuper A Hodges B Ellaway R Conceptual and practical challenges in the assessment of physician competencies Med Teach 2015 37 245 251 10.3109/0142159X.2014.993599
  10. 10.
    Govaerts MJB Schuwirth LWT van der Vleuten CPM Muijtjens AMM Workplace-based assessment: effects of rater expertise Adv Health Sci Educ Theory Pract 2011 16 151 165 10.1007/s10459-010-9250-7
  11. 11.
    Cleaton N Yeates P McCray G Exploring the relationship between examiners’ memories for performances, domain separation and score variability Med Teach 2018 10.1080/0142159X.2018.1463088
  12. 12.
    Wood TJ Mental workload as a tool for understanding dual processes in rater-based assessments Adv Health Sci Educ Theory Pract 2013 18 523 525 10.1007/s10459-012-9396-6
  13. 13.
    Byrne A Mental workload as a key factor in clinical decision making Adv Health Sci Educ Theory Pract 2013 18 537 545 10.1007/s10459-012-9360-5
  14. 14.
    Ferrari R Writing narrative style literature reviews Med Writ 2015 24 230 235 10.1179/2047480615Z.000000000329
  15. 15.
    Byrne A Tweed N Halligan C A pilot study of the mental workload of objective structured clinical examination examiners Med Educ 2014 48 262 267 10.1111/medu.12387
  16. 16.
    Byrne A Soskova T Dawkins J Coombes L A pilot study of marking accuracy and mental workload as measures of OSCE examiner performance BMC Med Educ 2016 16 191 10.1186/s12909-016-0708-z
  17. 17.
    Tavares W Eva KW Impact of rating demands on rater-based assessments of clinical competence Educ Prim Care 2014 25 308 318 10.1080/14739879.2014.11730760
  18. 18.
    Tavares W Ginsburg S Eva KW Selecting and simplifying: rater performance and behavior when considering multiple competencies Teach Learn Med 2016 28 41 51 10.1080/10401334.2015.1107489
  19. 19.
    Hurley KF Giffin NA Stewart SA Bullock GB Probing the effect of OSCE checklist length on inter-observer reliability and observer accuracy Med Educ Online 2015 20 29242 10.3402/meo.v20.29242
  20. 20.
    Tavares W Sadowski A Eva KW Asking for less and getting more: the impact of broadening a rater’s focus in formative assessment Acad Med 2018 93 1584 1590 10.1097/ACM.0000000000002294
  21. 21.
    Byrne A Measurement of mental workload in clinical medicine: a review study. Anesth Pain IEEE Trans Med Imaging 2011 1:90 4
  22. 22.
    Naismith LM Cavalcanti RB Validity of cognitive load measures in simulation-based training: a systematic review Acad Med 2015 90 S24 S35 10.1097/ACM.0000000000000893
  23. 23.
    Cook DA Dupras DM Beckman TJ Thomas KG Pankratz VS Effect of rater training on reliability and accuracy of mini-CEX scores: a randomized, controlled trial J Gen Intern Med 2009 24 74 79 10.1007/s11606-008-0842-3
  24. 24.
    Allen PM Edwards JA Snyder FJ Makinson KA Hamby DM The effect of cognitive load on decision making with graphically displayed uncertainty information Risk Anal 2014 34 1495 1505 10.1111/risa.12161
  25. 25.
    Berendonk C Stalmeijer RE Schuwirth LWT Expertise in performance assessment: assessors’ perspectives. Adv Health Sci Educ IEEE Trans Med Imaging 2013 18:559 71
  26. 26.
    Govaerts MJB Van de Wiel MWJ Schuwirth LWT, Van der Vleuten CPM, Muijtjens AMM. Workplace-based assessment: raters’ performance theories and constructs. Adv in Health Sci Educ IEEE Trans Med Imaging 2013 18:375 96
  27. 27.
    Oudkerk Pool A Govaerts MJB Jaarsma DADC Driessen EW From aggregation to interpretation: how assessors judge complex data in a competency-based portfolio. Adv Health Sci Educ IEEE Trans Med Imaging 2018 23:275 87
  28. 28.
    Schutz A Moss PA Reasonable decisions in portfolio assessment: evaluating complex evidence of teaching. Educ Policy Analysis Archives IEEE Trans Med Imaging 2004 12 33
  29. 29.
    Crossley J Johnson G Booth J Wade W Good questions, good answers: construct alignment improves the performance of workplace based assessment scales Med Educ 2011 45 914 919 10.1111/j.1365-2923.2010.03913.x
  30. 30.
    Boyer CA Lutfey KE Examining critical health policy issues within and beyond the clinical encounter: patient-provider relationships and help-seeking behaviors J Health Soc Behav 2010 51 S80 S93 10.1177/0022146510383489
Language: English
Published on: Nov 14, 2019
Published by: Bohn Stafleu van Loghum
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2019 Bridget Paravattil, Kyle John Wilby, published by Bohn Stafleu van Loghum
This work is licensed under the Creative Commons Attribution 4.0 License.