Self-Monitoring Accuracy over Time for a Complex Diagnostic Skill

Wolf E. Hautz; Thimo Marcin; Stefan K. Schauber; Robin Walter; Stefanie C. Hautz; Tanja Birrenbach; Beat Lehmann; Thomas C. Sauter; Roman Hari; Juliane E. Kämmer

doi:10.5334/pme.1767

Self-Monitoring Accuracy over Time for a Complex Diagnostic Skill

Volume 15 (2026): Issue 1

By: Wolf E. Hautz , Thimo Marcin , Stefan K. Schauber , Robin Walter , Stefanie C. Hautz , Tanja Birrenbach , Beat Lehmann , Thomas C. Sauter , Roman Hari and Juliane E. Kämmer

Open Access

|May 2026

Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier Ll. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 6. September 2006;296(9):1094–1102. DOI: 10.1001/jama.296.9.1094; PubMed PMID: 16954489.
Open DOI Search in Google Scholar Back to article
Arnold L, Willoughby TL, Calkins EV. Self-evaluation in undergraduate medical education: a longitudinal perspective. J Med Educ. Januar 1985;60(1):21–28. DOI: 10.1097/00001888-198501000-00004; PubMed PMID: 3965720.
Open DOI Search in Google Scholar Back to article
Artino AR, Brydges R, Gruppen LD. Self-regulated learning in healthcare profession education: theoretical perspectives and research methods. In: Researching medical education. Chichester, West Sussex; Hoboken, NJ: John Wiley & Sons, Ltd; 2015. S. 155–165. DOI: 10.1002/9781118838983.ch14
Open DOI Search in Google Scholar Back to article
Kruger J, Dunning D. Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments. J Pers Soc Psychol. Dezember 1999;77(6):1121–1134. DOI: 10.1037/0022-3514.77.6.1121; PubMed PMID: 10626367.
Open DOI Search in Google Scholar Back to article
Jansen RA, Rafferty AN, Griffiths TL. A rational model of the Dunning-Kruger effect supports insensitivity to evidence in low performers. Nat Hum Behav. Juni 2021;5(6):756–763. DOI: 10.1038/s41562-021-01057-0; PMID: 33633375.
Open DOI Search in Google Scholar Back to article
Barnsley L, Lyon PM, Ralston SJ, Hibbert EJ, Cunningham I, Gordon FC, u. a. Clinical skills in junior medical officers: a comparison of self-reported confidence and observed competence. Med Educ. April 2004;38(4):358–367. DOI: 10.1046/j.1365-2923.2004.01773.x; PubMed PMID: 15025637.
Open DOI Search in Google Scholar Back to article
Berner ES, Graber ML. Overconfidence as a cause of diagnostic error in medicine. Am J Med. Mai 2008;121(5 Suppl):S2–S23. DOI: 10.1016/j.amjmed.2008.01.001; PubMed PMID: 18440350.
Open DOI Search in Google Scholar Back to article
Hautz WE, Kämmer JE, Hautz SC, Sauter TC, Zwaan L, Exadaktylos AK, u. a. Diagnostic error increases mortality and length of hospital stay in patients presenting through the emergency room. Scand J Trauma Resusc Emerg Med. 8. Mai 2019;27(1):54. DOI: 10.1186/s13049-019-0629-z; PubMed PMID: 31068188; PubMed Central PMCID: PMC6505221.
Open DOI Search in Google Scholar Back to article
Johnson WR, Durning SJ, Allard RJ, Barelski AM, Artino AR. A scoping review of self-monitoring in graduate medical education. Med Educ. September 2023;57(9):795–806. DOI: 10.1111/medu.15023
Open DOI Search in Google Scholar Back to article
Eva KW, Regehr G. “I’ll never play professional football” and other fallacies of self-assessment. J Contin Educ Health Prof. 2008;28(1):14–19. DOI: 10.1002/chp.150; PubMed PMID: 18366120.
Open DOI Search in Google Scholar Back to article
Eva KW, Regehr G. Knowing when to look it up: a new conception of self-assessment ability. Acad Med J Assoc Am Med Coll. Oktober 2007;82(10 Suppl):S81–S84. DOI: 10.1097/ACM.0b013e31813e6755; PubMed PMID: 17895699.
Open DOI Search in Google Scholar Back to article
Eva KW, Regehr G. Exploring the divergence between self-assessment and self-monitoring. Adv Health Sci Educ Theory Pract. August 2011;16(3):311–329. DOI: 10.1007/s10459-010-9263-2; PubMed PMID: 21113820; PubMed Central PMCID: PMC3139875.
Open DOI Search in Google Scholar Back to article
McConnell MM, Regehr G, Wood TJ, Eva KW. Self-monitoring and its relationship to medical knowledge. Adv Health Sci Educ. August 2012;17(3):311–323. DOI: 10.1007/s10459-011-9305-4
Open DOI Search in Google Scholar Back to article
Hautz WE, Schubert S, Schauber SK, Kunina-Habenicht O, Hautz SC, Kämmer JE, u. a. Accuracy of self-monitoring: does experience, ability or case difficulty matter? Med Educ. Juli 2019;53(7):735–744. DOI: 10.1111/medu.13801
Open DOI Search in Google Scholar Back to article
Kämmer JE, Hautz WE, März M. Self-monitoring accuracy does not increase throughout undergraduate medical education. Med Educ. 2020;54(4):320–327. DOI: 10.1111/medu.14057
Open DOI Search in Google Scholar Back to article
Staal J, Katarya K, Speelman M, Brand R, Alsma J, Sloane J, u. a. Impact of performance and information feedback on medical interns’ confidence-accuracy calibration. Adv Health Sci Educ Theory Pract. März 2024;29(1):129–145. DOI: 10.1007/s10459-023-10252-9; PubMed PMID: 37329493; PubMed Central PMCID: PMC10927782.
Open DOI Search in Google Scholar Back to article
Staal J, Katarya K, Speelman M, Brand R, Alsma J, Sloane J, u. a. Impact of performance and information feedback on medical interns’ confidence-accuracy calibration. Adv Health Sci Educ Theory Pract. 17. Juni 2023. DOI: 10.1007/s10459-023-10252-9; PubMed PMID: 37329493.
Open DOI Search in Google Scholar Back to article
Wouda JC, Van De Wiel HBM. The effects of self-assessment and supervisor feedback on residents’ patient-education competency using videoed outpatient consultations. Patient Educ Couns. Oktober 2014;97(1):59–66. DOI: 10.1016/j.pec.2014.05.023
Open DOI Search in Google Scholar Back to article
Fitzgerald JT, White CB, Gruppen LD. A longitudinal study of self-assessment accuracy. Med Educ. Juli 2003;37(7):645–649. DOI: 10.1046/j.1365-2923.2003.01567.x; PubMed PMID: 12834423.
Open DOI Search in Google Scholar Back to article
Tweed M, Purdie G, Wilkinson T. Low performing students have insightfulness when they reflect-in-action. Med Educ. März 2017;51(3):316–323. DOI: 10.1111/medu.13206; PubMed PMID: 28084033.
Open DOI Search in Google Scholar Back to article
Pusic MV, Chiaramonte R, Gladding S, Andrews JS, Pecaric MR, Boutis K. Accuracy of self-monitoring during learning of radiograph interpretation. Med Educ. August 2015;49(8):838–846. DOI: 10.1111/medu.12774; PubMed PMID: 26152495.
Open DOI Search in Google Scholar Back to article
Hari R, Kälin K, Birrenbach T, Tal K, Roumet M, Limacher A, u. a. Near-peer compared to faculty teaching of abdominal ultrasound for medical students – A randomized-controlled trial. Ultraschall Med – Eur J Ultrasound. 31. Mai 2023;a-2103–4787. DOI: 10.1055/a-2103-4787
Open DOI Search in Google Scholar Back to article
Hofer M, Kamper L, Sadlo M, Sievers K, Heussen N. Evaluation of an OSCE assessment tool for abdominal ultrasound courses. Ultraschall Med Stuttg Ger 1980. April 2011;32(2):184–190. DOI: 10.1055/s-0029-1246049
Open DOI Search in Google Scholar Back to article
Frederick S. Cognitive Reflection and Decision Making. J Econ Perspect. 1. November 2005;19(4):25–42. DOI: 10.1257/089533005775196732
Open DOI Search in Google Scholar Back to article
Travers E, Rolison JJ, Feeney A. The time course of conflict on the Cognitive Reflection Test. Cognition. Mai 2016;150:109–118. DOI: 10.1016/j.cognition.2016.01.015
Open DOI Search in Google Scholar Back to article
Toplak ME, West RF, Stanovich KE. The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks. Mem Cognit. Oktober 2011;39(7):1275–1289. DOI: 10.3758/s13421-011-0104-1
Open DOI Search in Google Scholar Back to article
Białek M, Sawicki P. Cognitive Reflection Effects on Time Discounting. J Individ Differ. April 2018;39(2):99–106. DOI: 10.1027/1614-0001/a000254
Open DOI Search in Google Scholar Back to article
Schauber SK, Hautz SC, Kämmer JE, Stroben F, Hautz WE. Do different response formats affect how test takers approach a clinical reasoning task? An experimental study on antecedents of diagnostic accuracy using a constructed response and a selected response format. Adv Health Sci Educ Theory Pract. Oktober 2021;26(4):1339–1354. DOI: 10.1007/s10459-021-10052-z; PubMed PMID: 33977409; PubMed Central PMCID: PMC8452553.
Open DOI Search in Google Scholar Back to article
Bates D, Mächler M, Bolker B, Walker S. Fitting Linear Mixed-Effects Models Using lme4. J Stat Softw. 2015;67(1). DOI: 10.18637/jss.v067.i01
Open DOI Search in Google Scholar Back to article
Maehle V, Cooper K, Kirkpatrick P. Absolute clinical skill decay in the medical, nursing and allied health professions: a scoping review protocol. JBI Database Syst Rev Implement Rep. Juni 2017;15(6):1522–1527. DOI: 10.11124/JBISRIR-2016-003094; PubMed PMID: 28628511.
Open DOI Search in Google Scholar Back to article
Carpenter SK, Cepeda NJ, Rohrer D, Kang SHK, Pashler H. Using Spacing to Enhance Diverse Forms of Learning: Review of Recent Research and Implications for Instruction. Educ Psychol Rev. September 2012;24(3):369–378. DOI: 10.1007/s10648-012-9205-z
Open DOI Search in Google Scholar Back to article
Phillips JL, Heneka N, Bhattarai P, Fraser C, Shaw T. Effectiveness of the spaced education pedagogy for clinicians’ continuing professional development: a systematic review. Med Educ. September 2019;53(9):886–902. DOI: 10.1111/medu.13895
Open DOI Search in Google Scholar Back to article
León SP. How Accurate Are Our Students? A Meta-analytic Systematic Review on Self-assessment Scoring Accuracy. Educ Psychol Rev. 2023. DOI: 10.1007/s10648-023-09819-0
Open DOI Search in Google Scholar Back to article
Zheng B, He Q, Lei J. Informing factors and outcomes of self-assessment practices in medical education: a systematic review. Ann Med. 31. Dezember 2024;56(1):2421441. DOI: 10.1080/07853890.2024.2421441
Open DOI Search in Google Scholar Back to article
Koriat A. Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning. J Exp Psychol Gen. 1997;126(4):349–470. DOI: 10.1037/0096-3445.126.4.349
Open DOI Search in Google Scholar Back to article
Björkman M. Internal cue theory: Calibration and resolution of confidence in general knowledge. Organ Behav Hum Decis Process. 1994;58(3):386–405. DOI: 10.1006/obhd.1994.1043
Open DOI Search in Google Scholar Back to article
Gigerenzer G, Hoffrage U, Kleinbölting H. Probabilistic mental models: a Brunswikian theory of confidence. Psychol Rev. Oktober 1991;98(4):506–528. DOI: 10.1037/0033-295X.98.4.506; PubMed PMID: 1961771.
Open DOI Search in Google Scholar Back to article
Blissett S, Sibbald M, Kok E, van Merrienboer J. Optimizing self-regulation of performance: is mental effort a cue? Adv Health Sci Educ Theory Pract. Dezember 2018;23(5):891–898. DOI: 10.1007/s10459-018-9838-x; PubMed PMID: 29948414.
Open DOI Search in Google Scholar Back to article
de Bruin ABH, Dunlosky J, Cavalcanti RB. Monitoring and regulation of learning in medical education: the need for predictive cues. Med Educ. Juni 2017;51(6):575–584. DOI: 10.1111/medu.13267; PubMed PMID: 28332224; PubMed Central PMCID: PMC5434949.
Open DOI Search in Google Scholar Back to article
Schoenherr JR, Waechter J, Millington SJ. Subjective awareness of ultrasound expertise development: individual experience as a determinant of overconfidence. Adv Health Sci Educ Theory Pract. Oktober 2018;23(4):749–765. DOI: 10.1007/s10459-018-9826-1; PubMed PMID: 29691699.
Open DOI Search in Google Scholar Back to article
Tweed M, Purdie G, Wilkinson T. Defining and tracking medical student self-monitoring using multiple-choice question item certainty. BMC Med Educ. 6. Oktober 2020;20(1):344. DOI: 10.1186/s12909-020-02250-x; PubMed PMID: 33023565; PubMed Central PMCID: PMC7542100.
Open DOI Search in Google Scholar Back to article
Eva KW. On the generality of specificity. Med Educ. Juli 2003;37(7):587–588. DOI: 10.1046/j.1365-2923.2003.01563.x; PubMed PMID: 12834414.
Open DOI Search in Google Scholar Back to article
Olsson H. Measuring overconfidence: Methodological problems and statistical artifacts. J Bus Res. 2014. DOI: 10.1016/j.jbusres.2014.03.002
Open DOI Search in Google Scholar Back to article

Authors

Metrics

Articles in this issue

DOI: https://doi.org/10.5334/pme.1767 | Journal eISSN: 2212-277X

Journal RSS Feed

Language: English

Page range: 420 - 431

Submitted on: Mar 1, 2025

Accepted on: Apr 7, 2026

Published on: May 14, 2026

Published by: Ubiquity Press

In partnership with: Paradigm Publishing Services

Publication frequency: 1 issue per year

© 2026 Wolf E. Hautz, Thimo Marcin, Stefan K. Schauber, Robin Walter, Stefanie C. Hautz, Tanja Birrenbach, Beat Lehmann, Thomas C. Sauter, Roman Hari, Juliane E. Kämmer, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.

Volume 15 (2026): Issue 1