
Evaluating the reliability of gestalt quality ratings of medical education podcasts: A METRIQ study
References
- Cadogan M Thoma B Chan TM Lin M Free Open Access Meducation (FOAM): the rise of emergency medicine and critical care blogs and podcasts (2002–2013) Emerg Med J 2014 31 e1 e76 e77 10.1136/emermed-2013-203502
- Purdy E Thoma B Bednarczyk J Migneault D Sherbino J The use of free online educational resources by Canadian emergency medicine residents and program directors CJEM 2015 17 101 106 10.1017/cem.2014.73
- Thoma B Chan TM Paterson QS Milne WK Sanders JL Lin M Emergency medicine and critical care blogs and podcasts: establishing an international consensus on quality Ann Emerg Med 2015 66 396 402.e4 10.1016/j.annemergmed.2015.03.002
- Lin M Thoma B Trueger NS Ankel F Sherbino J Chan T Quality indicators for blogs and podcasts used in medical education: modified Delphi consensus recommendations by an international cohort of health professions educators Postgrad Med J 2015 91 546 550 10.1136/postgradmedj-2014-133230
- Riddell J Swaminathan A Lee M Mohamed A Rogers R Rezaie SR A survey of emergency medicine residents’ use of educational podcasts West J Emerg Med 2017 18 229 234 10.5811/westjem.2016.12.32850
- Thurtle N Banks C Cox M Pain T Furyk J Free open access medical education resource knowledge and utilisation amongst emergency medicine trainees: a survey in four countries Afr J Emerg Med 2016 6 12 17 10.1016/j.afjem.2015.10.005
- Thoma B Sebok-Syer SS Krishnan K Individual gestalt is unreliable for the evaluation of quality in medical education blogs: a METRIQ study Ann Emerg Med 2017 70 394 401 10.1016/j.annemergmed.2016.12.025
- Rieh SY Judgment of information quality and cognitive authority in the Web J Am Soc Inf Sci Technol 2002 53 145 161 10.1002/asi.10017
- Rieh SY Danielson DR Credibility: A multidisciplinary framework Annu Rev Inf Sci Technol 2007 41 307 364 10.1002/aris.2007.1440410114
- Metzger MJ Making sense of credibility on the Web: Models for evaluating online information and recommendations for future research J Am Soc Inf Sci Technol 2007 58 2078 2091 10.1002/asi.20672
- Krishnan K Thoma B Trueger NS Lin M Chan TM Gestalt assessment of online educational resources may not be sufficiently reliable and consistent Perspect Med Educ 2017 6 91 98 10.1007/s40037-017-0343-3
- Colmers-Gray IN Krishnan K Chan TM The revised METRIQ score: a quality evaluation tool for online educational resources 2019
- Chan TM Thoma B Krishnan K Derivation of two critical appraisal scores for trainees to evaluate online educational resources: a METRIQ study West J Emerg Med 2016 17 574 584 10.5811/westjem.2016.6.30825
- Chan TM Grock A Paddock M Kulasegaram K Yarris LM Lin M Examining reliability and validity of an online score (ALiEM AIR) for rating free open access medical education resources Ann Emerg Med 2016 68 729 735 10.1016/j.annemergmed.2016.02.018
- Reb J Cropanzano R Evaluating dynamic performance: the influence of salient Gestalt characteristics on performance ratings J Appl Psychol 2007 92 490 499 10.1037/0021-9010.92.2.490
- Ariely D Carmon Z Gestalt characteristics of experiences: the defining features of summarized events J Behav Decis Making 2000 13 191 201 10.1002/(SICI)1099-0771(200004/06)13:2<;191::AID-BDM330>3.0.CO;2-A
- Thoma B Paddock M Purdy E Leveraging a virtual community of practice to participate in a survey-based study: a description of the METRIQ study methodology AEM Educ Train 2017 1 110 113 10.1002/aet2.10013
- Thoma B Goerzen S Horeczko T An international, interprofessional investigation of the self-reported podcast listening habits of emergency clinicians: A METRIQ Study CJEM 2020 22 1 112 117 10.1017/cem.2019.427
- Wenger EMR Snyder WM Cultivating communities of practice 2002 Boston Harvard Business School Press
- Dube L Bourhis A Jacob R Towards a typology of virtual communities of practice Interdiscip J Inf Knowl Manag 2006 1 69 73
- Thoma B Chan TM Kapur P The social media index as an indicator of quality for emergency medicine blogs: a METRIQ study Ann Emerg Med 2018 72 696 702 10.1016/j.annemergmed.2018.05.003
- Thoma B Sanders JL Lin M Paterson QS Steeg J Chan TM The social media index: measuring the impact of emergency medicine and critical care websites West J Emerg Med 2015 16 242 249 10.5811/westjem.2015.1.24860
- Carpenter CR Sarli CC Fowler SA Best evidence in emergency medicine (BEEM) rater scores correlate with publications’ future citations Acad Emerg Med 2013 20 1004 1012 10.1111/acem.12235
- Lin M Joshi N Grock A Approved instructional resources series: a national initiative to identify quality emergency medicine blog and podcast content for resident education J Grad Med Educ 2016 8 219 225 10.4300/JGME-D-15-00388.1
- Kamis O Dogan CD An investigation of reliability coefficients estimated for decision studies in generalizability theory J Educ Learn 2018 7 4 103 10.5539/jel.v7n4p103
- Riddell J Robins L Brown A Sherbino J Lin M Ilgen JS Independent and interwoven: a qualitative exploration of residents’ experiences with educational podcasts Acad Med 2020 95 89 96 10.1097/ACM.0000000000002984
DOI: https://doi.org/10.1007/S40037-020-00589-X | Journal eISSN: 2212-277X
Language: English
Page range: 302 - 306
Published on: Jun 3, 2020
Published by: Bohn Stafleu van Loghum
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year
Keywords:
© 2020 Jason M. Jason M. Woods, Teresa M. Chan, Damian Roland, Jeff Riddell, Andrew Tagg, Brent Brent Thoma, published by Bohn Stafleu van Loghum
This work is licensed under the Creative Commons Attribution 4.0 License.