Have a personal or library account? Click to login
Evaluating the reliability of gestalt quality ratings of medical education podcasts: A METRIQ study Cover

Evaluating the reliability of gestalt quality ratings of medical education podcasts: A METRIQ study

Open Access
|Jun 2020

References

  1. 1.
    Cadogan M Thoma B Chan TM Lin M Free Open Access Meducation (FOAM): the rise of emergency medicine and critical care blogs and podcasts (2002–2013) Emerg Med J 2014 31 e1 e76 e77 10.1136/emermed-2013-203502
  2. 2.
    Purdy E Thoma B Bednarczyk J Migneault D Sherbino J The use of free online educational resources by Canadian emergency medicine residents and program directors CJEM 2015 17 101 106 10.1017/cem.2014.73
  3. 3.
    Thoma B Chan TM Paterson QS Milne WK Sanders JL Lin M Emergency medicine and critical care blogs and podcasts: establishing an international consensus on quality Ann Emerg Med 2015 66 396 402.e4 10.1016/j.annemergmed.2015.03.002
  4. 4.
    Lin M Thoma B Trueger NS Ankel F Sherbino J Chan T Quality indicators for blogs and podcasts used in medical education: modified Delphi consensus recommendations by an international cohort of health professions educators Postgrad Med J 2015 91 546 550 10.1136/postgradmedj-2014-133230
  5. 5.
    Riddell J Swaminathan A Lee M Mohamed A Rogers R Rezaie SR A survey of emergency medicine residents’ use of educational podcasts West J Emerg Med 2017 18 229 234 10.5811/westjem.2016.12.32850
  6. 6.
    Thurtle N Banks C Cox M Pain T Furyk J Free open access medical education resource knowledge and utilisation amongst emergency medicine trainees: a survey in four countries Afr J Emerg Med 2016 6 12 17 10.1016/j.afjem.2015.10.005
  7. 7.
    Thoma B Sebok-Syer SS Krishnan K Individual gestalt is unreliable for the evaluation of quality in medical education blogs: a METRIQ study Ann Emerg Med 2017 70 394 401 10.1016/j.annemergmed.2016.12.025
  8. 8.
    Rieh SY Judgment of information quality and cognitive authority in the Web J Am Soc Inf Sci Technol 2002 53 145 161 10.1002/asi.10017
  9. 9.
    Rieh SY Danielson DR Credibility: A multidisciplinary framework Annu Rev Inf Sci Technol 2007 41 307 364 10.1002/aris.2007.1440410114
  10. 10.
    Metzger MJ Making sense of credibility on the Web: Models for evaluating online information and recommendations for future research J Am Soc Inf Sci Technol 2007 58 2078 2091 10.1002/asi.20672
  11. 11.
    Krishnan K Thoma B Trueger NS Lin M Chan TM Gestalt assessment of online educational resources may not be sufficiently reliable and consistent Perspect Med Educ 2017 6 91 98 10.1007/s40037-017-0343-3
  12. 12.
    Colmers-Gray IN Krishnan K Chan TM The revised METRIQ score: a quality evaluation tool for online educational resources 2019
  13. 13.
    Chan TM Thoma B Krishnan K Derivation of two critical appraisal scores for trainees to evaluate online educational resources: a METRIQ study West J Emerg Med 2016 17 574 584 10.5811/westjem.2016.6.30825
  14. 14.
    Chan TM Grock A Paddock M Kulasegaram K Yarris LM Lin M Examining reliability and validity of an online score (ALiEM AIR) for rating free open access medical education resources Ann Emerg Med 2016 68 729 735 10.1016/j.annemergmed.2016.02.018
  15. 15.
    Reb J Cropanzano R Evaluating dynamic performance: the influence of salient Gestalt characteristics on performance ratings J Appl Psychol 2007 92 490 499 10.1037/0021-9010.92.2.490
  16. 16.
    Ariely D Carmon Z Gestalt characteristics of experiences: the defining features of summarized events J Behav Decis Making 2000 13 191 201 10.1002/(SICI)1099-0771(200004/06)13:2<;191::AID-BDM330>3.0.CO;2-A
  17. 17.
    Thoma B Paddock M Purdy E Leveraging a virtual community of practice to participate in a survey-based study: a description of the METRIQ study methodology AEM Educ Train 2017 1 110 113 10.1002/aet2.10013
  18. 18.
    Thoma B Goerzen S Horeczko T An international, interprofessional investigation of the self-reported podcast listening habits of emergency clinicians: A METRIQ Study CJEM 2020 22 1 112 117 10.1017/cem.2019.427
  19. 19.
    Wenger EMR Snyder WM Cultivating communities of practice 2002 Boston Harvard Business School Press
  20. 20.
    Dube L Bourhis A Jacob R Towards a typology of virtual communities of practice Interdiscip J Inf Knowl Manag 2006 1 69 73
  21. 21.
    Thoma B Chan TM Kapur P The social media index as an indicator of quality for emergency medicine blogs: a METRIQ study Ann Emerg Med 2018 72 696 702 10.1016/j.annemergmed.2018.05.003
  22. 22.
    Thoma B Sanders JL Lin M Paterson QS Steeg J Chan TM The social media index: measuring the impact of emergency medicine and critical care websites West J Emerg Med 2015 16 242 249 10.5811/westjem.2015.1.24860
  23. 23.
    Carpenter CR Sarli CC Fowler SA Best evidence in emergency medicine (BEEM) rater scores correlate with publications’ future citations Acad Emerg Med 2013 20 1004 1012 10.1111/acem.12235
  24. 24.
    Lin M Joshi N Grock A Approved instructional resources series: a national initiative to identify quality emergency medicine blog and podcast content for resident education J Grad Med Educ 2016 8 219 225 10.4300/JGME-D-15-00388.1
  25. 25.
    Kamis O Dogan CD An investigation of reliability coefficients estimated for decision studies in generalizability theory J Educ Learn 2018 7 4 103 10.5539/jel.v7n4p103
  26. 26.
    Riddell J Robins L Brown A Sherbino J Lin M Ilgen JS Independent and interwoven: a qualitative exploration of residents’ experiences with educational podcasts Acad Med 2020 95 89 96 10.1097/ACM.0000000000002984
Language: English
Published on: Jun 3, 2020
Published by: Bohn Stafleu van Loghum
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2020 Jason M. Jason M. Woods, Teresa M. Chan, Damian Roland, Jeff Riddell, Andrew Tagg, Brent Brent Thoma, published by Bohn Stafleu van Loghum
This work is licensed under the Creative Commons Attribution 4.0 License.