Have a personal or library account? Click to login
Evaluating the reliability of gestalt quality ratings of medical education podcasts: A METRIQ study Cover

Evaluating the reliability of gestalt quality ratings of medical education podcasts: A METRIQ study

Open Access
|Jun 2020

Figures & Tables

Table 1

Summary data for podcast raters

Subgroups

n

Age, mean (SD)

Gender

All participants

240

33.1 (7.9)

56.0% male

43.6% female

 0.4% prefer not to disclose

Attending or consultant physicians

73

38.0 (7.0)

69.9% male

30.1% female

Pre-hospital care providers

27

31.9 (7.0)

70.4% male

29.6% female

Medical students

67

26.6 (3.8)

49.3% male

50.7% female

Nurse & nurse practitioners

22

39.3 (9.6)

27.3% male

68.2% female

 4.5% prefer not to disclose

Physician assistants

11

39.1 (7.7)

72.7% male

27.3% female

Residents/Registrars/Fellows

40

30.8 (3.4)

42.5% male

57.5% female

Location

240

Canada 122 (50.6%)

United States 59 (24.5%)

Europe 32 (13.3%)

Oceana 14 (5.8%)

Africa 9 (3.7%)

South America 4 (1.7%)

Asia 1 (0.4%)

Table 2

Variance, generalizability, and decision studies

ANOVA study

Generalizability study

Decision study

Number of raters in group

% Variance due to podcast

% Variance due to rater in group

% Variance due to Podcast by rater (p × r) interaction

G‑coefficient (Phi) for the whole group

How many raters in this group needed to have a Phi coefficient ≥0.80

All raters

240

17.0%

 9.9%

73.2%

0.98

20

Attendings

 73

17.8%

 8.6%

73.7%

0.94

18

Residents, registrars, & fellows

 27

15.0%

 9.4%

75.6%

0.88

23

Medical students

 67

21.6%

 8.7%

69.7%

0.95

15

Nurses & nurse practitioners

 22

 9.9%

31.8%

58.3%

0.77

27

Physician assistants

 11

23.3%

16.4%

60.3%

0.81

13

Prehospital care providers

 40

10.8%

12.8%

76.3%

0.77

33

Language: English
Published on: Jun 3, 2020
Published by: Bohn Stafleu van Loghum
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2020 Jason M. Jason M. Woods, Teresa M. Chan, Damian Roland, Jeff Riddell, Andrew Tagg, Brent Brent Thoma, published by Bohn Stafleu van Loghum
This work is licensed under the Creative Commons Attribution 4.0 License.