Table 1
10-Item Checklist properties used to simulate the data (Items difficuly (Pi) and discrimination (Di))
|
Stations | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
1 |
2 |
3 |
4 |
5 |
6 |
7 |
8 |
9 |
10 |
11 |
12 | ||
|
Item | |||||||||||||
|
1 |
Di |
0.43 |
0.67 |
0.39 |
0.89 |
0.92 |
0.82 |
0.77 |
0.67 |
0.67 |
0.82 |
0.59 |
0.95 |
|
Pi |
−0.05 |
0.16 |
0.24 |
0.07 |
0.23 |
0.11 |
0.1 |
−0.35 |
0.31 |
0.09 |
0.11 |
0.14 | |
|
2 |
Di |
0.75 |
0.34 |
0.2 |
0.39 |
0.88 |
0.96 |
0.72 |
0.08 |
0.65 |
0.34 |
0.11 |
0.76 |
|
Pi |
0.34 |
0.1 |
0.06 |
0.25 |
0.27 |
0.16 |
0.11 |
−0.26 |
−0.06 |
−0.01 |
0.3 |
0.13 | |
|
3 |
Di |
0.84 |
0.7 |
0.57 |
0.95 |
0.89 |
0.86 |
0.75 |
0.24 |
0.91 |
0.89 |
0.63 |
0.43 |
|
Pi |
0.48 |
0.1 |
−0.03 |
0.12 |
0.24 |
0.12 |
0.44 |
−0.49 |
0.08 |
0.1 |
0.28 |
0.08 | |
|
4 |
Di |
0.97 |
0.28 |
0.48 |
0.56 |
0.97 |
0.72 |
0.97 |
0.01 |
0.45 |
0.62 |
0.21 |
0.73 |
|
Pi |
0.07 |
−0.41 |
−0.09 |
0.55 |
0.3 |
0.14 |
0.14 |
−0.2 |
0.1 |
0.09 |
0.24 |
0.23 | |
|
5 |
Di |
0.18 |
0.8 |
0.57 |
0.7 |
0.97 |
0.75 |
0.93 |
0.92 |
0.84 |
0.13 |
0.78 |
0.94 |
|
Pi |
−0.07 |
0.28 |
0.25 |
0.17 |
0.3 |
0.06 |
0.15 |
0.41 |
0.28 |
0.04 |
0.11 |
0.23 | |
|
6 |
Di |
0.18 |
0.69 |
0.67 |
0.93 |
0.93 |
0.71 |
0.72 |
0.86 |
0.53 |
0.81 |
0.31 |
0.82 |
|
Pi |
−0.07 |
0.21 |
0.24 |
−0.03 |
0.16 |
0.17 |
0.29 |
0.22 |
0.43 |
0.33 |
0.36 |
0.22 | |
|
7 |
Di |
0.33 |
0.66 |
0.84 |
0.41 |
0.86 |
0.91 |
0.92 |
0.99 |
0.14 |
0.81 |
0.64 |
0.86 |
|
Pi |
−0.06 |
0.41 |
0.34 |
0.09 |
0.07 |
0.1 |
0.28 |
−0.06 |
0.26 |
0.17 |
0.29 |
0.19 | |
|
8 |
Di |
0.34 |
0.03 |
0.87 |
0.52 |
0.65 |
0.83 |
0.68 |
0.92 |
0.22 |
0.62 |
0.11 |
0.95 |
|
Pi |
−0.03 |
−0.12 |
0.29 |
0.62 |
0.29 |
0.19 |
0.18 |
0.34 |
0.24 |
0.06 |
0.22 |
0.38 | |
|
9 |
Di |
0.28 |
0.08 |
0.98 |
0.92 |
0.86 |
0.8 |
0.98 |
0.92 |
0.77 |
0.62 |
0.06 |
0.76 |
|
Pi |
0.1 |
0.01 |
0.6 |
0.41 |
0.36 |
0.1 |
0.25 |
0.14 |
0.23 |
0.05 |
0.07 |
0.02 | |
|
10 |
Di |
0.3 |
0.07 |
0.9 |
0.61 |
0.67 |
0.57 |
0.78 |
0.95 |
0.69 |
0.6 |
0.1 |
0.05 |
|
Pi |
−0.16 |
0.19 |
0.35 |
0.31 |
0.15 |
0.17 |
0.33 |
0.17 |
0.19 |
0.1 |
0.07 |
−0.19 | |
Fig. 1
Detection rates per type of rater bias, rate of bias and number of biased raters
