Table 1
Inter Annotator Agreement (Krippendorff’s α) for event types.
| ECKBERT | EFFI BRIEST | ERDBEBEN | JUDENBUCHE | KRAMBAMBULI | VERWANDLUNG | |
|---|---|---|---|---|---|---|
| event type | 0.73 | 0.57 | 0.75 | 0.61 | 0.66 | 0.73 |
Table 2
Inter Annotator Agreement (Krippendorff’s α) for additional event properties. For a detailed description and examples see Vauth and Gius (2021).
| ECKBERT | EFFI BRIEST | ERDBEBEN | JUDENBUCHE | KRAMBAMBULI | VERWANDLUNG | |
|---|---|---|---|---|---|---|
| unpredictable | –0.25 | –0.30 | –0.08 | –0.35 | –0.21 | –0.55 |
| mental | 0.79 | 0.33 | 0.58 | 0.39 | 0.46 | 0.79 |
| representation_type | 0.94 | 0.87 | 0.86 | 0.91 | 0.86 | 0.67 |
| persistent | 0.09 | 0.13 | 0.28 | –0.14 | 0.25 | –0.89 |
| iterative | 0.62 | 0.20 | –0.29 | 0.35 | 0.07 | 0.70 |
| intentional | 0.75 | 0.24 | 0.45 | 0.43 | 0.32 | 0.70 |
| non_event_type | 0.66 | 0.68 | 0.80 | 0.71 | 0.80 | 0.69 |
Table 3
Number and extension (in tokens) of gold standard annotations per text. For tokenization we used the German tokenizer in the NLTK toolkit version 3.7 (Bird et al., 2009).
| ERDBEBEN | VERWANDLUNG | ECKBERT | KRAMBAMBULI | JUDENBUCHE | EFFI BRIEST | ALL TEXT | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| COUNT | TOKEN | COUNT | TOKEN | COUNT | TOKEN | COUNT | TOKEN | COUNT | TOKEN | COUNT | TOKEN | COUNT | TOKEN | |
| non_event | 167 | 1,086 | 757 | 5,938 | 212 | 1,488 | 116 | 712 | 856 | 4,732 | 2,887 | 16,655 | 4,995 | 30,611 |
| stative_event | 136 | 1,046 | 455 | 3,830 | 243 | 1,667 | 82 | 637 | 476 | 3,502 | 1,675 | 11,656 | 3,067 | 22,338 |
| process | 400 | 3,459 | 1,126 | 9,748 | 450 | 3,225 | 268 | 1,990 | 1,120 | 8,146 | 2,061 | 15,180 | 5,425 | 41,748 |
| change_of_state | 9 | 63 | 26 | 216 | 25 | 163 | 4 | 39 | 39 | 324 | 43 | 362 | 146 | 1,167 |