Skip to main content

Evaluating the Evaluator: Problems With SemEval-2020 Task 1 for Lexical Semantic Change Detection Cover

Evaluating the Evaluator: Problems With SemEval-2020 Task 1 for Lexical Semantic Change Detection

Journal of Open Humanities Data

Volume 12 (2026): Issue 1

By: Bach Phan-Tat , Kris Heylen , Dirk Geeraerts , Stefano De Pascale and Dirk Speelman

Open Access

|Jul 2026

Figures & tables

Figures & Tables

Table 1

Counts of data quality issues by language-period subset. S = Sentence, T = Token.

FILE	S CUTOFF	S MERGED	T OCR	T BOUNDARY	T CHARS	METADATA
ENG 1	19	0	7	4	9	1
ENG 2	10	2	0	9	4	0
GER 1	3	0	2	0	2	0
GER 2	13	5	68	21	11	2
LAT 1	3	1	0	0	0	5
LAT 2	5	1	1	2	3	8
SWE 1	37	0	212	23	40	0
SWE 2	9	4	90	6	7	0

Articles in this issue

DOI: https://doi.org/10.5334/johd.547 | Journal eISSN: 2059-481X

Journal RSS Feed

Language: English

Page range: 103 - 103

Submitted on: Apr 9, 2026

|

Accepted on: May 26, 2026

|

Published on: Jul 31, 2026

Published by: Ubiquity Press

In partnership with: Paradigm Publishing Services

Keywords:

SemEval 2020 Task 1,

lexical semantic change,

benchmark dataset,

© 2026 Bach Phan-Tat, Kris Heylen, Dirk Geeraerts, Stefano De Pascale, Dirk Speelman, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.

Volume 12 (2026): Issue 1

Previous article