Lemmatization of the DIA1900 Diachronic Corpus

Lucie Benešová; Klára Pivoňková; Martin Stluka

doi:10.2478/jazcas-2023-0045

.blurhash-client-img { display: none !important; }

Lemmatization of the DIA1900 Diachronic Corpus

Journal of Linguistics/Jazykovedný casopis

Volume 74 (2023): Issue 1 (June 2023)

By: Lucie Benešová, Klára Pivoňková and Martin Stluka

Open Access

|Dec 2023

Abstract

This paper focuses on the process of lemmatization of the upcoming Czech diachronic corpus of the second half of the 19^th century, DIA1900. The article describes different approaches to the corpus lemmatization of synchronic written, spoken and diachronic corpora within the Czech National Corpus project, including single- and multilevel lemmatization and available tools used to link the variants.

References

Benešová, L., Kučera, K., Najbrtová, K., Pivoňková, K., and Stluka, M. (2023). Korpus DIA1900: jeho koncepce a vytváření. Časopis pro moderní filologii, 105, pages 121–140.
Search in Google Scholar Back to article
Hajič, J. (2004). Disambiguation of Rich Inflection: Computational Morphology of Czech. Praha: Karolinum.
Search in Google Scholar Back to article
Hana, J., Lehečka, B., Feldmann, A., Černá, A., and Oliva, K. (2011). Building a Corpus of Old Czech. In Proceedings of the Adaptation of Language Resources and Tools for Processing Cultural Heritage Objects Workshop associated with the 8^th International Conference on Language Resources and Evaluation (LREC 2012), pages 9–15.
Search in Google Scholar Back to article
Hlaváčová, J., Mikulová, M., Štěpánková, B., and Hajič, J. (2019). Modifications of the Czech morphologigal dictionary for consistent corpus annotation. Journal of Linguistics, 70(2), pages 380–389.
Search in Google Scholar Back to article
Jungmann, J. (1835–1839). Slovník česko-německý. Praha. Accessible at: https://vokabular.ujc.cas.cz/moduly/slovniky/.
Search in Google Scholar Back to article
Kieraś, W., and Woliński, M. (2018). Manually Annotated Corpus of Polish Texts Published between 1830 and 1918. In Proceedings of the Eleventh International Conference on Language Recources and Evaluation (LREC 2018). Miyazaki, Japan: ELRA, pages 3854–3859.
Search in Google Scholar Back to article
lemma. https://wiki.korpus.cz/doku.php/pojmy:lemma (Last visited March 24, 2023).
Search in Google Scholar Back to article
lemmatizace. https://wiki.korpus.cz/doku.php/cnk:syn2020:lemmatizace (Last visited March 24, 2023)
Search in Google Scholar Back to article
Kučera, K., Najbrtová, K., Pivoňková, K., Řehořková, A., and Stluka, M. (2019). Korpus českého jazyka 2. poloviny 19. století. Časopis pro moderní filologii, 101, pages 92–97.
Search in Google Scholar Back to article
Příruční slovník jazyka českého (PSJČ) (1935–1957). Accessible at: https://bara.ujc.cas.cz/psjc/.
Search in Google Scholar Back to article
Pravidla hledící k českému pravopisu a tvarosloví s abecedním seznamem slov a tvarů (1902). Praha: Školní knihosklad.
Search in Google Scholar Back to article
Pravidla českého pravopisu s abecedním seznamem slov a tvarů: Jediné c.k. ministerstvem kultu a vyučování schválené vydání (1913). Praha: Školní knihosklad.
Search in Google Scholar Back to article
Thornton, A. M. (2019). Overabundance in Morphology. In Oxford Research Encyclopedia of Linguistics. Oxford University Press.
Search in Google Scholar Back to article

Articles in this issue

DOI: https://doi.org/10.2478/jazcas-2023-0045 | Journal eISSN: 1338-4287 (formerly 0021-5597) | Journal ISSN: 0021-5597

Journal RSS Feed

Language: English

Page range: 275 - 284

Published on: Dec 25, 2023

Published by: Slovak Academy of Sciences, Ľudovít Štúr Institute of Linguistics

In partnership with: Paradigm Publishing Services

Publication frequency: 3 issues per year

Keywords:

Czech,

diachronic corpus,

disambiguation,

lemmatization,

morphological dictionary,

variability

Related subjects:

Linguistics and semiotics,

Theoretical frameworks and disciplines,

Linguistics, other

© 2023 Lucie Benešová, Klára Pivoňková, Martin Stluka, published by Slovak Academy of Sciences, Ľudovít Štúr Institute of Linguistics
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Volume 74 (2023): Issue 1 (June 2023)