Have a personal or library account? Click to login
Identifying Errors in Russian Web Corpora Cover
By: Maria Khokhlova  
Open Access
|Aug 2021

Abstract

The explosion of the Web leads to the production of large amounts of texts and inevitably influences their quality. Errors that tend to occur more often can distort results, especially when texts are used for scientific purposes, in language teaching or learning. Hence, there is a need to examine the existing corpora based on web texts and to clean up the data, which may contain such “noisy” fragments. In our study, we deal with the problem of errors and analyze the Aranea Russicum Maximum corpus. Among such errors, we can name, above all, encoding errors, incorrect font types, as well as segments written in other languages. These phenomena result in incorrect morphological analysis and lemmatization, frequency distortion, as well as the fact that lexical units cannot be found and therefore displayed to corpus users. The paper focuses on the errors, describes their types and outlines possible ways to eliminate them.

DOI: https://doi.org/10.2478/jazcas-2022-0021 | Journal eISSN: 1338-4287 | Journal ISSN: 0021-5597
Language: English
Page range: 977 - 985
Published on: Aug 17, 2021
In partnership with: Paradigm Publishing Services
Publication frequency: 2 issues per year

© 2021 Maria Khokhlova, published by Slovak Academy of Sciences, Ľudovít Štúr Institute of Linguistics
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.