Konferenzbeitrag
Deduplication in large web corpora
Our paper tries to find answers to some questions related to deduplication process in large-scale web-crawled corpora. An experiment based on eight corpora from the Aranea family is introduced, and first results are presented.
- Sprache
-
Englisch
- Thema
-
Korpus <Linguistik>
Sprache
- Ereignis
-
Geistige Schöpfung
- (wer)
-
Benko, Vladimír
- Ereignis
-
Veröffentlichung
- (wer)
-
Mannheim : Leibniz-Institut für Deutsche Sprache
- (wann)
-
2019-07-04
- URN
-
urn:nbn:de:bsz:mh39-90221
- Letzte Aktualisierung
-
06.03.2025, 09:00 MEZ
Datenpartner
Dieses Objekt wird bereitgestellt von:
Leibniz-Institut für Deutsche Sprache - Bibliothek. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Leibniz-Institut für Deutsche Sprache - Bibliothek. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Objekttyp
- Konferenzbeitrag
Beteiligte
- Benko, Vladimír
- Mannheim : Leibniz-Institut für Deutsche Sprache
Entstanden
- 2019-07-04
Ähnliche Objekte (12)
Processing and querying large web corpora with the COW14 architecture
Ungoliant: An optimized pipeline for the generation of a very large-scale multilingual web corpus
Modelling large parallel corpora. The Zurich Parallel Corpus Collection
Discovering Subtle Word Relations in Large German Corpora
Automatic Classification by Topic Domain for Meta Data Generation, Web Corpus Evaluation, and Corpus Comparison
Corpus-driven study of multi-word expressions based on collocations from a very large corpus
Are web corpora inferior? The Case of Czech and Slovak
Addressing Cha(lle)nges in Long-Term Archiving of Large Corpora
Removing spam from web corpora through supervised learning using FastText
Evaluating DBMS-based Access Strategies to Very Large Multi-layer Corpora
A Functional Database Framework for Querying Very Large Multi-Layer Corpora
The Vast and the Focused: On the need for domain-focused web corpora
Processing and querying large web corpora with the COW14 architecture
Ungoliant: An optimized pipeline for the generation of a very large-scale multilingual web corpus
Modelling large parallel corpora. The Zurich Parallel Corpus Collection
Discovering Subtle Word Relations in Large German Corpora
Automatic Classification by Topic Domain for Meta Data Generation, Web Corpus Evaluation, and Corpus Comparison
Corpus-driven study of multi-word expressions based on collocations from a very large corpus
Are web corpora inferior? The Case of Czech and Slovak
Addressing Cha(lle)nges in Long-Term Archiving of Large Corpora
Removing spam from web corpora through supervised learning using FastText
Evaluating DBMS-based Access Strategies to Very Large Multi-layer Corpora
A Functional Database Framework for Querying Very Large Multi-Layer Corpora
The Vast and the Focused: On the need for domain-focused web corpora
Processing and querying large web corpora with the COW14 architecture
Ungoliant: An optimized pipeline for the generation of a very large-scale multilingual web corpus
Modelling large parallel corpora. The Zurich Parallel Corpus Collection
Discovering Subtle Word Relations in Large German Corpora
Automatic Classification by Topic Domain for Meta Data Generation, Web Corpus Evaluation, and Corpus Comparison
Corpus-driven study of multi-word expressions based on collocations from a very large corpus
Are web corpora inferior? The Case of Czech and Slovak
Addressing Cha(lle)nges in Long-Term Archiving of Large Corpora
Removing spam from web corpora through supervised learning using FastText
Evaluating DBMS-based Access Strategies to Very Large Multi-layer Corpora
A Functional Database Framework for Querying Very Large Multi-Layer Corpora