Konferenzbeitrag
Deduplication in large web corpora
Our paper tries to find answers to some questions related to deduplication process in large-scale web-crawled corpora. An experiment based on eight corpora from the Aranea family is introduced, and first results are presented.
- Language
-
Englisch
- Subject
-
Korpus <Linguistik>
Sprache
- Event
-
Geistige Schöpfung
- (who)
-
Benko, Vladimír
- Event
-
Veröffentlichung
- (who)
-
Mannheim : Leibniz-Institut für Deutsche Sprache
- (when)
-
2019-07-04
- URN
-
urn:nbn:de:bsz:mh39-90221
- Last update
-
06.03.2025, 9:00 AM CET
Data provider
This object is provided by:
Leibniz-Institut für Deutsche Sprache - Bibliothek. If you have any questions about the object, please contact the data provider.
Leibniz-Institut für Deutsche Sprache - Bibliothek. If you have any questions about the object, please contact the data provider.
Object type
- Konferenzbeitrag
Associated
- Benko, Vladimír
- Mannheim : Leibniz-Institut für Deutsche Sprache
Time of origin
- 2019-07-04
Other Objects (12)
Processing and querying large web corpora with the COW14 architecture
Ungoliant: An optimized pipeline for the generation of a very large-scale multilingual web corpus
Modelling large parallel corpora. The Zurich Parallel Corpus Collection
Discovering Subtle Word Relations in Large German Corpora
Automatic Classification by Topic Domain for Meta Data Generation, Web Corpus Evaluation, and Corpus Comparison
Corpus-driven study of multi-word expressions based on collocations from a very large corpus
Are web corpora inferior? The Case of Czech and Slovak
Addressing Cha(lle)nges in Long-Term Archiving of Large Corpora
Removing spam from web corpora through supervised learning using FastText
Evaluating DBMS-based Access Strategies to Very Large Multi-layer Corpora
A Functional Database Framework for Querying Very Large Multi-Layer Corpora
The Vast and the Focused: On the need for domain-focused web corpora
Processing and querying large web corpora with the COW14 architecture
Ungoliant: An optimized pipeline for the generation of a very large-scale multilingual web corpus
Modelling large parallel corpora. The Zurich Parallel Corpus Collection
Discovering Subtle Word Relations in Large German Corpora
Automatic Classification by Topic Domain for Meta Data Generation, Web Corpus Evaluation, and Corpus Comparison
Corpus-driven study of multi-word expressions based on collocations from a very large corpus
Are web corpora inferior? The Case of Czech and Slovak
Addressing Cha(lle)nges in Long-Term Archiving of Large Corpora
Removing spam from web corpora through supervised learning using FastText
Evaluating DBMS-based Access Strategies to Very Large Multi-layer Corpora
A Functional Database Framework for Querying Very Large Multi-Layer Corpora
The Vast and the Focused: On the need for domain-focused web corpora
Processing and querying large web corpora with the COW14 architecture
Ungoliant: An optimized pipeline for the generation of a very large-scale multilingual web corpus
Modelling large parallel corpora. The Zurich Parallel Corpus Collection
Discovering Subtle Word Relations in Large German Corpora
Automatic Classification by Topic Domain for Meta Data Generation, Web Corpus Evaluation, and Corpus Comparison
Corpus-driven study of multi-word expressions based on collocations from a very large corpus
Are web corpora inferior? The Case of Czech and Slovak
Addressing Cha(lle)nges in Long-Term Archiving of Large Corpora
Removing spam from web corpora through supervised learning using FastText
Evaluating DBMS-based Access Strategies to Very Large Multi-layer Corpora
A Functional Database Framework for Querying Very Large Multi-Layer Corpora