遇见数据集

Catalan General Crawling

收藏
Zenodo2024-02-28 更新2026-05-25 收录
数据链接:
官方服务:

资源简介:

If you use this resource in your work, please cite our latest paper: @inproceedings{armengol-estape-etal-2021-multilingual,<br> title = "Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? {A} Comprehensive Assessment for {C}atalan",<br> author = "Armengol-Estap{\'e}, Jordi and<br> Carrino, Casimiro Pio and<br> Rodriguez-Penagos, Carlos and<br> de Gibert Bonet, Ona and<br> Armentano-Oller, Carme and<br> Gonzalez-Agirre, Aitor and<br> Melero, Maite and<br> Villegas, Marta",<br> booktitle = "Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021",<br> month = aug,<br> year = "2021",<br> address = "Online",<br> publisher = "Association for Computational Linguistics",<br> url = "https://aclanthology.org/2021.findings-acl.437",<br> doi = "10.18653/v1/2021.findings-acl.437",<br> pages = "4933--4946",<br> } The Catalan General Crawling Corpus is a 435-million-token web corpus of Catalan built from the web. It has been obtained by crawling the 500 most popular .cat and .ad domains during July 2020. It consists of 434.817.705 tokens, 19.451.691 sentences and 1.016.114 documents. Documents are separated by single new lines. It is a subcorpus of the Catalan Textual Corpus. We license the actual packaging of this data under a Attribution 4.0 International License. Copyright (c) 2021 Text Mining Unit at BSC

提供机构:
Zenodo
创建时间:
2021-03-25
二维码
社区交流群
二维码
科研交流群
商业服务