Web Text Corpus

kaggle2018-10-19 更新2024-03-08 收录

下载链接：

https://www.kaggle.com/datasets/nltkdata/web-text-corpus

下载链接

链接失效反馈

官方服务：

资源简介：

A Corpus of Web Text

网页文本语料库

创建时间：

2017-08-21

PAISÀ Corpus of Italian Web Text

The Paisà corpus is a large collection of Italian web texts, licensed under Creative Commons (Attribution-ShareAlike and Attribution-Noncommercial-ShareAlike). It has been...

B2FIND30

1000-Language Web Text Corpus

谷歌研究团队创建了一个名为‘1000-Language Web Text Corpus’的数据集，旨在收集并整理来自互联网的多种语言文本。该数据集包含至少100,000个相对干净的句子，覆盖超过500种语言，为机器翻译和自动语音识别等技术的发展提供了丰富的资源。创建过程中，团队面临了语言识别准确性、数据噪声和语言间相似性等挑战，通过开发可调精度的词表过滤技术和半监督语言识别模型，有效提升了数据集的

arXiv2020-10-29 更新110

HK Web Text Corpus (MySQL Dump, raw version)

Database Description Language: Hong Kong Cantonese, Traditional Chinese Size: ~49.2 GB (SQL dump), 11.1 GB (7z archive) Format: MySQL dump, UTF-8 encoding Source: public web sources (news sites,

Zenodo2025-08-16 更新00

PAISÀ Corpus of Italian Web Text

This corpus contains approximately 380,000 documents coming from about 1,000 different websites, for a total of about 250 million words. Approximately 260,000 documents are from Wikipedia, approx. 5,6

SSH Open MarketPlace2023-10-13 更新60

HK Web Text Corpus (MySQL Dump, raw version)

Database Description Language: Hong Kong Cantonese, Traditional Chinese Size: ~49.2 GB (SQL dump), 11.1 GB (7z archive) Format: MySQL dump, UTF-8 encoding Source: public web sources (news sites,

Zenodo2025-08-16 更新00