Hieuman/realnews

这是一个包含网页内容的文本数据集，其中包括网页的URL、使用过的URL、标题、正文、摘要、作者列表、发布日期、域名、Warc日期、状态和数据集划分信息。数据集主要被划分为训练集，适用于文本处理和自然语言处理相关任务。数据集规模较大，包含了数以亿计的网页文本数据。

This is a text dataset containing web page contents, which includes fields such as URL, used URL, title, text, summary, author list, publish date, domain, Warc date, status, and dataset split information. The dataset is primarily split into a training set, suitable for text processing and natural language processing related tasks. The dataset is large in scale, containing hundreds of millions of web page text entries.