gabrieljesus/Labadain-30k-plus-tetun

Labadain-30k+是一个单语的Tetun文档级别审核数据集，由母语为Tetun的人士审核。该数据集包含33,550个文档，收集时间从2001年6月至2023年9月，不包括2004和2005年。数据通过Labadain Crawler网络爬虫获取，包含DocID、标题、URL、来源、类别、发布日期和内容等元数据。每个文档由两个连续的新行分隔。Labadain-30k+ is a monolingual Tetun dataset, audited at the document level by native Tetun speakers. It contains 33,550 documents collected between June 2001 and September 2023, excluding 2004 and 2005, for which no documents are available. The dataset was acquired through web crawling using Labadain Crawler and includes metadata such as DocID, title, URL, source, category, publication date, and content. Each document is separated by two consecutive newlines.