irds/clueweb09_it
收藏Hugging Face2023-01-05 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/irds/clueweb09_it
下载链接
链接失效反馈官方服务:
资源简介:
---
pretty_name: '`clueweb09/it`'
viewer: false
source_datasets: []
task_categories:
- text-retrieval
---
# Dataset Card for `clueweb09/it`
The `clueweb09/it` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package.
For more information about the dataset, see the [documentation](https://ir-datasets.com/clueweb09#clueweb09/it).
# Data
This dataset provides:
- `docs` (documents, i.e., the corpus); count=27,250,729
## Usage
```python
from datasets import load_dataset
docs = load_dataset('irds/clueweb09_it', 'docs')
for record in docs:
record # {'doc_id': ..., 'url': ..., 'date': ..., 'http_headers': ..., 'body': ..., 'body_content_type': ...}
```
Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the
data in 🤗 Dataset format.
提供机构:
irds
原始信息汇总
数据集概述
数据集名称
clueweb09/it
数据集来源
由 ir-datasets 提供。
数据集内容
- 数据类型: 文档(corpus)
- 文档数量: 27,250,729
数据集使用示例
python from datasets import load_dataset
docs = load_dataset(irds/clueweb09_it, docs) for record in docs: record # {doc_id: ..., url: ..., date: ..., http_headers: ..., body: ..., body_content_type: ...}



