irds/gov2

---
pretty_name: '`gov2`'
viewer: false
source_datasets: []
task_categories:
- text-retrieval
---

# Dataset Card for `gov2`

The `gov2` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package.
For more information about the dataset, see the [documentation](https://ir-datasets.com/gov2#gov2).

# Data

This dataset provides:
- `docs` (documents, i.e., the corpus); count=25,205,179

This dataset is used by: [`gov2_trec-tb-2004`](https://huggingface.co/datasets/irds/gov2_trec-tb-2004), [`gov2_trec-tb-2005`](https://huggingface.co/datasets/irds/gov2_trec-tb-2005), [`gov2_trec-tb-2005_efficiency`](https://huggingface.co/datasets/irds/gov2_trec-tb-2005_efficiency), [`gov2_trec-tb-2005_named-page`](https://huggingface.co/datasets/irds/gov2_trec-tb-2005_named-page), [`gov2_trec-tb-2006`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006), [`gov2_trec-tb-2006_efficiency`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_efficiency), [`gov2_trec-tb-2006_efficiency_10k`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_efficiency_10k), [`gov2_trec-tb-2006_efficiency_stream1`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_efficiency_stream1), [`gov2_trec-tb-2006_efficiency_stream2`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_efficiency_stream2), [`gov2_trec-tb-2006_efficiency_stream3`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_efficiency_stream3), [`gov2_trec-tb-2006_efficiency_stream4`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_efficiency_stream4), [`gov2_trec-tb-2006_named-page`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_named-page)

## Usage

```python
from datasets import load_dataset

docs = load_dataset('irds/gov2', 'docs')
for record in docs:
record # {'doc_id': ..., 'url': ..., 'http_headers': ..., 'body': ..., 'body_content_type': ...}

```

Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the
data in 🤗 Dataset format.

---
pretty_name: '`gov2`'
viewer: 不可用
source_datasets: []
task_categories:
- 文本检索
---

# `gov2` 数据集卡片

本`gov2`数据集由[ir-datasets](https://ir-datasets.com/)工具包提供。如需了解该数据集的更多详情，请参阅其[官方文档](https://ir-datasets.com/gov2#gov2)。

# 数据集内容

本数据集包含：
- `docs`（即文档语料库），共计25,205,179条。

本数据集被以下数据集使用：[`gov2_trec-tb-2004`](https://huggingface.co/datasets/irds/gov2_trec-tb-2004)、[`gov2_trec-tb-2005`](https://huggingface.co/datasets/irds/gov2_trec-tb-2005)、[`gov2_trec-tb-2005_efficiency`](https://huggingface.co/datasets/irds/gov2_trec-tb-2005_efficiency)、[`gov2_trec-tb-2005_named-page`](https://huggingface.co/datasets/irds/gov2_trec-tb-2005_named-page)、[`gov2_trec-tb-2006`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006)、[`gov2_trec-tb-2006_efficiency`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_efficiency)、[`gov2_trec-tb-2006_efficiency_10k`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_efficiency_10k)、[`gov2_trec-tb-2006_efficiency_stream1`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_efficiency_stream1)、[`gov2_trec-tb-2006_efficiency_stream2`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_efficiency_stream2)、[`gov2_trec-tb-2006_efficiency_stream3`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_efficiency_stream3)、[`gov2_trec-tb-2006_efficiency_stream4`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_efficiency_stream4)、[`gov2_trec-tb-2006_named-page`](https://huggingface.co/datasets/irds/gov2_trec-tb-2006_named-page)

## 使用方法

python
from datasets import load_dataset

docs = load_dataset('irds/gov2', 'docs')
for record in docs:
record # {'doc_id': ..., 'url': ..., 'http_headers': ..., 'body': ..., 'body_content_type': ...}

请注意，调用`load_dataset`函数将下载该数据集（若数据集未公开，则会提供访问指引），并将其转换为🤗 数据集格式进行存储。

原始信息汇总

数据集概述

数据集名称

gov2

数据集来源

由 ir-datasets 包提供。

数据集内容

• docs (文档，即语料库); 数量=25,205,179

数据集用途

• 用于多个相关数据集，包括：
  • gov2_trec-tb-2004
  • gov2_trec-tb-2005
  • gov2_trec-tb-2005_efficiency
  • gov2_trec-tb-2005_named-page
  • gov2_trec-tb-2006
  • gov2_trec-tb-2006_efficiency
  • gov2_trec-tb-2006_efficiency_10k
  • gov2_trec-tb-2006_efficiency_stream1
  • gov2_trec-tb-2006_efficiency_stream2
  • gov2_trec-tb-2006_efficiency_stream3
  • gov2_trec-tb-2006_efficiency_stream4
  • gov2_trec-tb-2006_named-page

数据集加载示例

python from datasets import load_dataset

docs = load_dataset(irds/gov2, docs) for record in docs: record # {doc_id: ..., url: ..., http_headers: ..., body: ..., body_content_type: ...}

搜集汇总

背景与挑战

背景概述

该数据集名为'irds/gov2'，包含超过2500万条文档，主要用于文本检索任务。它被多个TREC任务使用，适用于信息检索研究和应用。