irds/lotte_science_dev
收藏资源简介：
--- pretty_name: '`lotte/science/dev`' viewer: false source_datasets: [] task_categories: - text-retrieval --- # Dataset Card for `lotte/science/dev` The `lotte/science/dev` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package. For more information about the dataset, see the [documentation](https://ir-datasets.com/lotte#lotte/science/dev). # Data This dataset provides: - `docs` (documents, i.e., the corpus); count=343,642 This dataset is used by: [`lotte_science_dev_forum`](https://huggingface.co/datasets/irds/lotte_science_dev_forum), [`lotte_science_dev_search`](https://huggingface.co/datasets/irds/lotte_science_dev_search) ## Usage ```python from datasets import load_dataset docs = load_dataset('irds/lotte_science_dev', 'docs') for record in docs: record # {'doc_id': ..., 'text': ...} ``` Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the data in 🤗 Dataset format. ## Citation Information ``` @article{Santhanam2021ColBERTv2, title = "ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction", author = "Keshav Santhanam and Omar Khattab and Jon Saad-Falcon and Christopher Potts and Matei Zaharia", journal= "arXiv preprint arXiv:2112.01488", year = "2021", url = "https://arxiv.org/abs/2112.01488" } ```
数据集展示名：`lotte/science/dev` 数据集查看器：禁用 源数据集：无 任务类别： - 文本检索 # `lotte/science/dev` 数据集卡片 本数据集由[ir-datasets](https://ir-datasets.com/)工具包提供。如需了解该数据集的更多细节，请参阅[官方文档](https://ir-datasets.com/lotte#lotte/science/dev)。 ## 数据内容 本数据集包含以下内容： - `docs`（文档，即语料库），共计343,642条。 本数据集被以下数据集所使用： [`lotte_science_dev_forum`](https://huggingface.co/datasets/irds/lotte_science_dev_forum)、[`lotte_science_dev_search`](https://huggingface.co/datasets/irds/lotte_science_dev_search) ## 使用方法 python from datasets import load_dataset docs = load_dataset('irds/lotte_science_dev', 'docs') for record in docs: record # {'doc_id': ..., 'text': ...} 请注意，调用`load_dataset`函数将下载该数据集（若数据集未公开，则会提供访问指引），并将数据转换为🤗数据集格式的副本。 ## 引用信息 @article{Santhanam2021ColBERTv2, title = "ColBERTv2: 基于轻量级后期交互的高效精准检索", author = "Keshav Santhanam and Omar Khattab and Jon Saad-Falcon and Christopher Potts and Matei Zaharia", journal= "arXiv预印本 arXiv:2112.01488", year = "2021", url = "https://arxiv.org/abs/2112.01488" }
数据集概述
数据集名称
lotte/science/dev
数据来源
由 ir-datasets 包提供。
数据内容
- 文档 (
docs): 包含343,642个文档。
数据用途
该数据集被用于以下项目：
使用示例
python from datasets import load_dataset
docs = load_dataset(irds/lotte_science_dev, docs) for record in docs: record # {doc_id: ..., text: ...}
引用信息
@article{Santhanam2021ColBERTv2, title = "ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction", author = "Keshav Santhanam and Omar Khattab and Jon Saad-Falcon and Christopher Potts and Matei Zaharia", journal= "arXiv preprint arXiv:2112.01488", year = "2021", url = "https://arxiv.org/abs/2112.01488" }
