five

irds/wikiclir_fr

收藏
Hugging Face2024-10-04 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/irds/wikiclir_fr
下载链接
链接失效反馈
官方服务:
资源简介:
--- pretty_name: '`wikiclir/fr`' viewer: false source_datasets: [] task_categories: - text-retrieval language: - fr --- # Dataset Card for `wikiclir/fr` The `wikiclir/fr` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package. For more information about the dataset, see the [documentation](https://ir-datasets.com/wikiclir#wikiclir/fr). # Data This dataset provides: - `docs` (documents, i.e., the corpus); count=1,894,397 - `queries` (i.e., topics); count=1,089,179 - `qrels`: (relevance assessments); count=5,137,366 ## Usage ```python from datasets import load_dataset docs = load_dataset('irds/wikiclir_fr', 'docs') for record in docs: record # {'doc_id': ..., 'title': ..., 'text': ...} queries = load_dataset('irds/wikiclir_fr', 'queries') for record in queries: record # {'query_id': ..., 'text': ...} qrels = load_dataset('irds/wikiclir_fr', 'qrels') for record in qrels: record # {'query_id': ..., 'doc_id': ..., 'relevance': ..., 'iteration': ...} ``` Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the data in 🤗 Dataset format. ## Citation Information ``` @inproceedings{sasaki-etal-2018-cross, title = "Cross-Lingual Learning-to-Rank with Shared Representations", author = "Sasaki, Shota and Sun, Shuo and Schamoni, Shigehiko and Duh, Kevin and Inui, Kentaro", booktitle = "Proceedings of the 2018 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)", month = jun, year = "2018", address = "New Orleans, Louisiana", publisher = "Association for Computational Linguistics", url = "https://aclanthology.org/N18-2073", doi = "10.18653/v1/N18-2073", pages = "458--463" } ```
提供机构:
irds
原始信息汇总

数据集卡片 wikiclir/fr

数据集概述

wikiclir/fr 数据集由 ir-datasets 包提供。

数据内容

该数据集包含以下内容:

  • docs(文档,即语料库):数量为 1,894,397
  • queries(即主题):数量为 1,089,179
  • qrels(相关性评估):数量为 5,137,366

使用方法

以下是加载和使用该数据集的示例代码: python from datasets import load_dataset

docs = load_dataset(irds/wikiclir_fr, docs) for record in docs: record # {doc_id: ..., title: ..., text: ...}

queries = load_dataset(irds/wikiclir_fr, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/wikiclir_fr, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

引用信息

@inproceedings{sasaki-etal-2018-cross, title = "Cross-Lingual Learning-to-Rank with Shared Representations", author = "Sasaki, Shota and Sun, Shuo and Schamoni, Shigehiko and Duh, Kevin and Inui, Kentaro", booktitle = "Proceedings of the 2018 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)", month = jun, year = "2018", address = "New Orleans, Louisiana", publisher = "Association for Computational Linguistics", url = "https://aclanthology.org/N18-2073", doi = "10.18653/v1/N18-2073", pages = "458--463" }

5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作