castorini/msmarco_v1_doc_doc2query-t5_expansions

该数据集提供了使用docTTTTTquery模型为MS MARCO V1文档语料库生成的查询。docTTTTTquery模型是doc2query系列文档扩展模型的最新版本，其基本思想是训练一个模型，当给定输入文档时，生成文档可能回答的问题（或更广泛地说，文档可能相关的查询）。这些预测的问题（或查询）随后被附加到原始文档中，然后像以前一样进行索引。docTTTTTquery模型的名称来源于使用T5作为扩展模型。

原始信息汇总

数据集概述

数据集内容

本数据集提供了针对MS MARCO V1文档语料库生成的查询扩展，使用的是docTTTTTquery模型，该模型属于doc2query系列中的最新版本。该模型的基本功能是，给定一个输入文档，生成该文档可能回答的问题（或更广泛地说，该文档可能相关的查询）。这些预测的问题（或查询）随后被附加到原始文档上，然后像以前一样进行索引。

数据集结构

数据集包含三个折叠（训练集、开发集和测试集），它们共享相同的语料库。每个数据条目的示例如下：

json { "id": "D1555982", "predicted_queries": ["when find radius of star r", "what is r radius", "how to find out radius of star", "what is radius r", "what is radius of r", "how do you find radius of star igel", "which law states that radiation is proportional to radiation?", "what is the radius of a spherical star", "what is the radius of the star", "what is radius of star", "which radiation is produced during a solar radiation experiment?", "how to find radius r", "what is radius r of a star", "the hot glowing surfaces of stars emit energy in the form of", "what is the radius of a star", "what is the radius of a star", "how to find radius r on a star", "how to find radius r in a solar cell", "what kind of energy does a hot glowing surface of a star emit?", "what kind of energy does the hot glowing surface of stars emit"] }

加载数据集

加载数据集的示例代码如下：

python dataset = load_dataset(castorini/msmarco_v1_doc_doc2query-t5_expansions)

引用信息

@article{docTTTTTquery, title={From doc2query to {docTTTTTquery}}, author={Nogueira, Rodrigo and Lin, Jimmy}, year={2019} }

@article{emdt5, author = "Ronak Pradeep and Rodrigo Nogueira and Jimmy Lin", title = "The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models", journal = "arXiv:2101.05667", year = 2021, }