intfloat/query2doc_msmarco

该数据集包含来自MS-MARCO查询的GPT-3.5（`text-davinci-003`）生成内容。数据集中的每个实例包括查询ID、查询文本和生成的伪文档。数据集分为训练集、开发集、测试集以及两个TREC数据集（trec_dl2019和trec_dl2020）。

原始信息汇总

数据集概述

基本信息

• 许可证: cc-by-4.0
• 语言: 英语
• 数据集大小: 100K<n<1M

数据集内容

• 描述: 该数据集包含基于MS-MARCO查询的GPT-3.5 (text-davinci-003)生成内容。
• 来源论文: Query2doc: Query Expansion with Large Language Models by Liang Wang, Nan Yang, and Furu Wei

数据实例

• 示例: json { "query_id": "1030303", "query": "who is aziz hashim", "pseudo_doc": "Aziz Hashim is a renowned entrepreneur, business leader, and one of the most successful restaurant franchise operators in the US. He is the founder of NRD Capital, a private equity firm focused on investments in multi-unit restaurant franchised businesses. Hashim has built a formidable track record of success in the franchise industry, with brands such as Outback Steakhouse and Jamba Juice. His accomplishments and philanthropic initiatives have earned him numerous awards, including the prestigious Ernst and Young Entrepreneur of the Year award." }

数据字段

• query_id: 字符串类型
• query: 字符串类型
• pseudo_doc: 字符串类型

数据分割

分割类型	记录数
train	502939
dev	6980
test	6837
trec_dl2019	43
trec_dl2020	54

使用方法

• 加载数据集: python from datasets import load_dataset dataset = load_dataset(intfloat/query2doc_msmarco) print(dataset[trec_dl2019][0])

引用信息

@article{wang2023query2doc, title={Query2doc: Query Expansion with Large Language Models}, author={Wang, Liang and Yang, Nan and Wei, Furu}, journal={arXiv preprint arXiv:2303.07678}, year={2023} }