ContextualAI/recency-based-instructions

这是一个用于评估遵循特定指令的检索系统的数据集。每个查询都附带一个指定在检索过程中应优先考虑的信息方面或类型的指令。数据集包含了查询、指令、相关段落的元数据、非相关段落的元数据、段落的来源数据集和用于从来源数据集中检索完整段落的唯一标识符。

This dataset is designed for evaluating retrieval systems that can follow specific instructions when ranking passages. Each query is accompanied by an instruction that specifies the aspect or type of information that should be prioritized during retrieval. The dataset includes features such as the query, instruction, metadata for the relevant passage, metadata for non-relevant passages, the source dataset of the passage, and a unique identifier to retrieve the full passage from the source dataset.