zilliz/msmarco-context-relevance-with-think

该数据集包含带有相关性标注的查询-上下文对，用于识别文档中与查询语义相关的部分。标注有助于识别文档中哪些部分在语义上与查询相关，即使它们不包含精确的关键词匹配。关键特征包括：`context_spans`（指示上下文文本中分段跨度的位置）、`context_spans_relevance`（二进制标签，指示每个跨度是否应被高亮显示，即是否为回答查询提供关键信息）和`think_process`（包含标注过程中使用的推理过程，以确保更准确的上下文跨度相关性标签，并提高可观察性和可解释性）。数据集使用Qwen3-8B进行标注，完整的思考过程保存在`think_process`字段中。

This dataset contains query-context pairs with relevance annotations for context spans. The annotations help identify which parts of a document are semantically relevant to a query, even when they dont contain exact keyword matches. Key features include: `context_spans` (indicates the positions of segmented spans within the context text), `context_spans_relevance` (binary labels indicating whether each span should be highlighted, i.e., provides key information for answering the query), and `think_process` (contains the reasoning process used during annotation to ensure more accurate context span relevance labels and improve observability and interpretability). The dataset was annotated using Qwen3-8B, with the complete thinking process preserved in the `think_process` field.