ethanning/deepresearchgym-agentic-search-logs

--- license: cc-by-4.0 task_categories: - text-retrieval - text-generation language: - en tags: - information-retrieval - agentic-search - search-logs - query-rewriting - query-log - search-behavior - llm-agents - deep-research pretty_name: DeepResearchGym Agentic Search Logs size_categories: - 10M<n<100M --- ## DeepResearchGym Agentic Search Logs This repository hosts the dataset accompanying the paper **“Agentic Search in the Wild”** (arXiv: https://arxiv.org/abs/2601.17617). The dataset contains **14M+** search queries collected via **DeepResearchGym (DRGym)**, an open-source search API designed for DeepResearch-style agentic search. For more background on DRGym, see: https://arxiv.org/abs/2505.19253. All records have been **anonymized** and **shuffled** to prevent re-identification, and we additionally applied basic cleaning to remove clearly abnormal queries (e.g., empty/degenerate inputs and obvious artifacts). The final release is **sessionized**, where queries are grouped into search sessions according to the procedure described in the paper. For full details on data collection, processing, anonymization, and sessionization, please refer to the paper. ## Dataset Structure | Field | Description | |-------|-------------| | `session_id` | Anonymized session identifier | | `session_len` | Number of queries in this session | | `query_id` | 1-indexed position within session | | `query` | Query text | | `time_offset` | Seconds since first query in session | | `retrieval_depth` | Number of documents requested (k) | ## License This dataset is released under **CC BY 4.0**. We encourage use for research and development with appropriate attribution. ## Citation If you use this dataset, please cite the corresponding paper (arXiv: https://arxiv.org/abs/2601.17617). ```bibtex @misc{ning2026agenticsearchwildintents, title={Agentic Search in the Wild: Intents and Trajectory Dynamics from 14M+ Real Search Requests}, author={Jingjie Ning and João Coelho and Yibo Kong and Yunfan Long and Bruno Martins and João Magalhães and Jamie Callan and Chenyan Xiong}, year={2026}, eprint={2601.17617}, archivePrefix={arXiv}, primaryClass={cs.IR}, url={https://arxiv.org/abs/2601.17617}, } ``` ## Contact For questions, issues, or collaboration, please contact the paper authors.许可证：CC BY 4.0 任务类别： - 文本检索 - 文本生成 语言： - 英语 标签： - 信息检索 - 智能体搜索(agentic-search) - 搜索日志(search-logs) - 查询重写(query-rewriting) - 查询日志(query-log) - 搜索行为(search-behavior) - 大语言模型智能体(LLM Agents) - 深度研究(deep-research) 展示名称：DeepResearchGym 智能体搜索日志 规模类别： - 1000万<数据量<1亿 ## DeepResearchGym 智能体搜索日志 本仓库承载了与论文**“野外智能体搜索”（Agentic Search in the Wild）**（arXiv 链接：https://arxiv.org/abs/2601.17617）配套的数据集。 该数据集包含超过1400万条搜索查询，均通过**DeepResearchGym（DRGym）**采集——这是一款专为深度研究型智能体搜索设计的开源搜索API。如需了解DRGym的更多背景信息，请参阅：https://arxiv.org/abs/2505.19253。 所有记录均已完成**匿名化**与**洗牌处理**，以防止身份重新识别；此外我们还执行了基础清洗操作，移除了明显异常的查询（例如空输入、退化输入以及明显的伪影数据）。最终发布的数据集已完成**会话化处理**，即按照论文中描述的流程，将查询按搜索会话进行分组。 如需了解数据采集、处理、匿名化与会话化的完整细节，请参阅该论文。 ## 数据集结构 | 字段名 | 描述 | |-------|-------------| | `session_id` | 匿名化后的会话标识符 | | `session_len` | 该会话内的查询数量 | | `query_id` | 会话内的1索引位置（从1开始计数的查询序号） | | `query` | 查询文本 | | `time_offset` | 距会话内第一条查询的秒数 | | `retrieval_depth` | 请求获取的文档数（即参数k） | ## 许可证 本数据集采用**CC BY 4.0**许可证发布。我们鼓励在进行适当署名的前提下，将其用于研究与开发工作。 ## 引用 若您使用本数据集，请引用对应的论文（arXiv 链接：https://arxiv.org/abs/2601.17617）。 bibtex @misc{ning2026agenticsearchwildintents, title={"Agentic Search in the Wild: Intents and Trajectory Dynamics from 14M+ Real Search Requests"}, author={Jingjie Ning and João Coelho and Yibo Kong and Yunfan Long and Bruno Martins and João Magalhães and Jamie Callan and Chenyan Xiong}, year={2026}, eprint={2601.17617}, archivePrefix={arXiv}, primaryClass={cs.IR}, url={https://arxiv.org/abs/2601.17617}, } ## 联系方式 如有疑问、问题或合作意向，请联系论文作者。