lyuchao/ITBench-Trajectories

ITBench轨迹数据集是一个用于IT自动化任务的智能体执行轨迹的全面集合。该数据集包含了使用ITBench-SRE-Agent的大语言模型（LLM）智能体的完整执行轨迹，记录了智能体在处理来自ITBench基准测试的站点可靠性工程（SRE）、安全与合规（CISO）以及财务运营（FinOps）场景时的真实推理过程、工具使用情况和性能表现。每条轨迹都包括智能体的调查工作流程、生成的代码、最终输出以及定量评估指标。ITBench Trajectories is a comprehensive collection of agent execution traces for IT automation tasks. This dataset contains complete execution trajectories of LLM agents using the ITBench-SRE-Agent. It captures real agent reasoning, tool usage, and performance across multiple state-of-the-art language models tackling Site Reliability Engineering (SRE), Security & Compliance (CISO), and Financial Operations (FinOps) scenarios from the ITBench benchmark. Each trajectory includes the agents investigation workflow, generated code, final output, and quantitative evaluation metrics.