ibm-research/ITBench-Trajectories

ITBench轨迹数据集包含了使用[ITBench-SRE-Agent](https://github.com/itbench-hub/ITBench-SRE-Agent)的LLM代理的完整执行轨迹。它记录了代理在实际操作中的推理过程、工具使用情况以及在多个先进语言模型中处理站点可靠性工程（SRE）、安全与合规（CISO）以及财务运营（FinOps）场景的性能表现。数据集结构包括代理的调查工作流、生成的代码、最终输出以及定量评估指标。This dataset contains complete execution trajectories of LLM agents using the [ITBench-SRE-Agent](https://github.com/itbench-hub/ITBench-SRE-Agent). It captures real agent reasoning, tool usage, and performance across multiple state-of-the-art language models tackling Site Reliability Engineering (SRE), Security & Compliance (CISO), and Financial Operations (FinOps) scenarios from the [ITBench benchmark](https://github.com/IBM/ITBench). Each trajectory includes the agents investigation workflow, generated code, final output, and quantitative evaluation metrics.