five

A Dataset of LLM Strategic Play

收藏
DataONE2025-12-01 更新2025-12-06 收录
下载链接:
https://search.dataone.org/view/sha256:35d73be64c0f55765de6bda372854c27118b0e37765f4e0c032facfe144f06ce
下载链接
链接失效反馈
官方服务:
资源简介:
This dataset aims to support the systematic evaluation of Large Language Models (LLMs) in structured decision-making environments. It contains 9,572 move-level records generated from competitive interactions among twenty LLMs across four board games—Tic-Tac-Toe, Connect Four, Suicide, and Not Connect Four—collected during an eight-round Swiss-System tournament conducted between May and July 2025. The data captures the full context of each decision, including board states encoded in GDL, legal move sets, model identifiers, execution times, and the raw reasoning provided by each agent. A GDL-based validation pipeline, including a multi-step correction mechanism, ensures the legality and integrity of all recorded actions. The scope of the dataset is to enable analyses of strategic behavior, rule adherence, performance stability, and model-to-model variability, providing a resource for benchmarking and studying LLM behavior in controlled, reproducible game environments.
创建时间:
2025-12-04
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作