遇见数据集

TS-MCP benchmark: preregistered protocol and sealed run plans for language models on Tanabe-Sugano ligand-field tasks

收藏
Zenodo2026-11-03 更新2026-11-05 收录
官方服务:

资源简介:

This preregistration fixes the hypotheses, design, run plans and analysis of the confirmatory study of the TS-MCP benchmark before any model has seen a confirmatory task. Language models determine ligand-field parameters (Dq, B, C) of transition-metal complexes from absorption bands, compute Tanabe-Sugano curves and diagrams, and recognise questions outside the ligand-field model. Three conditions differ only in their tools: no tools (A), a sandboxed code interpreter (B), and a domain MCP server built on the tanabesugano package (C). The confirmatory split has 55 tasks, identified by hash only. The record contains the preregistration document and the sealed run plans (headers and hashes, no task text and no prompts).

提供机构:
Zenodo
创建时间:
2026-11-03
二维码
社区交流群
二维码
科研交流群
商业服务