IDEA-AI4S/ReactBench

ReactBench是一个全面的基准测试，旨在评估多模态大语言模型（MLLMs）在化学反应图上的拓扑推理能力。该数据集挑战模型解释复杂的视觉布局、理解分子转化以及追踪不同图结构中的反应路径。数据结构包括默认加载的扁平化Parquet格式和原始存档格式，前者为每个独立的视觉问答对提供优化，后者保留原始的一对多关系。

ReactBench is a comprehensive benchmark designed to evaluate the topological reasoning capabilities of Multimodal Large Language Models (MLLMs) specifically on chemical reaction diagrams. The dataset challenges models to interpret complex visual layouts, understand molecular transformations, and trace reaction pathways across different diagram structures. The data structure includes a default flattened Parquet format optimized for evaluation and the original archive format preserving one-to-many relationships.