TREED: A Tree-Structured Diagram Benchmark for Multimodal Graph Reconstruction

TREED is a curated benchmark for evaluating topology reconstruction in multimodal foundation models. It provides tree-structured diagram images, ground-truth graph annotations represented as structured edge lists, model responses, and code. TREED operationalizes structural abstraction by preserving graph topology while removing semantic and stylistic information, with connectivity derived from symbol positions using a modified spanning-tree procedure. Diagrams are derived from diverse electrical-system datasets and standardized to isolate topology from semantic and visual cues, enabling reproducible evaluation of graph reconstruction and diagram understanding. The repository also includes the TREE-EDs dataset release (47 images) annotated using the Label Studio platform. Additional electrical-system datasets for benchmarking and dataset construction are catalogued at: https://mayot0.github.io/TopDat-ED/ Characteristics: • Images: 7,544 • Resolution: 393×403 • Node Range: 4–20 • Graph Type: Undirected • Ground Truth: Structured Edge Lists • Source Datasets: 7 (see references and links) • Metrics: GED, WL, Spectral, Path, Node Count Difference (NCD), and Tree Edge Deviation (TED) • Quality Control: Automated verification