SCALAR: Cross-Scale Benchmark of Nanoparticle Structures for Quantifying Hallucination, Consistency, and Reasoning in Materials Foundation Models

SCALAR (Structural Consistency And Logic Across Regimes) is a cross-scale benchmark of ≈100,000 nanoparticle structures (25–18,123 atoms across 83 predominantly hydride materials, carving radii 10–30 Å) designed to evaluate structural hallucination, cross-scale consistency, and physical reasoning in materials foundation models. Each structure is a spherical truncation of a DFT-relaxed, experimentally validated crystal lattice; the benchmark treats radius as a controlled scaling knob and provides leakage-free in-distribution and out-of-distribution splits over both radius and SO(3) rotation. This archive contains the seed inputs for the benchmark: the 83 primitive unit cell CIFs and per-(material, radius) base XYZ structures. The full benchmark (with rotation augmentation) is reproduced locally by running the generation pipeline shipped in the GitHub repository. Paper: "SCALAR: Quantifying Structural Hallucination, Consistency, and Reasoning Gaps in Materials Foundation Models" (submitted to Digital Discovery). Code & generation pipeline: github.com/KurbanIntelligenceLab/SCALAR (MIT license). To reproduce the full benchmark from this archive: python -m create_scalar.create_scalar --raw-data scalar_raw.zip --output scalar