Dataset for "DIRT: a Literature-Based Benchmark Suite for Grounders"

Reproducing benchmark results This requires docker.First load DIRT_container.tar.gz into docker with docker load < ./DIRT_container.tar.gz or something similar.Then making sure you're in the DIRT directory, run ./docker_run_bench.The final step is to wait a week. Files DIRT.zip contains the DIRT benchmark suite. JELIA_2025_benchmark_results.zip contains the raw results used in the JELIA paper. SLR.zip contains the raw results and all intermediate files used in the systematic literature review, with all abstracts and other copyrightable material removed. DIRT_container.tar.gz a docker image containing all the dependencies and reasoning engines required to run the DIRT benchmark. This is the exact container used for the creation of JELIA_2025_benchmark_results.zip. Can be used in the same way as the README in DIRT.zip in the Docker container section explains about the result file.