A Benchmark Framework for Screening Automation in Systematic Reviews (replication package)

This repository contains the replication package for the paper A Benchmark Framework for Screening Automation in Systematic Reviews. Structure (each subfolder has its own Readme file): promptsr.zip - Contains the PromptSR tool, including documentation README.md on how to use it. This tool assumes you already have a PostgreSQL instance running on the system. srbench.zip - Contains all the tab-separated files with 32 Systematic Reviews. supplementary.zip - Contains a PDF for supplementary material, like tables, plots, etc. It also contains a dump of the original results stored in PostgreSQL that can be loaded with the following command CREATE SCHEMA IF NOT EXISTS sesr_final_run; followed by psql -U <target_user> -d <target_db> -f results.sql To run PromptSR, unzip the file srbench.zip and place the srbench directory inside promptsr/data/srbench. In this directory, all the CSV files should exist. Example promptsr/data/srbench/archiml.csv Follow PromptSR's README to replicate the results or try the tool.