BRIDGE

This repository contains the BRIDGE dataset from the paper Bridging RL Theory and Practice with the Effective Horizon. The code used to generate the data is available at https://github.com/cassidylaidlaw/effective-horizon.

See README.md for details about the contents of the dataset. summary.csv contains an overview of properties of the MDPs. summary_sticky.csv contains an overview of the sticky-action versions of the MDPs investigated in the paper The Effective Horizon Explains Deep RL Performance in Stochastic Environments. bridge_dataset.zip contains the tabular representations of the MDPs and analysis results.

If you find the dataset useful for your research, please consider citing our papers:

@inproceedings{laidlaw2023effectivehorizon,
title={Bridging RL Theory and Practice with the Effective Horizon},
author={Laidlaw, Cassidy and Russell, Stuart and Dragan, Anca},
booktitle={NeurIPS},
year={2023}
}

@inproceedings{laidlaw2024stochasticeffectivehorizon,
title={The Effective Horizon Explains Deep RL Performance in Stochastic Environments},
author={Laidlaw, Cassidy and Zhu, Banghua and Russell, Stuart and Dragan, Anca},
booktitle={ICLR},
year={2024}
}