autorl-org/arlbench

ARLBench性能数据集是一个用于强化学习（RL）的超参数优化（HPO）的基准测试。它包含了PPO、DQN和SAC算法在各种环境下的景观数据，以及不同优化算法的优化数据。数据集的结构将训练步骤、种子和超参数配置映射到训练性能，并为优化运行提供了额外信息。README还提供了示例笔记本和ARLBench论文的链接以供更多详细信息。

The ARLBench Performance Dataset is a benchmark designed for hyperparameter optimization (HPO) in Reinforcement Learning (RL). It includes landscape data for PPO, DQN, and SAC algorithms across various environments, and optimization data for different optimization algorithms. The dataset is structured to map training steps, seed, and hyperparameter configuration to training performance, and includes additional information for optimization runs. The README also provides links to example notebooks and the ARLBench paper for further details.

原始信息汇总

ARLBench性能数据集

概述

ARLBench性能数据集是一个用于强化学习中超参数优化的基准测试数据集。该数据集收集了数千次运行结果，旨在为未来的超参数优化工具提供有意义的数据。

数据集规模

数据集大小介于10K到100K之间。

配置详情

数据集包含三种配置：

PPO数据

• 文件列表：
  • "atari_battle_zone_ppo.csv"
  • "atari_double_dunk_ppo.csv"
  • "atari_phoenix_ppo.csv"
  • "atari_qbert_ppo.csv"
  • "atari_this_game_ppo.csv"
  • "box2d_lunar_lander_continuous_ppo.csv"
  • "box2d_lunar_lander_ppo.csv"
  • "brax_halfcheetah_ppo.csv"
  • "brax_hopper_ppo.csv"
  • "brax_ant_ppo.csv"
  • "brax_humanoid_ppo.csv"
  • "cc_acrobot_ppo.csv"
  • "cc_cartpole_ppo.csv"
  • "cc_continuous_mountain_car_ppo.csv"
  • "cc_mountain_car_ppo.csv"
  • "cc_pendulum_ppo.csv"
  • "minigrid_door_key_ppo.csv"
  • "minigrid_empty_random_ppo.csv"
  • "minigrid_four_rooms_ppo.csv"
  • "minigrid_unlock_ppo.csv"

DQN数据

• 文件列表：
  • "atari_battle_zone_dqn.csv"
  • "atari_double_dunk_dqn.csv"
  • "atari_phoenix_dqn.csv"
  • "atari_qbert_dqn.csv"
  • "atari_this_game_dqn.csv"
  • "minigrid_door_key_dqn.csv"
  • "minigrid_empty_random_dqn.csv"
  • "minigrid_four_rooms_dqn.csv"
  • "minigrid_unlock_dqn.csv"
  • "cc_acrobot_dqn.csv"
  • "cc_cartpole_dqn.csv"
  • "cc_mountain_car_dqn.csv"
  • "box2d_lunar_lander_dqn.csv"

SAC数据

• 文件列表：
  • "box2d_bipedal_walker_sac.csv"
  • "box2d_lunar_lander_continuous_sac.csv"
  • "brax_halfcheetah_sac.csv"
  • "brax_hopper_sac.csv"
  • "brax_ant_sac.csv"
  • "brax_humanoid_sac.csv"
  • "cc_continuous_mountain_car_sac.csv"
  • "cc_pendulum_sac.csv"