HIGL
This is a PyTorch implementation for our paper: Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning (NeurIPS 2021).
Our code is based on official implementation of HRAC (NeurIPS 2020) and Map-planner (NeurIPS 2019)
Installation
conda create -n higl python=3.6
conda activate higl
./install_all.sh
Also, to run the MuJoCo experiments, a license is required (see here).
Usage
Training & Evaluation
- Point Maze
./scripts/point_maze_sparse.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/point_maze_sparse.sh dense 5e5 0 2
./scripts/point_maze_sparse.sh sparse 5e5 0 2
- Ant Maze (U-shape)
./scripts/higl_ant_maze_u.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u.sh dense 10e5 0 2
./scripts/higl_ant_maze_u.sh sparse 10e5 0 2
- Ant Maze (W-shape)
./scripts/higl_ant_maze_w.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_w.sh dense 10e5 0 2
./scripts/higl_ant_maze_w.sh sparse 10e5 0 2
- Reacher & Pusher
./scripts/higl_fetch.sh ${env} ${timesteps} ${gpu} ${seed}
./scripts/higl_fetch.sh Reacher3D-v0 5e5 0 2
./scripts/higl_fetch.sh Pusher-v0 10e5 0 2
- Stochastic Ant Maze (U-shape)
./scripts/higl_ant_maze_u_stoch.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u_stoch.sh dense 10e5 0 2
./scripts/higl_ant_maze_u_stoch.sh sparse 10e5 0 2
9.7k Jan 01, 2023
881 Dec 27, 2022
15 Dec 02, 2022
1.5k Dec 30, 2022
371 Jan 05, 2023
150 Dec 14, 2022
1.2k Dec 26, 2022
4 Sep 10, 2021
0 Jan 07, 2022
41 Nov 28, 2022
50 Nov 18, 2022
16 Oct 18, 2022
182 Dec 27, 2022
85 Dec 24, 2022
37 Oct 25, 2022
59 Nov 25, 2022
189 Dec 29, 2022
1 Jul 20, 2022
294 Jan 05, 2023
3 Apr 07, 2022