PyTorch code accompanying the paper "Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning" (NeurIPS 2021).

Last update: Dec 14, 2022

Related tags

Deep Learning HIGL

Overview

HIGL

This is a PyTorch implementation for our paper: Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning (NeurIPS 2021).

Our code is based on official implementation of HRAC (NeurIPS 2020) and Map-planner (NeurIPS 2019)

Installation

conda create -n higl python=3.6
conda activate higl
./install_all.sh

Also, to run the MuJoCo experiments, a license is required (see here).

Usage

Training & Evaluation

Point Maze

./scripts/point_maze_sparse.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/point_maze_sparse.sh dense 5e5 0 2
./scripts/point_maze_sparse.sh sparse 5e5 0 2

Ant Maze (U-shape)

./scripts/higl_ant_maze_u.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u.sh dense 10e5 0 2
./scripts/higl_ant_maze_u.sh sparse 10e5 0 2

Ant Maze (W-shape)

./scripts/higl_ant_maze_w.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_w.sh dense 10e5 0 2
./scripts/higl_ant_maze_w.sh sparse 10e5 0 2

Reacher & Pusher

./scripts/higl_fetch.sh ${env} ${timesteps} ${gpu} ${seed}
./scripts/higl_fetch.sh Reacher3D-v0 5e5 0 2
./scripts/higl_fetch.sh Pusher-v0 10e5 0 2

Stochastic Ant Maze (U-shape)

./scripts/higl_ant_maze_u_stoch.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u_stoch.sh dense 10e5 0 2
./scripts/higl_ant_maze_u_stoch.sh sparse 10e5 0 2

PyTorch code accompanying the paper "Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning" (NeurIPS 2021).

Related tags

Overview

HIGL

Installation

Usage

Training & Evaluation

Owner

Junsu Kim

Code for "My(o) Armband Leaks Passwords: An EMG and IMU Based Keylogging Side-Channel Attack" paper

Predict and time series avocado hass

Molecular Sets (MOSES): A benchmarking platform for molecular generation models

Code for the paper titled "Prabhupadavani: A Code-mixed Speech Translation Data for 25 languages"

Implementation of popular SOTA self-supervised learning algorithms as Fastai Callbacks.

Method for facial emotion recognition compitition of Xunfei and Datawhale .

Cleaned up code for DSTC 10: SIMMC 2.0 track: subtask 2: multimodal coreference resolution

A pytorch-version implementation codes of paper: "BSN++: Complementary Boundary Regressor with Scale-Balanced Relation Modeling for Temporal Action Proposal Generation"

Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising

[ICCV 2021 Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

Unofficial PyTorch implementation of MobileViT based on paper "MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer".

RuDOLPH: One Hyper-Modal Transformer can be creative as DALL-E and smart as CLIP

Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language (NeurIPS 2021)

Semi-supervised semantic segmentation needs strong, varied perturbations

My implementation of transformers related papers for computer vision in pytorch

Collapse by Conditioning: Training Class-conditional GANs with Limited Data

StyleGAN2-ADA - Official PyTorch implementation

A machine learning library for spiking neural networks. Supports training with both torch and jax pipelines, and deployment to neuromorphic hardware.

EgoNN: Egocentric Neural Network for Point Cloud Based 6DoF Relocalization at the City Scale

Human motion synthesis using Unity3D