Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Assessing the Influence of Models on the Performance of Reinforcement Learning Algorithms applied on Continuous Control Tasks

HAR-stacked-residual-bidir-LSTMs - Deep stacked residual bidirectional LSTMs for HAR

This game was designed to encourage young people not to gamble on lotteries, as the probablity of correctly guessing the number is infinitesimal!

Implementation for the paper SMPLicit: Topology-aware Generative Model for Clothed People (CVPR 2021)

Playable Video Generation

Contrastive Language-Image Pretraining

LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image.

Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training

learning and feeling SLAM together with hands-on-experiments

AMTML-KD: Adaptive Multi-teacher Multi-level Knowledge Distillation

Codebase for ECCV18 "The Sound of Pixels"

Code for the Population-Based Bandits Algorithm, presented at NeurIPS 2020.

AdvStyle - Official PyTorch Implementation

The implementation of DeBERTa

Connecting Java/ImgLib2 + Python/NumPy

Mahadi-Now - This Is Pakistani Just Now Login Tools

RefineGNN - Iterative refinement graph neural network for antibody sequence-structure co-design (RefineGNN)

A curated list of awesome Active Learning

Tracing Versus Freehand for Evaluating Computer-Generated Drawings (SIGGRAPH 2021)

Python-based Informatics Kit for Analysing Chemical Units