Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Implementation of Bidirectional Recurrent Independent Mechanisms (Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modules)

Driller: augmenting AFL with symbolic execution!

Code for paper " AdderNet: Do We Really Need Multiplications in Deep Learning?"

Exemplo de implementação do padrão circuit breaker em python

Convenient tool for speeding up the intern/officer review process.

Image-popularity-score - A novel deep regression method for image scoring.

PhysCap: Physically Plausible Monocular 3D Motion Capture in Real Time

toroidal - a lightweight transformer library for PyTorch

Generative Query Network (GQN) in PyTorch as described in "Neural Scene Representation and Rendering"

The InterScript dataset contains interactive user feedback on scripts generated by a T5-XXL model.

Official PyTorch implementation of "Contrastive Learning from Extremely Augmented Skeleton Sequences for Self-supervised Action Recognition" in AAAI2022.

[CVPR 2021] Generative Hierarchical Features from Synthesizing Images

Code for "Learning to Regrasp by Learning to Place"

Code for our SIGCOMM'21 paper "Network Planning with Deep Reinforcement Learning".

Code & Models for 3DETR - an End-to-end transformer model for 3D object detection

4K videos with annotated masks in our ICCV2021 paper 'Internal Video Inpainting by Implicit Long-range Propagation'.

A full-fledged version of Pix2Seq

Deep Learning segmentation suite designed for 2D microscopy image segmentation

AgML is a comprehensive library for agricultural machine learning

Subgraph Based Learning of Contextual Embedding