Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

NAS-FCOS: Fast Neural Architecture Search for Object Detection (CVPR 2020)

An excellent hash algorithm combining classical sponge structure and RNN.

PFENet: Prior Guided Feature Enrichment Network for Few-shot Segmentation (TPAMI).

Time should be taken seer-iously

Block Sparse movement pruning

Toolchain to build Yoshi's Island from source code

Fortuitous Forgetting in Connectionist Networks

This repository provides an unified frameworks to train and test the state-of-the-art few-shot font generation (FFG) models.

GPU Accelerated Non-rigid ICP for surface registration

Repository for publicly available deep learning models developed in Rosetta community

Event sourced bank - A wide-and-shallow example using the Python event sourcing library

Official implementation of MSR-GCN (ICCV 2021 paper)

Codes for AAAI 2022 paper: Context-aware Health Event Prediction via Transition Functions on Dynamic Disease Graphs

This porject is intented to build the most accurate model for predicting the porbability of loan default

This repo is about to create the Streamlit application for given ML model.

Learning Correspondence from the Cycle-consistency of Time (CVPR 2019)

Automatic meme generation model using Tensorflow Keras.

STEM: An approach to Multi-source Domain Adaptation with Guarantees

Code for "Reconstructing 3D Human Pose by Watching Humans in the Mirror", CVPR 2021 oral

Unofficial implementation of "TTNet: Real-time temporal and spatial video analysis of table tennis" (CVPR 2020)