Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

PSPNet in Chainer

The tl;dr on a few notable transformer/language model papers + other papers (alignment, memorization, etc).

Bachelor's Thesis in Computer Science: Privacy-Preserving Federated Learning Applied to Decentralized Data

Bringing Characters to Life with Computer Brains in Unity

This is implementation of AlexNet(2012) with 3D Convolution on TensorFlow (AlexNet 3D).

PyTorch implementation of Neural Combinatorial Optimization with Reinforcement Learning.

DeepAL: Deep Active Learning in Python

Fast Differentiable Matrix Sqrt Root

Koç University deep learning framework.

General Multi-label Image Classification with Transformers

On-device speech-to-intent engine powered by deep learning

Rewrite ultralytics/yolov5 v6.0 opencv inference code based on numpy, no need to rely on pytorch

NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework

Linear image-to-image translation

Face recognition with trained classifiers for detecting objects using OpenCV

A Python reference implementation of the CF data model

Pretrained Pytorch face detection (MTCNN) and recognition (InceptionResnet) models

DeepLab2: A TensorFlow Library for Deep Labeling

Pipeline code for Sequential-GAM(Genome Architecture Mapping).

A Dying Light 2 (DL2) PAKFile Utility for Modders and Mod Makers.