Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Densely Connected Convolutional Networks, In CVPR 2017 (Best Paper Award).

Unadversarial Examples: Designing Objects for Robust Vision

Hierarchical Clustering: O(1)-Approximation for Well-Clustered Graphs

ANN model for prediction a spatio-temporal distribution of supercooled liquid in mixed-phase clouds using Doppler cloud radar spectra.

RITA is a family of autoregressive protein models, developed by LightOn in collaboration with the OATML group at Oxford and the Debora Marks Lab at Harvard.

The code of paper 'Learning to Aggregate and Personalize 3D Face from In-the-Wild Photo Collection'

A simple image/video to Desmos graph converter run locally

This repository contains the implementation of the paper Contrastive Instance Association for 4D Panoptic Segmentation using Sequences of 3D LiDAR Scans

A fast and easy to use, moddable, Python based Minecraft server!

Multilingual Image Captioning

Apache Flink

Using OpenAI's CLIP to upscale and enhance images

Recommendationsystem - Movie-recommendation - matrixfactorization colloborative filtering recommendation system user

This is an official pytorch implementation of Lite-HRNet: A Lightweight High-Resolution Network.

More than a hundred strange attractors

PyTorch implementation of Densely Connected Time Delay Neural Network

Computer-Vision-Paper-Reviews - Computer Vision Paper Reviews with Key Summary along Papers & Codes

Multi-Content GAN for Few-Shot Font Style Transfer at CVPR 2018

Codes for building and training the neural network model described in Domain-informed neural networks for interaction localization within astroparticle experiments.

A self-supervised 3D representation learning framework named viewpoint bottleneck.