Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Mae segmentation - Reproduction of semantic segmentation using masked autoencoder (mae)

Reusable constraint types to use with typing.Annotated

Code for the paper "Jukebox: A Generative Model for Music"

This solves the autonomous driving issue which is supported by deep learning technology. Given a video, it splits into images and predicts the angle of turning for each frame.

一套完整的微博舆情分析流程代码，包括微博爬虫、LDA主题分析和情感分析。

The Python ensemble sampling toolkit for affine-invariant MCMC

Filtering variational quantum algorithms for combinatorial optimization

Amazon Forest Computer Vision: Satellite Image tagging code using PyTorch / Keras with lots of PyTorch tricks

GPU-accelerated PyTorch implementation of Zero-shot User Intent Detection via Capsule Neural Networks

Iranian Cars Detection using Yolov5s, PyTorch

[CVPR 2022] Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels

MIMIC Code Repository: Code shared by the research community for the MIMIC-III database

Additional environments compatible with OpenAI gym

EDPN: Enhanced Deep Pyramid Network for Blurry Image Restoration

Code for Transformers Solve Limited Receptive Field for Monocular Depth Prediction

pytorch implementation of ABC : Auxiliary Balanced Classifier for Class-imbalanced Semi-supervised Learning

This is a Keras implementation of a CNN for estimating age, gender and mask from a camera.

Parris, the automated infrastructure setup tool for machine learning algorithms.

Clean Machine Learning, a Coding Kata

PyTorch implementation of U-TAE and PaPs for satellite image time series panoptic segmentation.