Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

End-to-end Temporal Action Detection with Transformer. [Under review]

Code for binary and multiclass model change active learning, with spectral truncation implementation.

Generative vs Discriminative: Rethinking The Meta-Continual Learning (NeurIPS 2021)

Official pytorch implementation of Active Learning for deep object detection via probabilistic modeling (ICCV 2021)

DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification

WRENCH: Weak supeRvision bENCHmark

NOD: Taking a Closer Look at Detection under Extreme Low-Light Conditions with Night Object Detection Dataset

Investigating automatic navigation towards standard US views integrating MARL with the virtual US environment developed in CT2US simulation

SSPNet: Scale Selection Pyramid Network for Tiny Person Detection from UAV Images.

Codes for AAAI 2022 paper: Context-aware Health Event Prediction via Transition Functions on Dynamic Disease Graphs

PyTorch implementation for "Sharpness-aware Quantization for Deep Neural Networks".

This repository contains implementations of all Machine Learning Algorithms from scratch in Python. Mathematics required for ML and many projects have also been included.

A distributed, plug-n-play algorithm for multi-robot applications with a priori non-computable objective functions

Self-Supervised Speech Pre-training and Representation Learning Toolkit.

[NeurIPS 2021] Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Training

NeWT: Natural World Tasks

The authors' implementation of Unsupervised Adversarial Learning of 3D Human Pose from 2D Joint Locations

Deep Residual Networks with 1K Layers

A curated list of the latest breakthroughs in AI (in 2021) by release date with a clear video explanation, link to a more in-depth article, and code.

Fortuitous Forgetting in Connectionist Networks