Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Out-of-distribution detection using the pNML regret. NeurIPS2021

[NeurIPS 2021] PyTorch Code for Accelerating Robotic Reinforcement Learning with Parameterized Action Primitives

Improving Calibration for Long-Tailed Recognition (CVPR2021)

AdaMML: Adaptive Multi-Modal Learning for Efficient Video Recognition

Official code for ICCV2021 paper "M3D-VTON: A Monocular-to-3D Virtual Try-on Network"

SlotRefine: A Fast Non-Autoregressive Model forJoint Intent Detection and Slot Filling

CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

Source code for paper "ATP: AMRize Than Parse! Enhancing AMR Parsing with PseudoAMRs" @NAACL-2022

HNECV: Heterogeneous Network Embedding via Cloud model and Variational inference

An implementation of an abstract algebra for music tones (pitches).

The repository contains reproducible PyTorch source code of our paper Generative Modeling with Optimal Transport Maps, ICLR 2022.

How to Train a GAN? Tips and tricks to make GANs work

Code for Domain Adaptive Video Segmentation via Temporal Consistency Regularization in ICCV 2021

PyTorch experiments with the Zalando fashion-mnist dataset

A pytorch-version implementation codes of paper: "BSN++: Complementary Boundary Regressor with Scale-Balanced Relation Modeling for Temporal Action Proposal Generation"

A 3D sparse LBM solver implemented using Taichi

Revisiting Oxford and Paris: Large-Scale Image Retrieval Benchmarking

EfficientNetV2-with-TPU - Cifar-10 case study

MAUS: A Dataset for Mental Workload Assessment Using Wearable Sensor - Baseline system

Jetson Nano-based smart camera system that measures crowd face mask usage in real-time.