Differentiable Annealed Importance Sampling (DAIS)

This repository contains the code to reproduce the DAIS results from the paper Differentiable Annealed Importance Sampling and the Perils of Gradient Noise.

Bayesian Linear Regression

Please first install JAX (https://github.com/google/jax), then reproduce our results by running the following:

python blr/dais.py --gamma 0.0
python blr/dais.py --gamma 0.9
python blr.dais.py --bsize 100

Variational Autoencoder

Please first install PyTorch (https://pytorch.org/).

For training, one example command for DAIS with $K = 10$ and $S = 5$ (to adapt annealing scheme, add --adapt_beta):

python vae/mnist_train.py --lf_step 10 --n_particles 5 --lf_lrate 0.08

After training, you can find the saved checkpoint and evaluate it (e.g., using AIS):

python vae/mnist_eval.py --ais --n_particles 10 --lf_step 10000 --lf_lrate 0.05 --resume xxx

Also, you can reproduce the evaulation results of AIS/HAIS/DAIS by runing vae/mnist_eval_scaling.py:

python vae/mnist_eval_scaling.py --linear_beta --lf_lrate 0.08 --n_particles 10 --resume xxx

Citation

To cite this work, please use

@inproceedings{
	zhang2021differentiable,
	title={Differentiable Annealed Importance Sampling and the Perils of Gradient Noise},
	author={Guodong Zhang and Kyle Hsu and Jianing Li and Chelsea Finn and Roger Baker Grosse},
	booktitle={Thirty-Fifth Conference on Neural Information Processing Systems},
	year={2021},
	url={https://openreview.net/forum?id=6rqjgrL7Lq}
}

Differentiable Annealed Importance Sampling (DAIS)

Related tags

Overview

Differentiable Annealed Importance Sampling (DAIS)

Bayesian Linear Regression

Variational Autoencoder

Citation

Owner

Guodong Zhang

PAIRED in PyTorch 🔥

Repo for the ACMMM20 submission: "Personalized breath based biometric authentication with wearable multimodality".

PyTorch implementation of UPFlow (unsupervised optical flow learning)

Simulate genealogical trees and genomic sequence data using population genetic models

Adaptive Pyramid Context Network for Semantic Segmentation (APCNet CVPR'2019)

MRI reconstruction (e.g., QSM) using deep learning methods

UMich 500-Level Mobile Robotics Course

The toolkit to generate auto labeled datasets

A Self-Supervised Contrastive Learning Framework for Aspect Detection

Explanatory Learning: Beyond Empiricism in Neural Networks

Prevent `CUDA error: out of memory` in just 1 line of code.

Hcaptcha-challenger - Gracefully face hCaptcha challenge with Yolov5(ONNX) embedded solution

A face dataset generator with out-of-focus blur detection and dynamic interval adjustment.

An implementation of "MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixing" (ICML 2019).

A Data Annotation Tool for Semantic Segmentation, Object Detection and Lane Line Detection.(In Development Stage)

Detecting Potentially Harmful and Protective Suicide-related Content on Twitter

Official PyTorch implementation for paper "Efficient Two-Stage Detection of Human–Object Interactions with a Novel Unary–Pairwise Transformer"

Equivariant layers for RC-complement symmetry in DNA sequence data

Backend code to use MCPI's python API to make infinite worlds with custom generation

PoseViz – Multi-person, multi-camera 3D human pose visualization tool built using Mayavi.