awesome-MIM

Reading list for research topics in Masked Image Modeling(MIM).

We list the most popular methods for MIM, if I missed something, please submit a request. (Note: We show the date of the first version of Arxiv here. But the link of paper may be not the early version.)

Self-supervied Vision Transformers as backbone models.

Date	Method	Conference	Title	Code
2021-06-14	BeiT	ICLR 2022(Oral)	BEiT: BERT Pre-Training of Image Transformers	BeiT
2021-11-11	MAE	Arxiv 2021	Masked Autoencoders Are Scalable Vision Learners	MAE
2021-11-15	iBoT	Arxiv 2021	iBOT: Image BERT Pre-Training with Online Tokenizer	iBoT
2021-11-18	SimMIM	Arxiv 2021	SimMIM: A Simple Framework for Masked Image Modeling	SimMIM
2021-12-16	MaskFeat	Arxiv 2021	Masked Feature Prediction for Self-Supervised Visual Pre-Training	None
2021-12-20	SplitMask	Arxiv 2021	Are Large-scale Datasets Necessary for Self-Supervised Pre-training?	None
2022-01-31	ADIOS	Arxiv 2022	Adversarial Masking for Self-Supervised Learning	None
2022-02-07	CAE	Arxiv 2022	Context Autoencoder for Self-Supervised Representation Learning	None
2022-02-07	CIM	Arxiv 2022	Corrupted Image Modeling for Self-Supervised Visual Pre-Training	None

Reading list for research topics in Masked Image Modeling

Related tags

Overview

awesome-MIM

Self-supervied Vision Transformers as backbone models.

Owner

ligang

Making self-supervised learning work on molecules by using their 3D geometry to pre-train GNNs. Implemented in DGL and Pytorch Geometric.

Flower classification model that classifies flowers in 10 classes made using transfer learning (~85% accuracy).

Automate issue discovery for your projects against Lightning nightly and releases.

A repository built on the Flow software package to explore cyber-security attacks on intelligent transportation systems.

Project NII pytorch scripts

Code for "Causal autoregressive flows" - AISTATS, 2021

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

A PyTorch implementation of PointRend: Image Segmentation as Rendering

Official PyTorch implementation of "VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization" (CVPR 2021)

An Ensemble of CNN (Python 3.5.1 Tensorflow 1.3 numpy 1.13)

Opinionated code formatter, just like Python's black code formatter but for Beancount

Implementation of our paper "Video Playback Rate Perception for Self-supervised Spatio-Temporal Representation Learning".

GT4SD, an open-source library to accelerate hypothesis generation in the scientific discovery process.

BlueFog Tutorials

Efficient Training of Audio Transformers with Patchout

CR-FIQA: Face Image Quality Assessment by Learning Sample Relative Classifiability

DeepOBS: A Deep Learning Optimizer Benchmark Suite

Imaging, analysis, and simulation software for radio interferometry

Scripts and a shader to get you started on setting up an exported Koikatsu character in Blender.

The official PyTorch code implementation of "Human Trajectory Prediction via Counterfactual Analysis" in ICCV 2021.