awesome-MIM

Reading list for research topics in Masked Image Modeling(MIM).

We list the most popular methods for MIM, if I missed something, please submit a request. (Note: We show the date of the first version of Arxiv here. But the link of paper may be not the early version.)

Self-supervied Vision Transformers as backbone models.

Date	Method	Conference	Title	Code
2021-06-14	BeiT	ICLR 2022(Oral)	BEiT: BERT Pre-Training of Image Transformers	BeiT
2021-11-11	MAE	Arxiv 2021	Masked Autoencoders Are Scalable Vision Learners	MAE
2021-11-15	iBoT	Arxiv 2021	iBOT: Image BERT Pre-Training with Online Tokenizer	iBoT
2021-11-18	SimMIM	Arxiv 2021	SimMIM: A Simple Framework for Masked Image Modeling	SimMIM
2021-12-16	MaskFeat	Arxiv 2021	Masked Feature Prediction for Self-Supervised Visual Pre-Training	None
2021-12-20	SplitMask	Arxiv 2021	Are Large-scale Datasets Necessary for Self-Supervised Pre-training?	None
2022-01-31	ADIOS	Arxiv 2022	Adversarial Masking for Self-Supervised Learning	None
2022-02-07	CAE	Arxiv 2022	Context Autoencoder for Self-Supervised Representation Learning	None
2022-02-07	CIM	Arxiv 2022	Corrupted Image Modeling for Self-Supervised Visual Pre-Training	None

Reading list for research topics in Masked Image Modeling

Related tags

Overview

awesome-MIM

Self-supervied Vision Transformers as backbone models.

Owner

ligang

Pytorch Implementation of DiffSinger: Diffusion Acoustic Model for Singing Voice Synthesis (TTS Extension)

TensorFlow implementation of "A Simple Baseline for Bayesian Uncertainty in Deep Learning"

Train a state-of-the-art yolov3 object detector from scratch!

Foreground-Action Consistency Network for Weakly Supervised Temporal Action Localization

A curated (most recent) list of resources for Learning with Noisy Labels

Unofficial implementation of the Involution operation from CVPR 2021

Information Gain Filtration (IGF) is a method for filtering domain-specific data during language model finetuning. IGF shows significant improvements over baseline fine-tuning without data filtration.

Faster RCNN with PyTorch

Pytorch implementation of the paper: "A Unified Framework for Separating Superimposed Images", in CVPR 2020.

Constructing interpretable quadratic accuracy predictors to serve as an objective function for an IQCQP problem that represents NAS under latency constraints and solve it with efficient algorithms.

PyTorch Implementation of Google Brain's WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesis

A Library for Modelling Probabilistic Hierarchical Graphical Models in PyTorch

Official implementation of our neural-network-based fast diffuse room impulse response generator (FAST-RIR)

People Interaction Graph

Hough Transform and Hough Line Transform Using OpenCV

🎓Automatically Update CV Papers Daily using Github Actions (Update at 12:00 UTC Every Day)

Deep Learning Based EDM Subgenre Classification using Mel-Spectrogram and Tempogram Features"

Simultaneous Detection and Segmentation

A modular application for performing anomaly detection in networks

OpenMMLab Pose Estimation Toolbox and Benchmark.