Mae segmentation - Reproduction of semantic segmentation using masked autoencoder (mae)

Last update: Dec 17, 2022

Overview

ADE20k Semantic segmentation with MAE

Getting started

Install the mmsegmentation library and some required packages.

pip install mmcv-full==1.3.0 mmsegmentation==0.11.0
pip install scipy timm==0.3.2

Install apex for mixed-precision training

git clone https://github.com/NVIDIA/apex
cd apex
pip install -v --disable-pip-version-check --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./

Follow the guide in mmseg to prepare the ADE20k dataset.

Fine-tuning for Reproducing Results of MAE ViT-Base

Command:

tools/dist_train.sh configs/mae/upernet_mae_base_12_512_slide_160k_ade20k.py 8 --seed 0  --options model.pretrained=https://dl.fbaipublicfiles.com/mae/pretrain/mae_pretrain_vit_base.pth

Expected results log(paper results: 48.1 mIoU):

+--------+-------+-------+-------+
| Scope  | mIoU  | mAcc  | aAcc  |
+--------+-------+-------+-------+
| global | 48.15 | 58.99 | 83.05 |
+--------+-------+-------+-------+

Evaluation

Command format:

tools/dist_test.sh  <CONFIG_PATH> <CHECKPOINT_PATH> <NUM_GPUS> --eval mIoU

Acknowledgment

This code is built using the mmsegmentation library, Timm library, the Swin repository, XCiT, SETR, BEiT and the MAE repository.

Mae segmentation - Reproduction of semantic segmentation using masked autoencoder (mae)

Related tags

Overview

ADE20k Semantic segmentation with MAE

Getting started

Fine-tuning for Reproducing Results of MAE ViT-Base

Evaluation

Acknowledgment

Owner

Graph-Refined Convolutional Network for Multimedia Recommendation with Implicit Feedback

PyTorch code for our ECCV 2018 paper "Image Super-Resolution Using Very Deep Residual Channel Attention Networks"

quantize aware training package for NCNN on pytorch

Hysterese plugin with two temperature offset areas

This program creates a formatted excel file which highlights the undervalued stock according to Graham's number.

Instant Real-Time Example-Based Style Transfer to Facial Videos

A multi-entity Transformer for multi-agent spatiotemporal modeling.

Torchlight2 lan game server tool - A message forwarding tool for Torchlight 2 lan game

UMPNet: Universal Manipulation Policy Network for Articulated Objects

Supervised Sliding Window Smoothing Loss Function Based on MS-TCN for Video Segmentation

Randomizes the warps in a stock pokeemerald repo.

A Deep Learning Framework for Neural Derivative Hedging

Solution to the Weather4cast 2021 challenge

Official PyTorch Implementation of "AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecasting".

Replication of Pix2Seq with Pretrained Model

DETReg: Unsupervised Pretraining with Region Priors for Object Detection

RoBERTa Marathi Language model trained from scratch during huggingface 🤗 x flax community week

Random-Afg - Afghanistan Random Old Idz Cloner Tools

A method to perform unsupervised cross-region adaptation of crop classifiers trained with satellite image time series.

Official code of paper "PGT: A Progressive Method for Training Models on Long Videos" on CVPR2021