RVT: Robust Vision Transformers
This repository contains PyTorch code for Robust Vision Transformers.
For details see Rethinking the Design Principles of Robust Vision Transformer by Xiaofeng Mao, Gege Qi, Yuefeng Chen, Yuan He and Hui Xue.
Usage
First, clone the repository locally:
git clone https://github.com/vtddggg/Robust-Vision-Transformer.git
Then, install PyTorch 1.7.0+ and torchvision 0.8.1+ and pytorch-image-models 0.3.2:
conda install -c pytorch pytorch torchvision
pip install timm==0.3.2
We use 4 nodes with 8 gpus to train RVT-Ti, RVT-S and RVT-B:
Training RVT-Ti
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_tiny --data-path /path/to/imagenet --output_dir output --dist-eval
Training RVT-S
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_small --data-path /path/to/imagenet --output_dir output --dist-eval
Training RVT-B
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_base --data-path /path/to/imagenet --output_dir output --batch-size 32 --dist-eval
If you want to train RVT-Ti*, RVT-S* or RVT-B*, simply add --use_mask and --use_patch_aug to enable positon-aware attention scaling and patch-wise augmentation.
19 Aug 07, 2022
75 Dec 16, 2022
16 Nov 09, 2022
975 Dec 30, 2022
2 Nov 07, 2022
267 Dec 23, 2022
101 Dec 13, 2022
130 Dec 02, 2022
16 Sep 27, 2022
792 Dec 28, 2022
7.6k Jan 09, 2023
27 Dec 18, 2022
1 Jun 02, 2022
72 Nov 10, 2022
8 Nov 20, 2022
334 Dec 31, 2022
152 Dec 31, 2022
1.1k Dec 10, 2022
100 Dec 19, 2022
5 Oct 26, 2022