Efficient Training of Visual Transformers with Small Datasets

Last update: Dec 25, 2022

Related tags

Overview

Efficient Training of Visual Transformers with Small Datasets

To appear in NerIPS 2021.

[arXiv][code]
Yahui Liu^1,3, Enver Sangineto¹, Wei Bi², Nicu Sebe¹, Bruno Lepri³, Marco De Nadai³
¹University of Trento, Italy, ²Tencent AI Lab, China, ³Bruno Kessler Foundation, Italy.

Coming soon ...

Owner

Yahui Liu

Yahui Liu currently studies in Multimedia and Human Understanding Group (MHUG), University of Trento, Italy.

GitHub Repository

Dilated Convolution for Semantic Image Segmentation

Multi-Scale Context Aggregation by Dilated Convolutions Introduction Properties of dilated convolution are discussed in our ICLR 2016 conference paper

764 Dec 26, 2022

Classification of Long Sequential Data using Circular Dilated Convolutional Neural Networks

Classification of Long Sequential Data using Circular Dilated Convolutional Neural Networks arXiv preprint: https://arxiv.org/abs/2201.02143. Architec

19 Nov 30, 2022

Deep Dual Consecutive Network for Human Pose Estimation (CVPR2021)

Beanie - is an asynchronous ODM for MongoDB, based on Motor and Pydantic. It uses an abstraction over Pydantic models and Motor collections to work wi

295 Dec 29, 2022

Breaching - Breaching privacy in federated learning scenarios for vision and text

Breaching - A Framework for Attacks against Privacy in Federated Learning This P

139 Jan 03, 2023

AttGAN: Facial Attribute Editing by Only Changing What You Want (IEEE TIP 2019)

News 11 Jan 2020: We clean up the code to make it more readable! The old version is here: v1. AttGAN TIP Nov. 2019, arXiv Nov. 2017 TensorFlow impleme

568 Dec 14, 2022

基于PaddleClas实现垃圾分类，并转换为inference格式用PaddleHub服务端部署

百度网盘链接及提取码：链接：https://pan.baidu.com/s/1HKpgakNx1hNlOuZJuW6T1w 提取码：wylx 一个垃圾分类项目带你玩转飞桨多个产品（1）基于PaddleClas实现垃圾分类，导出inference模型并利用PaddleHub Serving进行服务

22 Jul 12, 2022

Python library for loading and using triangular meshes.

Trimesh is a pure Python (2.7-3.4+) library for loading and using triangular meshes with an emphasis on watertight surfaces. The goal of the library i

2.2k Jan 07, 2023

(CVPR2021) ClassSR: A General Framework to Accelerate Super-Resolution Networks by Data Characteristic

ClassSR (CVPR2021) ClassSR: A General Framework to Accelerate Super-Resolution Networks by Data Characteristic Paper Authors: Xiangtao Kong, Hengyuan

308 Jan 05, 2023

pytorch implementation for Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network arXiv:1609.04802

PyTorch SRResNet Implementation of Paper: "Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network"(https://arxiv.org/abs

436 Jan 09, 2023

Some toy examples of score matching algorithms written in PyTorch

toy_gradlogp This repo implements some toy examples of the following score matching algorithms in PyTorch: ssm-vr: sliced score matching with variance

21 Dec 26, 2022

New approach to benchmark VQA models

VQA Benchmarking This repository contains the web application & the python interface to evaluate VQA models. Documentation Please see the documentatio

4 Jul 25, 2022

Eye-Blink-Counter - Python based Computer Vision project which counts how many time a person blinks

Eye Blink Counter OpenCV and Mediapipe No Blink Blink

2 Mar 24, 2022

VQGAN+CLIP Colab Notebook with user-friendly interface.

VQGAN+CLIP and other image generation system VQGAN+CLIP Colab Notebook with user-friendly interface. Latest Notebook: Mse regulized zquantize Notebook

227 Jan 05, 2023

DeepConsensus uses gap-aware sequence transformers to correct errors in Pacific Biosciences (PacBio) Circular Consensus Sequencing (CCS) data.

DeepConsensus DeepConsensus uses gap-aware sequence transformers to correct errors in Pacific Biosciences (PacBio) Circular Consensus Sequencing (CCS)

149 Dec 19, 2022

Efficient Training of Visual Transformers with Small Datasets

Related tags

Overview

Efficient Training of Visual Transformers with Small Datasets

Owner

Yahui Liu

Dilated Convolution for Semantic Image Segmentation

Classification of Long Sequential Data using Circular Dilated Convolutional Neural Networks

Deep Dual Consecutive Network for Human Pose Estimation (CVPR2021)

Breaching - Breaching privacy in federated learning scenarios for vision and text

AttGAN: Facial Attribute Editing by Only Changing What You Want (IEEE TIP 2019)

基于PaddleClas实现垃圾分类，并转换为inference格式用PaddleHub服务端部署

Python library for loading and using triangular meshes.

(CVPR2021) ClassSR: A General Framework to Accelerate Super-Resolution Networks by Data Characteristic

pytorch implementation for Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network arXiv:1609.04802

Some toy examples of score matching algorithms written in PyTorch

New approach to benchmark VQA models

Eye-Blink-Counter - Python based Computer Vision project which counts how many time a person blinks

VQGAN+CLIP Colab Notebook with user-friendly interface.

DeepConsensus uses gap-aware sequence transformers to correct errors in Pacific Biosciences (PacBio) Circular Consensus Sequencing (CCS) data.

Autonomous Movement from Simultaneous Localization and Mapping

Like a cowsay but without cows!

A public available dataset for road boundary detection in aerial images

This is a repository for a semantic segmentation inference API using the OpenVINO toolkit

Human motion synthesis using Unity3D

Codebase for the self-supervised goal reaching benchmark introduced in the LEXA paper