Efficient Training of Visual Transformers with Small Datasets

Last update: Dec 25, 2022

Related tags

Overview

Efficient Training of Visual Transformers with Small Datasets

To appear in NerIPS 2021.

[arXiv][code]
Yahui Liu^1,3, Enver Sangineto¹, Wei Bi², Nicu Sebe¹, Bruno Lepri³, Marco De Nadai³
¹University of Trento, Italy, ²Tencent AI Lab, China, ³Bruno Kessler Foundation, Italy.

Coming soon ...

Owner

Yahui Liu

Yahui Liu currently studies in Multimedia and Human Understanding Group (MHUG), University of Trento, Italy.

GitHub Repository

MonoRec: Semi-Supervised Dense Reconstruction in Dynamic Environments from a Single Moving Camera

494 Jan 06, 2023

A novel framework to automatically learn high-quality scanning of non-planar, complex anisotropic appearance.

appearance-scanner About This repository is an implementation of the neural network proposed in Free-form Scanning of Non-planar Appearance with Neura

14 Oct 18, 2022

Simple Python application to transform Serial data into OSC messages

SerialToOSC-Bridge Simple Python application to transform Serial data into OSC messages. The current purpose is to be a compatibility layer between ha

3 Jun 03, 2021

😇A pyTorch implementation of the DeepMoji model: state-of-the-art deep learning model for analyzing sentiment, emotion, sarcasm etc

------ Update September 2018 ------ It's been a year since TorchMoji and DeepMoji were released. We're trying to understand how it's being used such t

865 Dec 24, 2022

A python library to artfully visualize Factorio Blueprints and an interactive web demo for using it.

Factorio Blueprint Visualizer I love the game Factorio and I really like the look of factories after growing for many hours or blueprints after tweaki

124 Jan 07, 2023

Mask-invariant Face Recognition through Template-level Knowledge Distillation

Mask-invariant Face Recognition through Template-level Knowledge Distillation This is the official repository of "Mask-invariant Face Recognition thro

35 Dec 06, 2022

Grad2Task: Improved Few-shot Text Classification Using Gradients for Task Representation

Grad2Task: Improved Few-shot Text Classification Using Gradients for Task Representation Prerequisites This repo is built upon a local copy of transfo

10 Sep 28, 2022

Leaf: Multiple-Choice Question Generation

Leaf: Multiple-Choice Question Generation Easy to use and understand multiple-choice question generation algorithm using T5 Transformers. The applicat

62 Dec 20, 2022

Code for the paper "Improved Techniques for Training GANs"

Status: Archive (code is provided as-is, no updates expected) improved-gan code for the paper "Improved Techniques for Training GANs" MNIST, SVHN, CIF

2.2k Jan 01, 2023

Colar: Effective and Efficient Online Action Detection by Consulting Exemplars, CVPR 2022.

Colar: Effective and Efficient Online Action Detection by Consulting Exemplars This repository is the official implementation of Colar. In this work,

246 Dec 13, 2022

Simple STAC Catalogs discovery tool.

STAC Catalog Discovery Simple STAC discovery tool. Just paste the STAC Catalog link and press Enter. Details STAC Discovery tool enables discovering d

21 Oct 19, 2022

Code for the paper "Regularizing Variational Autoencoder with Diversity and Uncertainty Awareness"

DU-VAE This is the pytorch implementation of the paper "Regularizing Variational Autoencoder with Diversity and Uncertainty Awareness" Acknowledgement

4 Oct 19, 2022

Links to works on deep learning algorithms for physics problems, TUM-I15 and beyond

1.3k Jan 08, 2023

Fully Convolutional DenseNet (A.K.A 100 layer tiramisu) for semantic segmentation of images implemented in TensorFlow.

FC-DenseNet-Tensorflow This is a re-implementation of the 100 layer tiramisu, technically a fully convolutional DenseNet, in TensorFlow (Tiramisu). Th

121 Oct 12, 2022

Predicting path with preference based on user demonstration using Maximum Entropy Deep Inverse Reinforcement Learning in a continuous environment

Preference-Planning-Deep-IRL Introduction Check my portfolio post Dependencies Gym stable-baselines3 PyTorch Usage Take Demonstration python3 record.

9 Oct 26, 2022

Efficient Training of Visual Transformers with Small Datasets

Related tags

Overview

Efficient Training of Visual Transformers with Small Datasets

Owner

Yahui Liu

MonoRec: Semi-Supervised Dense Reconstruction in Dynamic Environments from a Single Moving Camera

A novel framework to automatically learn high-quality scanning of non-planar, complex anisotropic appearance.

Simple Python application to transform Serial data into OSC messages

😇A pyTorch implementation of the DeepMoji model: state-of-the-art deep learning model for analyzing sentiment, emotion, sarcasm etc

A python library to artfully visualize Factorio Blueprints and an interactive web demo for using it.

Mask-invariant Face Recognition through Template-level Knowledge Distillation

Grad2Task: Improved Few-shot Text Classification Using Gradients for Task Representation

Leaf: Multiple-Choice Question Generation

Code for the paper "Improved Techniques for Training GANs"

Colar: Effective and Efficient Online Action Detection by Consulting Exemplars, CVPR 2022.

Simple STAC Catalogs discovery tool.

Code for the paper "Regularizing Variational Autoencoder with Diversity and Uncertainty Awareness"

Links to works on deep learning algorithms for physics problems, TUM-I15 and beyond

Fully Convolutional DenseNet (A.K.A 100 layer tiramisu) for semantic segmentation of images implemented in TensorFlow.

Predicting path with preference based on user demonstration using Maximum Entropy Deep Inverse Reinforcement Learning in a continuous environment

Algo-burn - Script to configure an Algorand address as a "burn" address for one or more ASA tokens

Multi-modal Text Recognition Networks: Interactive Enhancements between Visual and Semantic Features

A Python-based development platform for automated trading systems - from backtesting to optimisation to livetrading.

Pytorch implementation of SimSiam Architecture

Code of paper "CDFI: Compression-Driven Network Design for Frame Interpolation", CVPR 2021