AutoAugment - Learning Augmentation Policies from Data
Unofficial implementation of the ImageNet, CIFAR10 and SVHN Augmentation Policies learned by AutoAugment, described in this Google AI Blogpost.
Update July 13th, 2018: Wrote a Blogpost about AutoAugment and Double Transfer Learning.
Tested with Python 3.6. Needs pillow>=5.0.0
Example
from autoaugment import ImageNetPolicy
image = PIL.Image.open(path)
policy = ImageNetPolicy()
transformed = policy(image)
To see examples of all operations and magnitudes applied to images, take a look at AutoAugment_Exploration.ipynb.
Example as a PyTorch Transform - ImageNet
from autoaugment import ImageNetPolicy
data = ImageFolder(rootdir, transform=transforms.Compose(
[transforms.RandomResizedCrop(224),
transforms.RandomHorizontalFlip(), ImageNetPolicy(),
transforms.ToTensor(), transforms.Normalize(...)]))
loader = DataLoader(data, ...)
Example as a PyTorch Transform - CIFAR10
from autoaugment import CIFAR10Policy
data = ImageFolder(rootdir, transform=transforms.Compose(
[transforms.RandomCrop(32, padding=4, fill=128), # fill parameter needs torchvision installed from source
transforms.RandomHorizontalFlip(), CIFAR10Policy(),
transforms.ToTensor(),
Cutout(n_holes=1, length=16), # (https://github.com/uoguelph-mlrg/Cutout/blob/master/util/cutout.py)
transforms.Normalize(...)]))
loader = DataLoader(data, ...)
Example as a PyTorch Transform - SVHN
from autoaugment import SVHNPolicy
data = ImageFolder(rootdir, transform=transforms.Compose(
[SVHNPolicy(),
transforms.ToTensor(),
Cutout(n_holes=1, length=20), # (https://github.com/uoguelph-mlrg/Cutout/blob/master/util/cutout.py)
transforms.Normalize(...)]))
loader = DataLoader(data, ...)
Results with AutoAugment
Generalizable Data Augmentations
Finally, we show that policies found on one task can generalize well across different models and datasets. For example, the policy found on ImageNet leads to significant improvements on a variety of FGVC datasets. Even on datasets for which fine-tuning weights pre-trained on ImageNet does not help significantly [26], e.g. Stanford Cars [27] and FGVC Aircraft [28], training with the ImageNet policy reduces test set error by 1.16% and 1.76%, respectively. This result suggests that transferring data augmentation policies offers an alternative method for transfer learning.
CIFAR 10
CIFAR 100
ImageNet
SVHN
Fine Grained Visual Classification Datasets
51 Nov 23, 2022
1 Dec 18, 2021
465 Jan 05, 2023
6 Sep 10, 2022
229 Dec 13, 2022
39 Nov 30, 2022
554 Dec 30, 2022
58 Jan 01, 2023
11 Nov 19, 2022
16 Jul 20, 2022
7 Sep 23, 2022
4 Jan 17, 2022
43 Nov 08, 2022
212 Dec 27, 2022
3 Mar 01, 2022
1.7k Dec 30, 2022
41 Dec 12, 2022
15 Dec 27, 2022
64 Dec 24, 2022
244 Jan 06, 2023