A Machine Teaching Framework for Scalable Recognition

Last update: Dec 08, 2021

Related tags

Overview

MEMORABLE

This repository contains the source code accompanying our ICCV 2021 paper.

A Machine Teaching Framework for Scalable Recognition
Pei Wang, Nuno Vasconcelos.
In ICCV, 2021.

@InProceedings{wang2021gradient,
author = {Wang, Pei and Vasconcelos, Nuno},
title = {A Machine Teaching Framework for Scalable Recognition},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2021}
}

Requirements

The project was implemented and tested in Python 3.5 and Pytorch 1.0. Other versions should work after minor modification.
NVIDIA GPU and cuDNN are required to have fast speeds. For now, CUDA 8.0 with cuDNN 6.0.20 has been tested. The other versions should be working.

Datasets

Butterflies and Chinese Characters, Gull are used. Please organize them as below after download,

datasets
|_ butterflies_crop
  |_ images
    |_ Viceroy
    |_ ...
|_ chinese_chars
  |_ images
    |_ grass
    |_ ...
|_ CUBgull
  |_ images
    |_ CaliforniaGull
    |_ ...

Implementation details

To generate counterfactual explanations

get_all_CE_butterflies.py
get_all_CE_gull.py

by SimCLR model

get_all_CE_butterflies_simclr.py
get_all_CE_gull_simclr.py

To generate teaching images and explanations

train_butterflies_CMaxGrad.py
train_gull_CMaxGrad.py

by SimCLR model

train_butterflies_CMaxGrad_simclr.py
train_gull_CMaxGrad_simclr.py

For the SimCLR, we used repo for training. Thanks for their open-source. For standard model, we trained by

train_butterflies_resnet18.py
train_gull_resnet18_linear.py

For questions, feel free to reach out

Pei Wang: [email protected]

A Machine Teaching Framework for Scalable Recognition

Related tags

Overview

MEMORABLE

Requirements

Datasets

Implementation details

To generate counterfactual explanations

To generate teaching images and explanations

Owner

Code to replicate the key results from Exploring the Limits of Out-of-Distribution Detection

Collect some papers about transformer with vision. Awesome Transformer with Computer Vision (CV)

GBIM(Gesture-Based Interaction map)

CityLearn Challenge Multi-Agent Reinforcement Learning for Intelligent Energy Management, 2020, PikaPika team

Source code and data in paper "MDFEND: Multi-domain Fake News Detection (CIKM'21)"

MatchGAN: A Self-supervised Semi-supervised Conditional Generative Adversarial Network

Official implementation of "Membership Inference Attacks Against Self-supervised Speech Models"

EdMIPS: Rethinking Differentiable Search for Mixed-Precision Neural Networks

EfficientNetv2 TensorRT int8

FactSeg: Foreground Activation Driven Small Object Semantic Segmentation in Large-Scale Remote Sensing Imagery (TGRS)

Some useful blender add-ons for SMPL skeleton's poses and global translation.

Example of a Quantum LSTM

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Implement some metaheuristics and cost functions

v objective diffusion inference code for PyTorch.

An example of Scatterbrain implementation (combining local attention and Performer)

An implementation of Deep Graph Infomax (DGI) in PyTorch

Fast Soft Color Segmentation

A pytorch reprelication of the model-based reinforcement learning algorithm MBPO

This is the pytorch re-implementation of the IterNorm