A Machine Teaching Framework for Scalable Recognition

Last update: Dec 08, 2021

Related tags

Overview

MEMORABLE

This repository contains the source code accompanying our ICCV 2021 paper.

A Machine Teaching Framework for Scalable Recognition
Pei Wang, Nuno Vasconcelos.
In ICCV, 2021.

@InProceedings{wang2021gradient,
author = {Wang, Pei and Vasconcelos, Nuno},
title = {A Machine Teaching Framework for Scalable Recognition},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2021}
}

Requirements

The project was implemented and tested in Python 3.5 and Pytorch 1.0. Other versions should work after minor modification.
NVIDIA GPU and cuDNN are required to have fast speeds. For now, CUDA 8.0 with cuDNN 6.0.20 has been tested. The other versions should be working.

Datasets

Butterflies and Chinese Characters, Gull are used. Please organize them as below after download,

datasets
|_ butterflies_crop
  |_ images
    |_ Viceroy
    |_ ...
|_ chinese_chars
  |_ images
    |_ grass
    |_ ...
|_ CUBgull
  |_ images
    |_ CaliforniaGull
    |_ ...

Implementation details

To generate counterfactual explanations

get_all_CE_butterflies.py
get_all_CE_gull.py

by SimCLR model

get_all_CE_butterflies_simclr.py
get_all_CE_gull_simclr.py

To generate teaching images and explanations

train_butterflies_CMaxGrad.py
train_gull_CMaxGrad.py

by SimCLR model

train_butterflies_CMaxGrad_simclr.py
train_gull_CMaxGrad_simclr.py

For the SimCLR, we used repo for training. Thanks for their open-source. For standard model, we trained by

train_butterflies_resnet18.py
train_gull_resnet18_linear.py

For questions, feel free to reach out

Pei Wang: [email protected]

A Machine Teaching Framework for Scalable Recognition

Related tags

Overview

MEMORABLE

Requirements

Datasets

Implementation details

To generate counterfactual explanations

To generate teaching images and explanations

Owner

Code for our NeurIPS 2021 paper 'Exploiting the Intrinsic Neighborhood Structure for Source-free Domain Adaptation'

Code for the paper Task Agnostic Morphology Evolution.

Fully Convolutional Refined Auto Encoding Generative Adversarial Networks for 3D Multi Object Scenes

Compressed Video Action Recognition

Adversarial Color Enhancement: Generating Unrestricted Adversarial Images by Optimizing a Color Filter

Calculates JMA (Japan Meteorological Agency) seismic intensity (shindo) scale from acceleration data recorded in NumPy array

The VeriNet toolkit for verification of neural networks

STRIVE: Scene Text Replacement In Videos

Interactive Terraform visualization. State and configuration explorer.

Repository for tackling Kaggle Ultrasound Nerve Segmentation challenge using Torchnet.

[2021][ICCV][FSNet] Full-Duplex Strategy for Video Object Segmentation

In this repo we reproduce and extend results of Learning in High Dimension Always Amounts to Extrapolation by Balestriero et al. 2021

Dynamics-aware Adversarial Attack of 3D Sparse Convolution Network

A framework that allows people to write their own Rocket League bots.

Monify: an Expense tracker Program implemented in a Graphical User Interface that allows users to keep track of their expenses

An Ensemble of CNN (Python 3.5.1 Tensorflow 1.3 numpy 1.13)

A simple Tensorflow based library for deep and/or denoising AutoEncoder.

Implementation of SETR model, Original paper: Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers.

Framework for joint representation learning, evaluation through multimodal registration and comparison with image translation based approaches

Pixel-Perfect Structure-from-Motion with Featuremetric Refinement (ICCV 2021, Oral)