A Machine Teaching Framework for Scalable Recognition

Last update: Dec 08, 2021

Related tags

Overview

MEMORABLE

This repository contains the source code accompanying our ICCV 2021 paper.

A Machine Teaching Framework for Scalable Recognition
Pei Wang, Nuno Vasconcelos.
In ICCV, 2021.

@InProceedings{wang2021gradient,
author = {Wang, Pei and Vasconcelos, Nuno},
title = {A Machine Teaching Framework for Scalable Recognition},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2021}
}

Requirements

The project was implemented and tested in Python 3.5 and Pytorch 1.0. Other versions should work after minor modification.
NVIDIA GPU and cuDNN are required to have fast speeds. For now, CUDA 8.0 with cuDNN 6.0.20 has been tested. The other versions should be working.

Datasets

Butterflies and Chinese Characters, Gull are used. Please organize them as below after download,

datasets
|_ butterflies_crop
  |_ images
    |_ Viceroy
    |_ ...
|_ chinese_chars
  |_ images
    |_ grass
    |_ ...
|_ CUBgull
  |_ images
    |_ CaliforniaGull
    |_ ...

Implementation details

To generate counterfactual explanations

get_all_CE_butterflies.py
get_all_CE_gull.py

by SimCLR model

get_all_CE_butterflies_simclr.py
get_all_CE_gull_simclr.py

To generate teaching images and explanations

train_butterflies_CMaxGrad.py
train_gull_CMaxGrad.py

by SimCLR model

train_butterflies_CMaxGrad_simclr.py
train_gull_CMaxGrad_simclr.py

For the SimCLR, we used repo for training. Thanks for their open-source. For standard model, we trained by

train_butterflies_resnet18.py
train_gull_resnet18_linear.py

For questions, feel free to reach out

Pei Wang: [email protected]

A Machine Teaching Framework for Scalable Recognition

Related tags

Overview

MEMORABLE

Requirements

Datasets

Implementation details

To generate counterfactual explanations

To generate teaching images and explanations

Owner

Facestar dataset. High quality audio-visual recordings of human conversational speech.

CSKG is a commonsense knowledge graph that combines seven popular sources into a consolidated representation

Cleaned test data list of DukeMTMC-reID, ICCV2021

PyTorch implementation of U-TAE and PaPs for satellite image time series panoptic segmentation.

A geometric deep learning pipeline for predicting protein interface contacts.

Auto HMM: Automatic Discrete and Continous HMM including Model selection

Yolo object detection - Yolo object detection with python

Code repository of the paper Neural circuit policies enabling auditable autonomy published in Nature Machine Intelligence

Contra is a lightweight, production ready Tensorflow alternative for solving time series prediction challenges with AI

A little Python application to auto tag your photos with the power of machine learning.

Physics-informed Neural Operator for Learning Partial Differential Equation

PyTorch implementations of neural network models for keyword spotting

一个多模态内容理解算法框架，其中包含数据处理、预训练模型、常见模型以及模型加速等模块。

Multispectral Object Detection with Yolov5

This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".

AI-UPV at IberLEF-2021 DETOXIS task: Toxicity Detection in Immigration-Related Web News Comments Using Transformers and Statistical Models

PyTorch implementation for SDEdit: Image Synthesis and Editing with Stochastic Differential Equations

Demo for the paper "Overlap-aware low-latency online speaker diarization based on end-to-end local segmentation"

Code for CMaskTrack R-CNN (proposed in Occluded Video Instance Segmentation)

Papers about explainability of GNNs