Jacobian-Free Backprop

Associated Publication

JFB: Jacobian-Free Backpropagation for Implicit Models (arXiv Link)

@article{WuFung2022JFB,
    title={JFB: Jacobian-Free Backpropagation for Implicit Models},
    author={Fung, Samy Wu and Heaton, Howard and Li, Qiuwei and McKenzie, Daniel and Osher, Stanley and Yin, Wotao},
    journal={Proceedings of the AAAI Conference on Artificial Intelligence},
    year={2022}
}

Set-up

Install all the requirements:

pip install -r requirements.txt

Training

For each dataset, there are three types of training drivers:

FPN with our proposed backprop:

	python train_CIFAR10.py
	python train_CIFAR10_Unaugmented.py
	python train_MNIST.py
	python train_SVHN.py

FPN with Jacobian-based backprop:

	python train_CIFAR10_Jacobian_Based.py
	python train_CIFAR10_Unaugmented_Jacobian_Based.py
	python train_MNIST_Jacobian_Based.py
	python train_SVHN_Jacobian_Based.py

Explicit models.

	python train_CIFAR10_Explicit.py
	python train_CIFAR10_Unaugmented_Explicit.py
	python train_MNIST_Explicit.py
	python train_SVHN_Explicit.py

JFB: Jacobian-Free Backpropagation for Implicit Models

Related tags

Overview

Jacobian-Free Backprop

Associated Publication

Set-up

Training

Owner

Typal Research

Official implementation of Influence-balanced Loss for Imbalanced Visual Classification in PyTorch.

Implementation of paper "Decision-based Black-box Attack Against Vision Transformers via Patch-wise Adversarial Removal"

FPSAutomaticAiming——基于YOLOV5的FPS类游戏自动瞄准AI

Official implementation of the paper ``Unifying Nonlocal Blocks for Neural Networks'' (ICCV'21)

A privacy-focused, intelligent security camera system.

The official implementation of the CVPR 2021 paper FAPIS: a Few-shot Anchor-free Part-based Instance Segmenter

Implements MLP-Mixer: An all-MLP Architecture for Vision.

Synthetic LiDAR sequential point cloud dataset with point-wise annotations

image scene graph generation benchmark

Code accompanying the paper Say As You Wish: Fine-grained Control of Image Caption Generation with Abstract Scene Graphs (Chen et al., CVPR 2020, Oral).

PyTorch evaluation code for Delving Deep into the Generalization of Vision Transformers under Distribution Shifts.

Code of U2Fusion: a unified unsupervised image fusion network for multiple image fusion tasks, including multi-modal, multi-exposure and multi-focus image fusion.

SW components and demos for visual kinship recognition. An emphasis is put on the FIW dataset-- data loaders, benchmarks, results in summary.

The official implementation code of "PlantStereo: A Stereo Matching Benchmark for Plant Surface Dense Reconstruction."

OpenIPDM is a MATLAB open-source platform that stands for infrastructures probabilistic deterioration model

D²Conv3D: Dynamic Dilated Convolutions for Object Segmentation in Videos

A general and strong 3D object detection codebase that supports more methods, datasets and tools (debugging, recording and analysis).

FasterAI: A library to make smaller and faster models with FastAI.

This repository contains the implementation of the HealthGen model, a generative model to synthesize realistic EHR time series data with missingness

A general-purpose, flexible, and easy-to-use simulator alongside an OpenAI Gym trading environment for MetaTrader 5 trading platform (Approved by OpenAI Gym)