PyTorch implementation of our Adam-NSCL algorithm from our CVPR2021 (oral) paper "Training Networks in Null Space for Continual Learning"

Last update: Dec 21, 2022

Overview

Adam-NSCL

This is a PyTorch implementation of Adam-NSCL algorithm for continual learning from our CVPR2021 (oral) paper:

Title: Training Networks in Null Space of Feature Covariance for Continual Learning

Authors: Shipeng Wang, Xiaorong Li, Jian Sun, Zongben Xu

Email: [email protected]; [email protected]

Arxiv: https://arxiv.org/pdf/2103.07113

Usage

sh scripts_svd/adamnscl.sh

Requirements: Python 3.7, PyTorch=1.5,tensorboardX

Citation

@InProceedings{Wang_2021_CVPR,
    author    = {Wang, Shipeng and Li, Xiaorong and Sun, Jian and Xu, Zongben},
    title     = {Training Networks in Null Space of Feature Covariance for Continual Learning},
    booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    month     = {June},
    year      = {2021},
    pages     = {184-193}
}

Owner

Shipeng Wang

GitHub Repository

Code for "Learning Structural Edits via Incremental Tree Transformations" (ICLR'21)

Learning Structural Edits via Incremental Tree Transformations Code for "Learning Structural Edits via Incremental Tree Transformations" (ICLR'21) 1.

40 Dec 23, 2022

Gapmm2: gapped alignment using minimap2 (align transcripts to genome)

gapmm2: gapped alignment using minimap2 This tool is a wrapper for minimap2 to r

2 Jan 27, 2022

RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching

RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching This repository contains the source code for our paper: RAFT-Stereo: Multilevel

328 Jan 09, 2023

This repo implements a 3D segmentation task for an airport baggage dataset.

3D CT Scan Segmentation With Occupancy Network This repo implements a 3D superresolution segmentation task for an airport baggage dataset. Our final p

2 Mar 28, 2022

Code for intrusion detection system (IDS) development using CNN models and transfer learning

Intrusion-Detection-System-Using-CNN-and-Transfer-Learning This is the code for the paper entitled "A Transfer Learning and Optimized CNN Based Intrus

38 Dec 12, 2022

A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis

A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis Figure: Shape-Accurate 3D-Aware Image Synthesis. A Shading-Guid

115 Dec 18, 2022

Some code of the implements of Geological Modeling Using 3D Pixel-Adaptive and Deformable Convolutional Neural Network

3D-GMPDCNN Geological Modeling Using 3D Pixel-Adaptive and Deformable Convolutional Neural Network PyTorch implementation of "Geological Modeling Usin

5 Nov 21, 2022

Creating a custom CNN hypertunned architeture for the Fashion MNIST dataset with Python, Keras and Tensorflow.

custom-cnn-fashion-mnist Creating a custom CNN hypertunned architeture for the Fashion MNIST dataset with Python, Keras and Tensorflow. The following

1 Mar 05, 2022

To Design and Implement Logistic Regression to Classify Between Benign and Malignant Cancer Types

To Design and Implement Logistic Regression to Classify Between Benign and Malignant Cancer Types, from a Database Taken From Dr. Wolberg reports his Clinic Cases.

1 Jul 31, 2022

NeuPy is a Tensorflow based python library for prototyping and building neural networks

NeuPy v0.8.2 NeuPy is a python library for prototyping and building neural networks. NeuPy uses Tensorflow as a computational backend for deep learnin

729 Jan 03, 2023

PyTorch implementation of Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

Simple PyTorch Implementation of "Grokking" Implementation of Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets Usage Running

15 Sep 29, 2022

Official repository for "Restormer: Efficient Transformer for High-Resolution Image Restoration". SOTA results for single-image motion deblurring, image deraining, image denoising (synthetic and real data), and dual-pixel defocus deblurring.

Restormer: Efficient Transformer for High-Resolution Image Restoration Syed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan,

906 Dec 30, 2022

PyTorch implementation of our Adam-NSCL algorithm from our CVPR2021 (oral) paper "Training Networks in Null Space for Continual Learning"

Related tags

Overview

Adam-NSCL

Usage

Owner

Shipeng Wang

Code for "Learning Structural Edits via Incremental Tree Transformations" (ICLR'21)

Gapmm2: gapped alignment using minimap2 (align transcripts to genome)

RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching

This repo implements a 3D segmentation task for an airport baggage dataset.

Code for intrusion detection system (IDS) development using CNN models and transfer learning

A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis

Some code of the implements of Geological Modeling Using 3D Pixel-Adaptive and Deformable Convolutional Neural Network

Creating a custom CNN hypertunned architeture for the Fashion MNIST dataset with Python, Keras and Tensorflow.

To Design and Implement Logistic Regression to Classify Between Benign and Malignant Cancer Types

NeuPy is a Tensorflow based python library for prototyping and building neural networks

PyTorch implementation of Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

Official repository for "Restormer: Efficient Transformer for High-Resolution Image Restoration". SOTA results for single-image motion deblurring, image deraining, image denoising (synthetic and real data), and dual-pixel defocus deblurring.

Code repository for "Stable View Synthesis".

DP-CL(Continual Learning with Differential Privacy)

ExCon: Explanation-driven Supervised Contrastive Learning

NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations

A large dataset of 100k Google Satellite and matching Map images, resembling pix2pix's Google Maps dataset.

Pytorch implementation of forward and inverse Haar Wavelets 2D

Educational API for 3D Vision using pose to control carton.

A solution to the 2D Ising model of ferromagnetism, implemented using the Metropolis algorithm