i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

This is a public code repository for the publication:

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery
Cameron R Wolfe, Anastasios Kyrillidis

Environment/Dependencies

Requires anaconda to be installed (python3) Anaconda can be installed at https://www.anaconda.com/products/individual

conda create -n ispasp python=3.6 anaconda
conda activate ispasp
conda install pytorch torchvision torchaudio cudatoolkit=11.3 -c pytorch
pip install -r requirements.txt

File Arrangement

Here we summarize all files present in this repo and their purpose.

+-- prune_resnet34_ispasp.py : i-SpaSP implementation for ResNet34
+-- prune_mobilenetv2_ispasp.py : i-SpaSP implementation for MobileNetV2
+-- lib/ : utility/helper functions
|   +-- data.py: helper functions for handling data
|   +-- utils.py: helper functions for computing performance metrics
+-- scripts/ : contains python scripts for running pruning experiments
|   +-- prune_rn34_ispasp.py: run an i-SpaSP pruning experiment for ResNet34  
|   +-- prune_mbnv2_ispasp.py: run an i-SpaSP pruning experiment for MobileNetV2
+-- requirements.txt : dependencies for pruning experiments

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Related tags

Overview

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Environment/Dependencies

File Arrangement

Owner

Cameron Ronald Wolfe

Real-time object detection on Android using the YOLO network with TensorFlow

Deep Reinforcement Learning for Multiplayer Online Battle Arena

PyTorch Implementation of Vector Quantized Variational AutoEncoders.

A Broader Picture of Random-walk Based Graph Embedding

A template repository for submitting a job to the Slurm Cluster installed at the DISI - University of Bologna

"Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation

Air Pollution Prediction System using Linear Regression and ANN

ROMP: Monocular, One-stage, Regression of Multiple 3D People, ICCV21

Neural Scene Flow Fields using pytorch-lightning, with potential improvements

DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models

This is the repository for Learning to Generate Piano Music With Sustain Pedals

Markov Attention Models

Keras Realtime Multi-Person Pose Estimation - Keras version of Realtime Multi-Person Pose Estimation project

This application explain how we can easily integrate Deepface framework with Python Django application

Flexible time series feature extraction & processing

Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

automated systems to assist guarding corona Virus precautions for Closed Rooms (e.g. Halls, offices, etc..)

Hyperparameter Optimization for TensorFlow, Keras and PyTorch

The easiest tool for extracting radiomics features and training ML models on them.

A simple API wrapper for Discord interactions.