FasterAI: A library to make smaller and faster models with FastAI.

Last update: Jan 01, 2023

Overview

Fasterai

fasterai is a library created to make neural network smaller and faster. It essentially relies on common compression techniques for networks such as pruning, knowledge distillation, ...

Project Documentation

Visit Read The Docs Project Page or read following README to know more about using Fasterai

Available Methods

1. Pruning

Make your model sparse (i.e. prune it) according to a:

Sparsity: the amount of weights that will be replaced by 0
Granularity: the granularity at which you operate the pruning (removing weights, vectors, kernels, filters)
Method: prune either each layer independantly (local pruning) or the whole model (global pruning)
Criteria: the criteria used to select the weights to remove (magnitude, movement, ...)
Schedule: which schedule you want to use for pruning (one shot, iterative, gradual, ...)

2. Knowledge Distillation

Distill the knowledge acquired by a big model into a smaller one.

3. Lottery Ticket Hypothesis

Find the winning ticket in you network, i.e. the initial subnetwork able to attain at least similar performances than the network as a whole.

Quick Start

1. Create your model with fastai

learn = cnn_learner(dls, model)

2. Get you Fasterai Callback

sp_cb=SparsifyCallback(end_sparsity, granularity, method, criteria, sched_func)

3. Train you model to make it sparse !

learn.fit_one_cycle(n_epochs, cbs=sp_cb)

More about other methods in the tutorials section

Installation

pip install git+https://github.com/nathanhubens/fasterai.git

pip install fasterai

Citing

@misc{Hubens:2020,
  Author = {Nathan Hubens},
  Title = {Fasterai},
  Year = {2020},
  Publisher = {GitHub},
  Journal = {GitHub repository},
  Howpublished = {\url{https://github.com/nathanhubens/fasterai}}
}

You might also like...

shufflev2-yolov5：lighter, faster and easier to deploy

shufflev2-yolov5: lighter, faster and easier to deploy. Evolved from yolov5 and the size of model is only 1.7M (int8) and 3.3M (fp16). It can reach 10+ FPS on the Raspberry Pi 4B when the input size is 320×320~

1.5k Jan 5, 2023

LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image.

This project is based on ultralytics/yolov3. LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image. Download $ git clone http

26 Dec 13, 2022

A Python package for faster, safer, and simpler ML processes

Bender 🤖 A Python package for faster, safer, and simpler ML processes. Why use bender? Bender will make your machine learning processes, faster, safe

6 Dec 13, 2022

Much faster than SORT(Simple Online and Realtime Tracking), a little worse than SORT

QSORT QSORT(Quick + Simple Online and Realtime Tracking) is a simple online and realtime tracking algorithm for 2D multiple object tracking in video s

8 Jul 27, 2022

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models. Because improving the PSNR index is not compatible with subjective effects, we hope this part of work and our academic research are independent of each other.

190 Jan 8, 2023

LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference

FasterAI: A library to make smaller and faster models with FastAI.

Related tags

Overview

Fasterai

Project Documentation

Available Methods

1. Pruning

2. Knowledge Distillation

3. Lottery Ticket Hypothesis

Quick Start

1. Create your model with fastai

2. Get you Fasterai Callback

3. Train you model to make it sparse !

Installation

Citing

You might also like...

shufflev2-yolov5：lighter, faster and easier to deploy

LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image.

A Python package for faster, safer, and simpler ML processes

Much faster than SORT(Simple Online and Realtime Tracking), a little worse than SORT

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models

LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference

Code to run experiments in SLOE: A Faster Method for Statistical Inference in High-Dimensional Logistic Regression.

PyTorch implementation of the Quasi-Recurrent Neural Network - up to 16 times faster than NVIDIA's cuDNN LSTM

A pytorch implementation of faster RCNN detection framework (Use detectron2, it's a masterpiece)

Releases(v0.1.9)

v0.1.9(Jul 4, 2022)

v0.1.8(May 29, 2022)

v0.1.6(Apr 19, 2022)

Owner

Nathan Hubens

Minimal fastai code needed for working with pytorch

Lama-cleaner: Image inpainting tool powered by LaMa

A simple python stock Predictor

TrackFormer: Multi-Object Tracking with Transformers

Official PyTorch implementation of "Evolving Search Space for Neural Architecture Search"

An implementation on "Curved-Voxel Clustering for Accurate Segmentation of 3D LiDAR Point Clouds with Real-Time Performance"

Code for our SIGCOMM'21 paper "Network Planning with Deep Reinforcement Learning".

MIM: MIM Installs OpenMMLab Packages

Build a small, 3 domain internet using Github pages and Wikipedia and construct a crawler to crawl, render, and index.

Physics-Aware Training (PAT) is a method to train real physical systems with backpropagation.

CLNTM - Contrastive Learning for Neural Topic Model

Satellite labelling tool for manual labelling of storm top features such as overshooting tops, above-anvil plumes, cold U/Vs, rings etc.

Hand Gesture Volume Control | Open CV | Computer Vision

[cvpr22] Perturbed and Strict Mean Teachers for Semi-supervised Semantic Segmentation

LexGLUE: A Benchmark Dataset for Legal Language Understanding in English

Code accompanying the NeurIPS 2021 paper "Generating High-Quality Explanations for Navigation in Partially-Revealed Environments"

Code for "Graph-Evolving Meta-Learning for Low-Resource Medical Dialogue Generation". [AAAI 2021]

Code for "PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation" CVPR 2019 oral

Offline Reinforcement Learning with Implicit Q-Learning

[ICCV'21] PlaneTR: Structure-Guided Transformers for 3D Plane Recovery