QAT(quantize aware training) for classification with MQBench

Last update: Nov 18, 2022

Overview

MQBench Quantization Aware Training with PyTorch

I am using MQBench(Model Quantization Benchmark)(http://mqbench.tech/) to quantize the model for deployment.

MQBench is a benchmark and framework for evluating the quantization algorithms under real world hardware deployments.

Prerequisites

Python 3.7+
PyTorch 1.8.1+

Install MQBench Lib

Before run this repository, you should install MQBench:

git clone https://github.com/ModelTC/MQBench.git
cd MQBench
python setup.py build
python setup.py install

Training Fp32 Model

# Start training fp32 model with: 
# model_name can be ResNet18, MobileNet, ...
python main.py model_name

# You can manually config the training with: 
python main.py --resume --lr=0.01

Training Quantize Model

# Start training quantize model with: 
# model_name can be ResNet18, MobileNet, ...
python main.py model_name --quantize

# You can manually config the training with: 
python main.py --resume --parallel DP --BackendType Tensorrt --quantize
python -m torch.distributed.launch main.py --local_rank 0 --parallel DDP --resume  --BackendType Tensorrt --quantize

Fp32 Accuracy

Model	Acc.
VGG16	92.64%
ResNet18	93.02%
ResNet50	93.62%
ResNet101	93.75%
RegNetX_200MF	94.24%
RegNetY_400MF	94.29%
MobileNetV2	94.43%
ResNeXt29(32x4d)	94.73%
ResNeXt29(2x64d)	94.82%
SimpleDLA	94.89%
DenseNet121	95.04%
PreActResNet18	95.11%
DPN92	95.16%
DLA	95.47%

QAT(quantize aware training) for classification with MQBench

Related tags

Overview

MQBench Quantization Aware Training with PyTorch

Prerequisites

Install MQBench Lib

Training Fp32 Model

Training Quantize Model

Fp32 Accuracy

Owner

Ling Zhang

A Kaggle competition: discriminate gender based on handwriting

Repo for the ACMMM20 submission: "Personalized breath based biometric authentication with wearable multimodality".

GNN-based Recommendation Benchma

Automatically measure the facial Width-To-Height ratio and get facial analysis results provided by Microsoft Azure

Official Implementation for the "An Empirical Investigation of 3D Anomaly Detection and Segmentation" paper.

PyTorch implementation of federated learning framework based on the acceleration of global momentum

Solver for Large-Scale Rank-One Semidefinite Relaxations

'Solving the sampling problem of the Sycamore quantum supremacy circuits

SmoothGrad implementation in PyTorch

Reference implementation of code generation projects from Facebook AI Research. General toolkit to apply machine learning to code, from dataset creation to model training and evaluation. Comes with pretrained models.

RRxIO - Robust Radar Visual/Thermal Inertial Odometry: Robust and accurate state estimation even in challenging visual conditions.

Code for Graph-to-Tree Learning for Solving Math Word Problems (ACL 2020)

Materials for my scikit-learn tutorial

A comprehensive list of published machine learning applications to cosmology

Spatially-Adaptive Pixelwise Networks for Fast Image Translation, CVPR 2021

Deepfake Scanner by Deepware.

Hierarchical Clustering: O(1)-Approximation for Well-Clustered Graphs

Code for Temporally Abstract Partial Models

NeROIC: Neural Object Capture and Rendering from Online Image Collections

A python module for configuration of block devices