QueryDet: Cascaded Sparse Query for Accelerating High-Resolution SmallObject Detection

Last update: Dec 31, 2022

Related tags

Overview

QueryDet-PyTorch

This repository is the official implementation of our paper: QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detection

Requirement

a. Install Pytorch 1.4 following here

b. Install APEX following here

c. Install our Pytorch based sparse convolution operation following here

d. Install the detectron2 toolkit following here, note that we build our approach based on version 0.2.1. Note you may follow the instructions to set COCO configs

d. Clone our repository and have fun with it!

Usage

1. Data preparation

a. To prepare MS-COCO, you may follow the instructions of Detectron2

b. We provide the data preprocessing code for VisDrone2018. You need to first download dataset from here

c. Check visdrone/data_prepare.py to process the dataset

2. Training

% train coco RetinaNet baseline
python train_coco.py --config-file models/retinanet/configs/coco/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train coco QueryDet 
python train_coco.py --config-file models/querydet/configs/coco/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train VisDrone RetinaNet baseline
python train_visdrone.py --config-file models/retinanet/configs/visdrone/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train VisDrone QueryDet
python train_visdrone.py --config-file models/querydet/configs/visdrone/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

3. Test

% test coco RetinaNet baseline
python infer_coco.py --config-file models/retinanet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth

% test coco QueryDet with Dense Inference
python infer_coco.py --config-file models/querydet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth

% test coco QueryDet with CSQ
python infer_coco.py --config-file models/querydet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth MODEL.QUERY.QUERY_INFER True

QueryDet: Cascaded Sparse Query for Accelerating High-Resolution SmallObject Detection

Related tags

Overview

QueryDet-PyTorch

Requirement

Usage

1. Data preparation

2. Training

3. Test

Owner

Chenhongyi Yang

DeRF: Decomposed Radiance Fields

VR-Caps: A Virtual Environment for Active Capsule Endoscopy

code for our BMVC 2021 paper "HCV: Hierarchy-Consistency Verification for Incremental Implicitly-Refined Classification"

A visualisation tool for Deep Reinforcement Learning

Voice of Pajlada with model and weights.

Multi Task Vision and Language

Official repo for BMVC2021 paper ASFormer: Transformer for Action Segmentation

Fully convolutional deep neural network to remove transparent overlays from images

MoCoGAN: Decomposing Motion and Content for Video Generation

Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition

Posterior predictive distributions quantify uncertainties ignored by point estimates.

Demo for Real-time RGBD-based Extended Body Pose Estimation paper

A multilingual version of MS MARCO passage ranking dataset

A Next Generation ConvNet by FaceBookResearch Implementation in PyTorch(Original) and TensorFlow.

Assessing the Influence of Models on the Performance of Reinforcement Learning Algorithms applied on Continuous Control Tasks

一个免费开源一键搭建的通用验证码识别平台，大部分常见的中英数验证码识别都没啥问题。

Implementation of the paper: "SinGAN: Learning a Generative Model from a Single Natural Image"

Understanding the Effects of Datasets Characteristics on Offline Reinforcement Learning

🔎 Monitor deep learning model training and hardware usage from your mobile phone 📱

A PyTorch-based library for fast prototyping and sharing of deep neural network models.