FAIMED 3D

use fastai to quickly train fully three-dimensional models on radiological data

Classification

from faimed3d.all import *

Load data in various medical formats (DICOM, NIfTI, NRRD) or even videos as simple as in fastai.

d = pd.read_csv('../data/radiopaedia_cases.csv')
dls = ImageDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

Faimed3d provides multiple model architectures, pretrained on the UCF101 dataset for action recoginiton, which can be used for transfer learning.

Model	3-fold accuracy	duration/epoch	model size
efficientnet b0	92.5 %	9M:35S	48.8 MB
efficientnet b1	90.1 %	13M:20S	80.5 MB
resnet 18	87.6 %	6M:57S	339.1 MB
resnet 50	94.8 %	12M:16S	561.2 MB
resnet 101	96.0 %	17M:20S	1,030 MB

# slow
learn = cnn_learner_3d(dls, efficientnet_b0)

# slow
learn.lr_find()

SuggestedLRs(lr_min=0.014454397559165954, lr_steep=6.309573450380412e-07)

Click here for a more in-depth classification example.

Segmentation

dls = SegmentationDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

All models in faimed3d can be used as a backbone for U-Nets, even with pre-trained weights.

# slow
learn = unet_learner_3d(dls, efficientnet_b0, n_out = 2)

# slow 
learn.lr_find()

SuggestedLRs(lr_min=0.33113112449646, lr_steep=0.10000000149011612)

Click here for a more in-depth segmentation example.

Extension to fastai for volumetric medical data

Related tags

Overview

FAIMED 3D

Classification

Segmentation

Owner

Keno

Python版OpenCVのTracking APIのサンプルです。DaSiamRPNアルゴリズムまで対応しています。

An Empirical Investigation of Model-to-Model Distribution Shifts in Trained Convolutional Filters

Diabet Feature Engineering - Predict whether people have diabetes when their characteristics are specified

A Tensorflow implementation of the Text Conditioned Auxiliary Classifier Generative Adversarial Network for Generating Images from text descriptions

Code in PyTorch for the convex combination linear IAF and the Householder Flow, J.M. Tomczak & M. Welling

A forwarding MPI implementation that can use any other MPI implementation via an MPI ABI

StarGAN - Official PyTorch Implementation (CVPR 2018)

A Pytorch implementation of MoveNet from Google. Include training code and pre-train model.

Arxiv harvester - Poor man's simple harvester for arXiv resources

PyTorch reimplementation of the paper Involution: Inverting the Inherence of Convolution for Visual Recognition [CVPR 2021].

LSTM and QRNN Language Model Toolkit for PyTorch

[CVPR 2021] MiVOS - Mask Propagation module. Reproduced STM (and better) with training code :star2:. Semi-supervised video object segmentation evaluation.

GLM (General Language Model)

PCGNN - Procedural Content Generation with NEAT and Novelty

SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data

[CVPR'21] Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

Advanced Deep Learning with TensorFlow 2 and Keras (Updated for 2nd Edition)

The code for "Deep Level Set for Box-supervised Instance Segmentation in Aerial Images".

[NeurIPS 2019] Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss

PyTorch implementation for 3D human pose estimation