FAIMED 3D

use fastai to quickly train fully three-dimensional models on radiological data

Classification

from faimed3d.all import *

Load data in various medical formats (DICOM, NIfTI, NRRD) or even videos as simple as in fastai.

d = pd.read_csv('../data/radiopaedia_cases.csv')
dls = ImageDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

Faimed3d provides multiple model architectures, pretrained on the UCF101 dataset for action recoginiton, which can be used for transfer learning.

Model	3-fold accuracy	duration/epoch	model size
efficientnet b0	92.5 %	9M:35S	48.8 MB
efficientnet b1	90.1 %	13M:20S	80.5 MB
resnet 18	87.6 %	6M:57S	339.1 MB
resnet 50	94.8 %	12M:16S	561.2 MB
resnet 101	96.0 %	17M:20S	1,030 MB

# slow
learn = cnn_learner_3d(dls, efficientnet_b0)

# slow
learn.lr_find()

SuggestedLRs(lr_min=0.014454397559165954, lr_steep=6.309573450380412e-07)

Click here for a more in-depth classification example.

Segmentation

dls = SegmentationDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

All models in faimed3d can be used as a backbone for U-Nets, even with pre-trained weights.

# slow
learn = unet_learner_3d(dls, efficientnet_b0, n_out = 2)

# slow 
learn.lr_find()

SuggestedLRs(lr_min=0.33113112449646, lr_steep=0.10000000149011612)

Click here for a more in-depth segmentation example.

Extension to fastai for volumetric medical data

Related tags

Overview

FAIMED 3D

Classification

Segmentation

Owner

Keno

Implementation of Memory-Efficient Neural Networks with Multi-Level Generation, ICCV 2021

Source code for TACL paper "KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation".

《Lerning n Intrinsic Grment Spce for Interctive Authoring of Grment Animtion》

A Lightweight Hyperparameter Optimization Tool 🚀

Implementation for our ICCV 2021 paper: Dual-Camera Super-Resolution with Aligned Attention Modules

PyTorch implementation of the Value Iteration Networks (VIN) (NIPS '16 best paper)

A benchmark for the task of translation suggestion

PyTorchMemTracer - Depict GPU memory footprint during DNN training of PyTorch

Tensorflow python implementation of "Learning High Fidelity Depths of Dressed Humans by Watching Social Media Dance Videos"

Depression Asisstant GDSC Challenge Solution

Automatically replace ONNX's RandomNormal node with Constant node.

Using deep learning to predict gene structures of the coding genes in DNA sequences of Arabidopsis thaliana

This program generates a random 12 digit/character password (upper and lowercase) and stores it in a file along with your username and app/website.

GPU Accelerated Non-rigid ICP for surface registration

tf2-keras implement yolov5

Fully convolutional deep neural network to remove transparent overlays from images

Repo for EMNLP 2021 paper "Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression"

PyTorch implementation of Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

[TNNLS 2021] The official code for the paper "Learning Deep Context-Sensitive Decomposition for Low-Light Image Enhancement"

Expressive Power of Invariant and Equivaraint Graph Neural Networks (ICLR 2021)