State of the Art Neural Networks for Deep Learning

Overview

pyradox

This python library helps you with implementing various state of the art neural networks in a totally customizable fashion using Tensorflow 2


Installation

pip install git+https://github.com/Ritvik19/pyradox.git

Usage

Modules

Module Description Input Shape Output Shape Usage
Rescale A layer that rescales the input: x_out = (x_in -mu) / sigma Arbitrary Same shape as input check here
Convolution 2D Applies 2D Convolution followed by Batch Normalization (optional) and Dropout (optional) 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Densely Connected Densely Connected Layer followed by Batch Normalization (optional) and Dropout (optional) 2D tensor with shape (batch_size, input_dim) 2D tensor with shape (batch_size, n_units) check here
DenseNet Convolution Block A Convolution block for DenseNets 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
DenseNet Convolution Block A Convolution block for DenseNets 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
DenseNet Transition Block A Transition block for DenseNets 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Dense Skip Connection Implementation of a skip connection for densely connected layer 2D tensor with shape (batch_size, input_dim) 2D tensor with shape (batch_size, n_units) check here
VGG Module Implementation of VGG Modules with slight modifications, Applies multiple 2D Convolution followed by Batch Normalization (optional), Dropout (optional) and MaxPooling 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Inception Conv Implementation of 2D Convolution Layer for Inception Net, Convolution Layer followed by Batch Normalization, Activation and optional Dropout 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Inception Block Implementation on Inception Mixing Block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Xception Block A customised implementation of Xception Block (Depthwise Separable Convolutions) 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net Block Implementation of Efficient Net Block (Depthwise Separable Convolutions) 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Conv Skip Connection Implementation of Skip Connection for Convolution Layer 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net Block Customized Implementation of ResNet Block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net V2 Block Customized Implementation of ResNetV2 Block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res NeXt Block Customized Implementation of ResNeXt Block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Inception Res Net Conv 2D Implementation of Convolution Layer for Inception Res Net: Convolution2d followed by Batch Norm 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Inception Res Net Block Implementation of Inception-ResNet block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) block 8 Block 17 Block 35
NAS Net Separable Conv Block Adds 2 blocks of Separable Conv Batch Norm 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
NAS Net Adjust Block Adjusts the input previous path to match the shape of the input
NAS Net Normal A Cell Normal cell for NASNet-A
NAS Net Reduction A Cell Reduction cell for NASNet-A
Mobile Net Conv Block Adds an initial convolution layer with batch normalization and activation 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Mobile Net Depth Wise Conv Block Adds a depthwise convolution block. A depthwise convolution block consists of a depthwise conv, batch normalization, activation, pointwise convolution, batch normalization and activation 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Inverted Res Block Adds an Inverted ResNet block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
SEBlock Adds a Squeeze Excite Block 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here

ConvNets

Module Description Input Shape Output Shape Usage
Generalized Dense Nets A generalization of Densely Connected Convolutional Networks (Dense Nets) 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Densely Connected Convolutional Network 121 A modified implementation of Densely Connected Convolutional Network 121 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Densely Connected Convolutional Network 169 A modified implementation of Densely Connected Convolutional Network 169 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Densely Connected Convolutional Network 201 A modified implementation of Densely Connected Convolutional Network 201 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Generalized VGG A generalization of VGG network 4D tensor with shape (batch_shape, rows, cols, channels) 4D or 2D tensor usage 1 usage 2
VGG 16 A modified implementation of VGG16 network 4D tensor with shape (batch_shape, rows, cols, channels) 2D tensor with shape (batch_shape, new_dim) usage 1 usage 2
VGG 19 A modified implementation of VGG19 network 4D tensor with shape (batch_shape, rows, cols, channels) 2D tensor with shape (batch_shape, new_dim) usage 1 usage 2
Inception V3 Customized Implementation of Inception Net 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Generalized Xception Generalized Implementation of XceptionNet (Depthwise Separable Convolutions) 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Xception Net A Customised Implementation of XceptionNet 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net Generalized Implementation of Effiecient Net 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B0 Customized Implementation of Efficient Net B0 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B1 Customized Implementation of Efficient Net B1 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B2 Customized Implementation of Efficient Net B2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B3 Customized Implementation of Efficient Net B3 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B4 Customized Implementation of Efficient Net B4 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B5 Customized Implementation of Efficient Net B5 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B6 Customized Implementation of Efficient Net B6 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Efficient Net B7 Customized Implementation of Efficient Net B7 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net Customized Implementation of Res Net 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net 50 Customized Implementation of Res Net 50 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net 101 Customized Implementation of Res Net 101 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net 152 Customized Implementation of Res Net 152 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net V2 Customized Implementation of Res Net V2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net 50 V2 Customized Implementation of Res Net 50 V2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net 101 V2 Customized Implementation of Res Net 101 V2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res Net 152 V2 Customized Implementation of Res Net 152 V2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res NeXt Customized Implementation of Res NeXt 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res NeXt 50 Customized Implementation of Res NeXt 50 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res NeXt 101 Customized Implementation of Res NeXt 101 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Res NeXt 152 Customized Implementation of Res NeXt 152 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
Inception Res Net V2 Customized Implementation of Inception Res Net V2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
NAS Net Generalised Implementation of NAS Net 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
NAS Net Mobile Customized Implementation of NAS Net Mobile 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
NAS Net Large Customized Implementation of NAS Net Large 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) check here
MobileNet Customized Implementation of MobileNet 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) usage 1 usage 2
Mobile Net V2 Customized Implementation of Mobile Net V2 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) usage 1 usage 2
Mobile Net V3 Customized Implementation of Mobile Net V3 4D tensor with shape (batch_shape, rows, cols, channels) 4D tensor with shape (batch_shape, new_rows, new_cols, new_channels) usage 1 usage 2

DenseNets

Module Description Input Shape Output Shape Usage
Densely Connected Network Network of Densely Connected Layers followed by Batch Normalization (optional) and Dropout (optional) 2D tensor with shape (batch_size, input_dim) 2D tensor with shape (batch_size, new_dim) check here
Densely Connected Resnet Network of skip connections for densely connected layer 2D tensor with shape (batch_size, input_dim) 2D tensor with shape (batch_size, new_dim) check here
You might also like...
State-of-the-art data augmentation search algorithms in PyTorch
State-of-the-art data augmentation search algorithms in PyTorch

MuarAugment Description MuarAugment is a package providing the easiest way to a state-of-the-art data augmentation pipeline. How to use You can instal

A selection of State Of The Art research papers (and code) on human locomotion (pose + trajectory) prediction (forecasting)

A selection of State Of The Art research papers (and code) on human trajectory prediction (forecasting). Papers marked with [W] are workshop papers.

A state of the art of new lightweight YOLO model implemented by TensorFlow 2.
A state of the art of new lightweight YOLO model implemented by TensorFlow 2.

CSL-YOLO: A New Lightweight Object Detection System for Edge Computing This project provides a SOTA level lightweight YOLO called "Cross-Stage Lightwe

We evaluate our method on different datasets (including ShapeNet, CUB-200-2011, and Pascal3D+) and achieve state-of-the-art results, outperforming all the other supervised and unsupervised methods and 3D representations, all in terms of performance, accuracy, and training time. FastReID is a research platform that implements state-of-the-art re-identification algorithms.
FastReID is a research platform that implements state-of-the-art re-identification algorithms.

FastReID is a research platform that implements state-of-the-art re-identification algorithms.

Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.
Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.

Summary Explorer Summary Explorer is a tool to visually inspect the summaries from several state-of-the-art neural summarization models across multipl

PaddleViT: State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 2.0+
PaddleViT: State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 2.0+

PaddlePaddle Vision Transformers State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 🤖 PaddlePaddle Visual Transformers (PaddleViT or

🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.
🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

English | 简体中文 | 繁體中文 State-of-the-art Natural Language Processing for Jax, PyTorch and TensorFlow 🤗 Transformers provides thousands of pretrained mo

Fuzzification helps developers protect the released, binary-only software from attackers who are capable of applying state-of-the-art fuzzing techniques

About Fuzzification Fuzzification helps developers protect the released, binary-only software from attackers who are capable of applying state-of-the-

Comments
Releases(v1.0.1)
Owner
Ritvik Rastogi
I have been writing code since 2016, and taught myself a handful of skills and programming languages. I love solving problems by writing code
Ritvik Rastogi
Tool for installing and updating MiSTer cores and other files

MiSTer Downloader This tool installs and updates all the cores and other extra files for your MiSTer. It also updates the menu core, the MiSTer firmwa

72 Dec 24, 2022
Pytorch Implementation of Auto-Compressing Subset Pruning for Semantic Image Segmentation

Pytorch Implementation of Auto-Compressing Subset Pruning for Semantic Image Segmentation Introduction ACoSP is an online pruning algorithm that compr

Merantix 8 Dec 07, 2022
Detecting Potentially Harmful and Protective Suicide-related Content on Twitter

TwitterSuicideML Scripts for reproducing the Machine Learning analysis of the paper: Detecting Potentially Harmful and Protective Suicide-related Cont

3 Oct 17, 2022
code from "Tensor decomposition of higher-order correlations by nonlinear Hebbian plasticity"

Code associated with the paper "Tensor decomposition of higher-order correlations by nonlinear Hebbian learning," Ocker & Buice, Neurips 2021. "plot_f

Gabriel Koch Ocker 4 Oct 16, 2022
Deep Learning pipeline for motor-imagery classification.

BCI-ToolBox 1. Introduction BCI-ToolBox is deep learning pipeline for motor-imagery classification. This repo contains five models: ShallowConvNet, De

DongHee 18 Oct 31, 2022
Narya API allows you track soccer player from camera inputs, and evaluate them with an Expected Discounted Goal (EDG) Agent

Narya The Narya API allows you track soccer player from camera inputs, and evaluate them with an Expected Discounted Goal (EDG) Agent. This repository

Paul Garnier 121 Dec 30, 2022
Reinforcement Learning for the Blackjack

Reinforcement Learning for Blackjack Author: ZHA Mengyue Math Department of HKUST Problem Statement We study playing Blackjack by reinforcement learni

Dolores 3 Jan 24, 2022
Sequence to Sequence (seq2seq) Recurrent Neural Network (RNN) for Time Series Forecasting

Sequence to Sequence (seq2seq) Recurrent Neural Network (RNN) for Time Series Forecasting Note: You can find here the accompanying seq2seq RNN forecas

Guillaume Chevalier 1k Dec 25, 2022
A way to store images in YAML.

YAMLImg A way to store images in YAML. I made this after seeing Roadcrosser's JSON-G because it was too inspiring to ignore this opportunity. Installa

5 Mar 14, 2022
Nest - A flexible tool for building and sharing deep learning modules

Nest - A flexible tool for building and sharing deep learning modules Nest is a flexible deep learning module manager, which aims at encouraging code

ZhouYanzhao 41 Oct 10, 2022
(3DV 2021 Oral) Filtering by Cluster Consistency for Large-Scale Multi-Image Matching

Scalable Cluster-Consistency Statistics for Robust Multi-Object Matching (3DV 2021 Oral Presentation) Filtering by Cluster Consistency (FCC) is a very

Yunpeng Shi 11 Sep 28, 2022
The codebase for our paper "Generative Occupancy Fields for 3D Surface-Aware Image Synthesis" (NeurIPS 2021)

Generative Occupancy Fields for 3D Surface-Aware Image Synthesis (NeurIPS 2021) Project Page | Paper Xudong Xu, Xingang Pan, Dahua Lin and Bo Dai GOF

xuxudong 97 Nov 10, 2022
Meta-meta-learning with evolution and plasticity

Evolve plastic networks to be able to automatically acquire novel cognitive (meta-learning) tasks

5 Jun 28, 2022
A PyTorch implementation of NeRF (Neural Radiance Fields) that reproduces the results.

NeRF-pytorch NeRF (Neural Radiance Fields) is a method that achieves state-of-the-art results for synthesizing novel views of complex scenes. Here are

Yen-Chen Lin 3.2k Jan 08, 2023
A PyTorch Implementation of "SINE: Scalable Incomplete Network Embedding" (ICDM 2018).

Scalable Incomplete Network Embedding ⠀⠀ A PyTorch implementation of Scalable Incomplete Network Embedding (ICDM 2018). Abstract Attributed network em

Benedek Rozemberczki 69 Sep 22, 2022
MiniSom is a minimalistic implementation of the Self Organizing Maps

MiniSom Self Organizing Maps MiniSom is a minimalistic and Numpy based implementation of the Self Organizing Maps (SOM). SOM is a type of Artificial N

Giuseppe Vettigli 1.2k Jan 03, 2023
OpenVINO黑客松比赛项目

Window_Guard OpenVINO黑客松比赛项目 英文名称:Window_Guard 中文名称:窗口卫士 硬件 树莓派4B 8G版本 一个磁石开关 USB摄像头(MP4视频文件也可以) 软件(库) OpenVINO RPi 使用方法 本项目使用的OPenVINO是是2021.3版本,并使用了

Tango 6 Jul 04, 2021
A super lightweight Lagrangian model for calculating millions of trajectories using ERA5 data

Easy-ERA5-Trck Easy-ERA5-Trck Galleries Install Usage Repository Structure Module Files Version iteration Easy-ERA5-Trck is a super lightweight Lagran

Zhenning Li 26 Nov 19, 2022
A data-driven maritime port simulator

PySeidon - A Data-Driven Maritime Port Simulator 🌊 Extendable and modular software for maritime port simulation. This software uses entity-component

6 Apr 10, 2022
PyTorch Lightning + Hydra. A feature-rich template for rapid, scalable and reproducible ML experimentation with best practices. ⚡🔥⚡

Lightning-Hydra-Template A clean and scalable template to kickstart your deep learning project 🚀 ⚡ 🔥 Click on Use this template to initialize new re

Łukasz Zalewski 2.1k Jan 09, 2023