Deep Learning Package based on TensorFlow

Last update: Dec 27, 2021

Overview

White-Box-Layer is a Python module for deep learning built on top of TensorFlow and is distributed under the MIT license.

The project was started in May 2021 by YeongHyeon Park.
This project does not limit for participation.
Contribute now!

Installation

Dependencies

whiteboxlayer requires:

Numpy: 1.18.5
Scipy: 1.4.1
TensorFlow: 2.3.0

User installation

You can install the white-box-layer via simple command as below.

$ pip install whiteboxlayer

Development

We welcome new contributors of all experience levels. The white-box-layer community goals are to be helpful, welcoming, and effective. The Development Guide has detailed information about contributing code, documentation, tests, and more. We've included some basic information in this README.

Example

Example for Convolutional Neural Network

An example of constructing a convolutional neural network is covered. The relevant source code is additionally provided following links.

Define TensorFlow based module

class Neuralnet(tf.Module):

    def __init__(self, **kwargs):
        super(Neuralnet, self).__init__()

        self.who_am_i = kwargs['who_am_i']
        self.dim_h = kwargs['dim_h']
        self.dim_w = kwargs['dim_w']
        self.dim_c = kwargs['dim_c']
        self.num_class = kwargs['num_class']
        self.filters = kwargs['filters']

        self.layer = wbl.Layers()

        self.forward = tf.function(self.__call__)

    @tf.function
    def __call__(self, x, verbose=False):

        logit = self.__nn(x=x, name=self.who_am_i, verbose=verbose)
        y_hat = tf.nn.softmax(logit, name="y_hat")

        return logit, y_hat

    def __nn(self, x, name='neuralnet', verbose=True):

        for idx, _ in enumerate(self.filters[:-1]):
            if(idx == 0): continue
            x = self.layer.conv2d(x=x, stride=1, \
                filter_size=[3, 3, self.filters[idx-1], self.filters[idx]], \
                activation='relu', name='%s-%dconv' %(name, idx), verbose=verbose)
            x = self.layer.maxpool(x=x, ksize=2, strides=2, \
                name='%s-%dmp' %(name, idx), verbose=verbose)

        x = tf.reshape(x, shape=[x.shape[0], -1], name="flat")
        x = self.layer.fully_connected(x=x, c_out=self.filters[-1], \
                activation='relu', name="%s-clf0" %(name), verbose=verbose)
        x = self.layer.fully_connected(x=x, c_out=self.num_class, \
                activation=None, name="%s-clf1" %(name), verbose=verbose)

        return x

Initializing module

model = Neuralnet(\
    who_am_i="CNN", \
    dim_h=28, dim_w=28, dim_c=1, \
    num_class=10, \
    filters=[1, 32, 64, 128])

dummy = tf.zeros((1, model.dim_h, model.dim_w, model.dim_c), dtype=tf.float32)
model.forward(x=dummy, verbose=True)

Results

Conv (CNN-1conv) (1, 28, 28, 1) -> (1, 28, 28, 32)
MaxPool (CNN-1mp) (1, 28, 28, 32) > (1, 14, 14, 32)
Conv (CNN-2conv) (1, 14, 14, 32) -> (1, 14, 14, 64)
MaxPool (CNN-2mp) (1, 14, 14, 64) > (1, 7, 7, 64)
FC (CNN-clf0) (1, 3136) -> (1, 128)
FC (CNN-clf1) (1, 128) -> (1, 10)
Conv (CNN-1conv) (1, 28, 28, 1) -> (1, 28, 28, 32)
MaxPool (CNN-1mp) (1, 28, 28, 32) > (1, 14, 14, 32)
Conv (CNN-2conv) (1, 14, 14, 32) -> (1, 14, 14, 64)
MaxPool (CNN-2mp) (1, 14, 14, 64) > (1, 7, 7, 64)
FC (CNN-clf0) (1, 3136) -> (1, 128)
FC (CNN-clf1) (1, 128) -> (1, 10)

You might also like...

Robust Video Matting in PyTorch, TensorFlow, TensorFlow.js, ONNX, CoreML!

MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g. model conversion and visualization. Convert models between Caffe, Keras, MXNet, Tensorflow, CNTK, PyTorch Onnx and CoreML.

MMdnn MMdnn is a comprehensive and cross-framework tool to convert, visualize and diagnose deep learning (DL) models. The "MM" stands for model manage

5.7k Jan 9, 2023

All course materials for the Zero to Mastery Deep Learning with TensorFlow course.

3.4k Jan 7, 2023

Deep Learning Package based on TensorFlow

Related tags

Overview

Installation

Dependencies

User installation

Development

Example

Example for Convolutional Neural Network

Define TensorFlow based module

Initializing module

Results

You might also like...

Robust Video Matting in PyTorch, TensorFlow, TensorFlow.js, ONNX, CoreML!

Deep learning library featuring a higher-level API for TensorFlow.

Deep learning library featuring a higher-level API for TensorFlow.

Deep learning operations reinvented (for pytorch, tensorflow, jax and others)

Deep learning with dynamic computation graphs in TensorFlow

QKeras: a quantization deep learning library for Tensorflow Keras

A bare-bones TensorFlow framework for Bayesian deep learning and Gaussian process approximation

MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g. model conversion and visualization. Convert models between Caffe, Keras, MXNet, Tensorflow, CNTK, PyTorch Onnx and CoreML.

All course materials for the Zero to Mastery Deep Learning with TensorFlow course.

Releases(0.2.9)

0.2.9(May 9, 2022)

0.2.7(Feb 9, 2022)

0.2.5(Feb 4, 2022)

0.2.4(Feb 4, 2022)

0.2.3(Feb 4, 2022)

0.2.2(Feb 4, 2022)

0.2.1(Dec 27, 2021)

0.1.18(Sep 30, 2021)

0.1.17(Sep 27, 2021)

0.1.16(Sep 17, 2021)

0.1.14(Jul 14, 2021)

0.1.12(Jun 17, 2021)

0.1.8(Jun 2, 2021)

0.1.5(May 30, 2021)

Owner

YeongHyeon Park

PyTorch implementation of the paper: Label Noise Transition Matrix Estimation for Tasks with Lower-Quality Features

基于AlphaPose的TensorRT加速

A modular, open and non-proprietary toolkit for core robotic functionalities by harnessing deep learning

Instance-wise Feature Importance in Time (FIT)

A code generator from ONNX to PyTorch code

AI-generated-characters for Learning and Wellbeing

Pytorch implementation of MLP-Mixer with loading pre-trained models.

Malmo Collaborative AI Challenge - Team Pig Catcher

A BaSiC Tool for Background and Shading Correction of Optical Microscopy Images

This repository contains the code and models necessary to replicate the results of paper: How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspective

BigbrotherBENL - Face recognition on the Big Brother episodes in Belgium and the Netherlands.

A library for efficient similarity search and clustering of dense vectors.

Implements Gradient Centralization and allows it to use as a Python package in TensorFlow

3D-CariGAN: An End-to-End Solution to 3D Caricature Generation from Normal Face Photos

SelfAugment extends MoCo to include automatic unsupervised augmentation selection.

Codes for realizing theories learned from Data Mining, Machine Learning, Deep Learning without using the present Python packages.

The offcial repository for 'CharacterBERT and Self-Teaching for Improving the Robustness of Dense Retrievers on Queries with Typos', SIGIR2022

Class activation maps for your PyTorch models (CAM, Grad-CAM, Grad-CAM++, Smooth Grad-CAM++, Score-CAM, SS-CAM, IS-CAM, XGrad-CAM, Layer-CAM)

Reduce end to end training time from days to hours (or hours to minutes), and energy requirements/costs by an order of magnitude using coresets and data selection.

Invasive Plant Species Identification