resco

Description

resco is a simple python package that report the effect of deep residual learning on backpropagation for 2 neural network architectures:

• A plain linear neural network
• A residual linear neural network

Installation

Install and create a virtualenv

pip install virtualenv
virtualenv .venv

Install the package

pip install . 

Execution

resco_analysis --model_name plain_dnn --n_blocks 50 --lr 0.001 --batch_size 256 --n_epochs 5

Gradients of the first neural network layer are reported on tensorboard, you can run your own tensorboard server by using this command

docker image build --tag tensorboard_resco .
docker container run --restart always -d -p 5001:5001 tensorboard_lm