An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Last update: Nov 09, 2021

Related tags

Deep Learning EquivariantSelfAttention

Overview

EquivariantSelfAttention

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

This work extends and builds on previous work:

FR Classification using e2cnn, whose code is here.
Attention for FR Classificaion, whose code is here. This work makes extensive use of the e2cnn package: e2cnn.

Imports for General Use

import os
import torch
import e2cnn
import pandas as pd
import numpy as np
import configparser as ConfigParser

import utils

Loading a network:

To load a network import the network files, read in a config file, and load the network with the config file parameters:

from networks import AGRadGalNet, VanillaLeNet, testNet, DNSteerableLeNet, DNSteerableAGRadGalNet
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

config      = ConfigParser.ConfigParser(allow_no_value=True)
config_path = "configs/CONFIG_NAME"
config.read(config_path)

net = locals()[config['model']['base']](**config['model']).to(device)

Alternatively, if you know which architecture you want to use, only import that and load in the config parameters (i.e. without using locals()):

from networks import DNSteerableAGRadGalNet
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

config      = ConfigParser.ConfigParser(allow_no_value=True)
config_path = "configs/CONFIG_NAME"
config.read(config_path)

net = DNSteerableAGRadGalNet(**config['model']).to(device)

Loading a model:

To load the best performing model (according to early stopping) from a given model training session:

path_supliment = config['data']['augment']+'/'
model = utils.utils.load_model(config, load_model='best', device=device, path_supliment=path_supliment)

Testing a model:

Follow the example of evaluation.ipynb for model evaluation.

Defining a model:

To define your own model simply create a new config which follows the examples provided in configs.

Training a model:

To train a model use the train.py using your config file:

python3.8 train.py --config YOUR_CONFIG_NAME.cfg >& logs/YOUR_CONFIG_NAME.log

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Related tags

Overview

EquivariantSelfAttention

Imports for General Use

Loading a network:

Loading a model:

Testing a model:

Defining a model:

Training a model:

Owner

MicRank is a Learning to Rank neural channel selection framework where a DNN is trained to rank microphone channels.

Neural network for stock price prediction

HiFi++: a Unified Framework for Neural Vocoding, Bandwidth Extension and Speech Enhancement

PyTorch implementation of "Simple and Deep Graph Convolutional Networks"

This repository contains python code necessary to replicated the experiments performed in our paper "Invariant Ancestry Search"

Aspect-Sentiment-Multiple-Opinion Triplet Extraction (NLPCC 2021)

Main repository for the HackBio'2021 Virtual Internship Experience for #Team-Greider ❤️

AAAI 2022 paper - Unifying Model Explainability and Robustness for Joint Text Classification and Rationale Extraction

Public scripts, services, and configuration for running a smart home K3S network cluster

Automatic packaging of the open-composite libs for OvGME

Official implementation of the ICML2021 paper "Elastic Graph Neural Networks"

Locally Most Powerful Bayesian Test for Out-of-Distribution Detection using Deep Generative Models

On Evaluation Metrics for Graph Generative Models

make ASCII Art by Deep Learning

An implementation of the "Attention is all you need" paper without extra bells and whistles, or difficult syntax

An implementation of the Contrast Predictive Coding (CPC) method to train audio features in an unsupervised fashion.

Production First and Production Ready End-to-End Speech Recognition Toolkit

CVPR2021 Content-Aware GAN Compression

Supervised multi-SNE (S-multi-SNE): Multi-view visualisation and classification

A collection of awesome resources image-to-image translation.