PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data.

ARM-Net: Adaptive Relation Modeling Network for Structured Data

This repository contains our PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data. We also provide the implementation of relevant baseline models for structured (tabular) data learning.

Our lightweight framework for structured data analytics implemented in Singa can be found in our project site.

Benchmark Dataset

Baseline Model

Model	Code	Reference
Logistic Regression	LR, lr.py
Factorization Machine	FM, fm.py	S Rendle, Factorization Machines, 2010.
Attentional Factorization Machine	AFM, afm.py	J Xiao, et al. Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks, 2017.
Higher-Order Factorization Machines	HOFM, hofm.py	M Blondel, et al. Higher-Order Factorization Machines, 2016.
Deep Neural Network	DNN, dnn.py
Graph Convolutional Networks	GCN, gcn.py	T Kipf, et al. Semi-Supervised Classification with Graph Convolutional Networks, 2016.
Graph Convolutional Networks	GAT, gat.py	P Veličković, et al. Graph Attention Networks, 2017.
Wide&Deep	Wide&Deep, wd.py	HT Cheng, et al. Wide & Deep Learning for Recommender Systems, 2016.
Product Neural Network	IPNN/KPNN, pnn.py	Y Qu, et al. Product-based Neural Networks for User Response Prediction, 2016.
Neural Factorization Machine	NFM, nfm.py	X He and TS Chua, Neural Factorization Machines for Sparse Predictive Analytics, 2017.
DeepFM	DeepFM, dfm.py	H Guo, et al. DeepFM: A Factorization-Machine based Neural Network for CTR Prediction, 2017.
Deep & Cross Network	DCN/DCN+, dcn.py	R Wang, et al. Deep & Cross Network for Ad Click Predictions, 2017.
Gated Linear Unit	SA_GLU, sa_glu.py	Y N. Dauphin, et al. Language Modeling with Gated Convolutional Networks, 2017
xDeepFM	CIN/xDeepFM, xdfm.py	J Lian, et al. xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems, 2018.
Context-Aware Self-Attention Network	GC_ARM, gc_arm.py	B Yang, et al. Context-Aware Self-Attention Networks, 2019
AFN	AFN/AFN+, afn.py	W Cheng, et al. Adaptive Factorization Network: Learning Adaptive-Order Feature Interactions, 2020.
ARM-Net	ARM-Net/ARM-Net+, armnet.py	S Cai, et al. ARM-Net: Adaptive Relation Modeling Network for Structured Data, 2021.

Citation

If you use our code in your research, please kindly cite:

@inproceedings{DBLP:conf/sigmod/CaiZ0JOZ21,
  author    = {Shaofeng Cai and
               Kaiping Zheng and
               Gang Chen and
               H. V. Jagadish and
               Beng Chin Ooi and
               Meihui Zhang},
  title     = {ARM-Net: Adaptive Relation Modeling Network for Structured Data},
  booktitle = {{SIGMOD} '21: International Conference on Management of Data, Virtual
               Event, China, June 20-25, 2021},
  pages     = {207--220},
  publisher = {{ACM}},
  year      = {2021},
}

Contact

To ask questions or report issues, you can directly drop us an email.

PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data.

Related tags

Overview

ARM-Net: Adaptive Relation Modeling Network for Structured Data

Benchmark Dataset

Baseline Model

Citation

Contact

Owner

DCGAN-tensorflow - A tensorflow implementation of Deep Convolutional Generative Adversarial Networks

Official source code of Fast Point Transformer, CVPR 2022

CLIP (Contrastive Language–Image Pre-training) for Italian

ATAC: Adversarially Trained Actor Critic

Official PyTorch repo for JoJoGAN: One Shot Face Stylization

ROS-UGV-Control-Interface - Control interface which can be used in any UGV

An educational resource to help anyone learn deep reinforcement learning.

Use CLIP to represent video for Retrieval Task

A framework to train language models to learn invariant representations.

An easy way to build PyTorch datasets. Modularly build datasets and automatically cache processed results

Code accompanying the paper on "An Empirical Investigation of Domain Generalization with Empirical Risk Minimizers" published at NeurIPS, 2021

"NAS-Bench-301 and the Case for Surrogate Benchmarks for Neural Architecture Search".

FedJAX is a library for developing custom Federated Learning (FL) algorithms in JAX.

Learning Optical Flow from a Few Matches (CVPR 2021)

Source code for paper "Deep Superpixel-based Network for Blind Image Quality Assessment"

TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning

PyTorch code of paper "LiVLR: A Lightweight Visual-Linguistic Reasoning Framework for Video Question Answering"

A repository for storing njxzc final exam review material

PyTorch implementation of Tacotron speech synthesis model.

(CVPR 2021) PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Clouds