PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data.

ARM-Net: Adaptive Relation Modeling Network for Structured Data

This repository contains our PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data. We also provide the implementation of relevant baseline models for structured (tabular) data learning.

Our lightweight framework for structured data analytics implemented in Singa can be found in our project site.

Benchmark Dataset

Baseline Model

Model	Code	Reference
Logistic Regression	LR, lr.py
Factorization Machine	FM, fm.py	S Rendle, Factorization Machines, 2010.
Attentional Factorization Machine	AFM, afm.py	J Xiao, et al. Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks, 2017.
Higher-Order Factorization Machines	HOFM, hofm.py	M Blondel, et al. Higher-Order Factorization Machines, 2016.
Deep Neural Network	DNN, dnn.py
Graph Convolutional Networks	GCN, gcn.py	T Kipf, et al. Semi-Supervised Classification with Graph Convolutional Networks, 2016.
Graph Convolutional Networks	GAT, gat.py	P Veličković, et al. Graph Attention Networks, 2017.
Wide&Deep	Wide&Deep, wd.py	HT Cheng, et al. Wide & Deep Learning for Recommender Systems, 2016.
Product Neural Network	IPNN/KPNN, pnn.py	Y Qu, et al. Product-based Neural Networks for User Response Prediction, 2016.
Neural Factorization Machine	NFM, nfm.py	X He and TS Chua, Neural Factorization Machines for Sparse Predictive Analytics, 2017.
DeepFM	DeepFM, dfm.py	H Guo, et al. DeepFM: A Factorization-Machine based Neural Network for CTR Prediction, 2017.
Deep & Cross Network	DCN/DCN+, dcn.py	R Wang, et al. Deep & Cross Network for Ad Click Predictions, 2017.
Gated Linear Unit	SA_GLU, sa_glu.py	Y N. Dauphin, et al. Language Modeling with Gated Convolutional Networks, 2017
xDeepFM	CIN/xDeepFM, xdfm.py	J Lian, et al. xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems, 2018.
Context-Aware Self-Attention Network	GC_ARM, gc_arm.py	B Yang, et al. Context-Aware Self-Attention Networks, 2019
AFN	AFN/AFN+, afn.py	W Cheng, et al. Adaptive Factorization Network: Learning Adaptive-Order Feature Interactions, 2020.
ARM-Net	ARM-Net/ARM-Net+, armnet.py	S Cai, et al. ARM-Net: Adaptive Relation Modeling Network for Structured Data, 2021.

Citation

If you use our code in your research, please kindly cite:

@inproceedings{DBLP:conf/sigmod/CaiZ0JOZ21,
  author    = {Shaofeng Cai and
               Kaiping Zheng and
               Gang Chen and
               H. V. Jagadish and
               Beng Chin Ooi and
               Meihui Zhang},
  title     = {ARM-Net: Adaptive Relation Modeling Network for Structured Data},
  booktitle = {{SIGMOD} '21: International Conference on Management of Data, Virtual
               Event, China, June 20-25, 2021},
  pages     = {207--220},
  publisher = {{ACM}},
  year      = {2021},
}

Contact

To ask questions or report issues, you can directly drop us an email.

PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data.

Related tags

Overview

ARM-Net: Adaptive Relation Modeling Network for Structured Data

Benchmark Dataset

Baseline Model

Citation

Contact

Owner

A repository with exploration into using transformers to predict DNA ↔ transcription factor binding

A deep learning model for style-specific music generation.

Project of 'TBEFN: A Two-branch Exposure-fusion Network for Low-light Image Enhancement '

AdaNet is a lightweight TensorFlow-based framework for automatically learning high-quality models with minimal expert intervention

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

Tensorflow implementation of the paper "HumanGPS: Geodesic PreServing Feature for Dense Human Correspondences", CVPR 2021.

A Comprehensive Analysis of Weakly-Supervised Semantic Segmentation in Different Image Domains (IJCV submission)

RATE: Overcoming Noise and Sparsity of Textual Features in Real-Time Location Estimation (CIKM'17)

DEEPAGÉ: Answering Questions in Portuguese about the Brazilian Environment

Old Photo Restoration (Official PyTorch Implementation)

Code for the paper “The Peril of Popular Deep Learning Uncertainty Estimation Methods”

Official implementation of Meta-StyleSpeech and StyleSpeech

'A C2C E-COMMERCE TRUST MODEL BASED ON REPUTATION' Python implementation

Pre-Training 3D Point Cloud Transformers with Masked Point Modeling

Crowd-Kit is a powerful Python library that implements commonly-used aggregation methods for crowdsourced annotation and offers the relevant metrics and datasets

FinEAS: Financial Embedding Analysis of Sentiment 📈

a Lightweight library for sequential learning agents, including reinforcement learning

Differential Privacy for Heterogeneous Federated Learning : Utility & Privacy tradeoffs

Home repository for the Regularized Greedy Forest (RGF) library. It includes original implementation from the paper and multithreaded one written in C++, along with various language-specific wrappers.

Tf alloc - Simplication of GPU allocation for Tensorflow2