STAR

Official implementation of Sparse Transformer-based Action Recognition

Dataset

download NTU RGB+D 60 action recognition of 2D/3D skeleton from http://rose1.ntu.edu.sg/datasets/actionRecognition.asp

or use google drive

NTU60 NTU120

uzip data as the following file structure: $(project_folder)/raw/.\*skeleton or $(project_folder)/dataset/raw/.\*skeleton (create "raw" folder under $(project_folder) or $(project_folder)/dataset then put raw skeleton files under "raw" folder)

run the code below to generate dataset:

python datagen.py

Training

git fetch and checkout to "distributed" branch

python train_dist.py -#distributed training

Configuration

parser.set_defaults(gpu=True,
                    batch_size=128,
                    dataset_name='NTU',
                    dataset_root=osp.join(os.getcwd()),  # or dataset_root=osp.join(os.getcwd(), 'dataset')
                    load_model=False,
                    in_channels=9,
                    num_enc_layers=5,
                    num_conv_layers=2,
                    weight_decay=4e-5,
                    drop_rate=[0.4, 0.4, 0.4, 0.4],  # linear_attention, sparse_attention, add_norm, ffn
                    hid_channels=64,
                    out_channels=64,
                    heads=8,
                    data_parallel=False,
                    cross_k=5,
                    mlp_head_hidden=128)

parser.set_defaults(gpu=True,
                    batch_size=128,
                    dataset_name='NTU',
                    dataset_root=osp.join(os.getcwd()),
                    load_model=False,
                    in_channels=9,
                    num_enc_layers=5,
                    num_conv_layers=2,
                    weight_decay=4e-5,
                    drop_rate=[0.4, 0.4, 0.4, 0.4],  # linear_attention, sparse_attention, add_norm, ffn
                    hid_channels=128,
                    out_channels=128,
                    heads=8,
                    data_parallel=False,
                    cross_k=5,
                    mlp_head_hidden=128)

Official implementation of Sparse Transformer-based Action Recognition

Related tags

Overview

STAR

Dataset

Training

Configuration

Owner

Chonghan_Lee

An unreferenced image captioning metric (ACL-21)

This repository contains all data used for writing a research paper Multiple Object Trackers in OpenCV: A Benchmark, presented in ISIE 2021 conference in Kyoto, Japan.

Code and dataset for ACL2018 paper "Exploiting Document Knowledge for Aspect-level Sentiment Classification"

Files for a tutorial to train SegNet for road scenes using the CamVid dataset

Code related to the manuscript "Averting A Crisis In Simulation-Based Inference"

Pytorch implementation of the Variational Recurrent Neural Network (VRNN).

Official Pytorch implementation for "End2End Occluded Face Recognition by Masking Corrupted Features, TPAMI 2021"

Multi-atlas segmentation (MAS) is a promising framework for medical image segmentation

Easily pull telemetry data and create beautiful visualizations for analysis.

A PaddlePaddle implementation of Time Interval Aware Self-Attentive Sequential Recommendation.

This is the repository for our paper SimpleTrack: Understanding and Rethinking 3D Multi-object Tracking

EfficientNetV2-with-TPU - Cifar-10 case study

Python library to receive live stream events like comments and gifts in realtime from TikTok LIVE.

Official Implementation of "DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization."

DeepRec is a recommendation engine based on TensorFlow.

Message Passing on Cell Complexes

Public implementation of "Learning from Suboptimal Demonstration via Self-Supervised Reward Regression" from CoRL'21

Unofficial implementation of the Involution operation from CVPR 2021

Project page for End-to-end Recovery of Human Shape and Pose

Code of Classification Saliency-Based Rule for Visible and Infrared Image Fusion