(CVPR 2022 Oral) Official implementation for "Surface Representation for Point Clouds"

Related tags

Deep Learningpoint-cloudpytorchsunrgbdscannets3dismodelnet40scanobjectnncvpr2022
Overview

RepSurf - Surface Representation for Point Clouds
[CVPR 2022 Oral]

By Haoxi Ran* , Jun Liu, Chengjie Wang ( * : corresponding contact)

PWC PWC PWC PWC PWC PWC

The pytorch official implementation of "Surface Representation for Point Clouds". The repos of RepSurf on other tasks are coming:

arXiv | PDF

Other Tasks:

3D Segmentation (ongoing): RepSurf for Segmentation

Preparation

Environment

We tested under the environment:

  • python 3.7
  • pytorch 1.6.0
  • cuda 10.1
  • gcc 7.2.0
  • h5py

For anaconda user, initialize the environment by:

sh init.sh

Or you can manually install the above packages and compile the cuda-based point operators by:

cd modules/pointops
python3 setup.py install

Classification

ScanObjectNN

  • Performance:
Model Accuracy #Params Augment Code Log Checkpoint
MVTN 82.8 4.24M None link N/A link
PointMLP 85.7 12.6M Scale, Shift link link link
PointNet++ SSG 77.9 1.475M Rotate, Jitter link N/A N/A
Umbrella RepSurf (PointNet++ SSG) 84.87 1.483M None link google drive google drive (6MB)
Umbrella RepSurf (PointNet++ SSG, 2x) 86.05 6.806M None link google drive google drive (27MB)

  • To download dataset:
wget http://download.cs.stanford.edu/orion/scanobjectnn/h5_files.zip
unzip h5_files.zip
ln -s [PATH]/h5_files data/ScanObjectNN

Note: We conduct all experiments on the hardest variant of ScanObjectNN (PB_T50_RS).

  • To train Umbrella RepSurf on ScanObjectNN:
sh scripts/repsurf/scanobjectnn/repsurf_ssg_umb.sh
  • To train Umbrella RepSurf (2x setting) on ScanObjectNN:
sh scripts/repsurf/scanobjectnn/repsurf_ssg_umb_2x.sh

Visualization

We provide several visualization results in the folder ./visualization for a closer look at the construction of RepSurf.

TODO

  • Classification on ModelNet40
  • Segmentation on S3DIS / ScanNet

Acknowledgment

We use part of the library pointops from PointWeb.

License

RepSurf is under the Apache-2.0 license. Please contact the primary author Haoxi Ran ([email protected]) for commercial use.

Owner
Haoxi Ran
Haoxi Ran
GitHub Repository
Learning to Initialize Neural Networks for Stable and Efficient Training

GradInit This repository hosts the code for experiments in the paper, GradInit: Learning to Initialize Neural Networks for Stable and Efficient Traini

Chen Zhu 124 Dec 30, 2022
The project is an official implementation of our CVPR2019 paper "Deep High-Resolution Representation Learning for Human Pose Estimation"

Deep High-Resolution Representation Learning for Human Pose Estimation (CVPR 2019) News [2020/07/05] A very nice blog from Towards Data Science introd

Leo Xiao 3.9k Jan 05, 2023
This repository contains the source code of an efficient 1D probabilistic model for music time analysis proposed in ICASSP2022 venue.

Jump Reward Inference for 1D Music Rhythmic State Spaces An implementation of the probablistic jump reward inference model for music rhythmic informat

Mojtaba Heydari 25 Dec 16, 2022
Code for weakly supervised segmentation of a single class

SingleClassRL Implementation of weak single object segmentation from paper "Regularized Loss for Weakly Supervised Single Class Semantic Segmentation"

16 Nov 14, 2022
Bio-Computing Platform Featuring Large-Scale Representation Learning and Multi-Task Deep Learning “螺旋桨”生物计算工具集

English | 简体中文 Latest News 2021.10.25 Paper "Docking-based Virtual Screening with Multi-Task Learning" is accepted by BIBM 2021. 2021.07.29 PaddleHeli

633 Jan 04, 2023
Official implementation of "Dynamic Anchor Learning for Arbitrary-Oriented Object Detection" (AAAI2021).

DAL This project hosts the official implementation for our AAAI 2021 paper: Dynamic Anchor Learning for Arbitrary-Oriented Object Detection [arxiv] [c

ming71 215 Nov 28, 2022
The BCNet related data and inference model.

BCNet This repository includes the some source code and related dataset of paper BCNet: Learning Body and Cloth Shape from A Single Image, ECCV 2020,

81 Dec 12, 2022
Model-based 3D Hand Reconstruction via Self-Supervised Learning, CVPR2021

S2HAND: Model-based 3D Hand Reconstruction via Self-Supervised Learning S2HAND presents a self-supervised 3D hand reconstruction network that can join

Yujin Chen 72 Dec 12, 2022
A library for preparing, training, and evaluating scalable deep learning hybrid recommender systems using PyTorch.

collie_recs Collie is a library for preparing, training, and evaluating implicit deep learning hybrid recommender systems, named after the Border Coll

ShopRunner 97 Jan 03, 2023
Code for the Active Speakers in Context Paper (CVPR2020)

Active Speakers in Context This repo contains the official code and models for the "Active Speakers in Context" CVPR 2020 paper. Before Training The c

43 Oct 14, 2022
MoCoPnet - Deformable 3D Convolution for Video Super-Resolution

MoCoPnet: Exploring Local Motion and Contrast Priors for Infrared Small Target Super-Resolution Pytorch implementation of local motion and contrast pr

Xinyi Ying 28 Dec 15, 2022
Code and dataset for ACL2018 paper "Exploiting Document Knowledge for Aspect-level Sentiment Classification"

Aspect-level Sentiment Classification Code and dataset for ACL2018 [paper] ‘‘Exploiting Document Knowledge for Aspect-level Sentiment Classification’’

Ruidan He 146 Nov 29, 2022
Functional deep learning

Pipeline abstractions for deep learning. Full documentation here: https://lf1-io.github.io/padl/ PADL: is a pipeline builder for PyTorch. may be used

LF1 101 Nov 09, 2022
Home repository for the Regularized Greedy Forest (RGF) library. It includes original implementation from the paper and multithreaded one written in C++, along with various language-specific wrappers.

Regularized Greedy Forest Regularized Greedy Forest (RGF) is a tree ensemble machine learning method described in this paper. RGF can deliver better r

RGF-team 364 Dec 28, 2022
Official and maintained implementation of the paper "OSS-Net: Memory Efficient High Resolution Semantic Segmentation of 3D Medical Data" [BMVC 2021].

OSS-Net: Memory Efficient High Resolution Semantic Segmentation of 3D Medical Data Christoph Reich, Tim Prangemeier, Özdemir Cetin & Heinz Koeppl | Pr

Christoph Reich 23 Sep 21, 2022
Set of models for classifcation of 3D volumes

Classification models 3D Zoo - Keras and TF.Keras This repository contains 3D variants of popular CNN models for classification like ResNets, DenseNet

69 Dec 28, 2022
GLM (General Language Model)

GLM GLM is a General Language Model pretrained with an autoregressive blank-filling objective and can be finetuned on various natural language underst

THUDM 421 Jan 04, 2023
Reliable probability face embeddings

ProbFace, arxiv This is a demo code of training and testing [ProbFace] using Tensorflow. ProbFace is a reliable Probabilistic Face Embeddging (PFE) me

Kaen Chan 34 Dec 31, 2022
Pervasive Attention: 2D Convolutional Networks for Sequence-to-Sequence Prediction

This is a fork of Fairseq(-py) with implementations of the following models: Pervasive Attention - 2D Convolutional Neural Networks for Sequence-to-Se

Maha 490 Dec 15, 2022
COVID-VIT: Classification of Covid-19 from CT chest images based on vision transformer models

COVID-ViT COVID-VIT: Classification of Covid-19 from CT chest images based on vision transformer models This code is to response to te MIA-COV19 compe

17 Dec 30, 2022