3D-RETR: End-to-End Single and Multi-View3D Reconstruction with Transformers

Last update: Dec 21, 2022

Related tags

Pytorch Utilities 3D-RETR

Overview

3D-RETR: End-to-End Single and Multi-View 3D Reconstruction with Transformers (BMVC 2021)

Zai Shi, Zhao Meng, Yiran Xing, Yunpu Ma, Roger Wattenhofer

∗The first two authors contribute equally to this work

[BMVC (with presentation)] [Paper] [Supplementary]

Citation

@inproceedings{3d-retr,
  author    = {Zai Shi, Zhao Meng, Yiran Xing, Yunpu Ma, Roger Wattenhofer},
  title     = {3D-RETR: End-to-End Single and Multi-View3D Reconstruction with Transformers},
  booktitle = {BMVC},
  year      = {2021}
}

Create Environment

git clone [email protected]:FomalhautB/3D-RETR.git
cd 3D-RETR
conda env create -f config/environment.yaml
conda activate 3d-retr

Prepare Data

ShapeNet

Download the Rendered Images and Voxelization (32) and decompress them into $SHAPENET_IMAGE and $SHAPENET_VOXEL

Train

Here is an example of reproducing the result of the single view 3D-RETR-B on the ShapeNet dataset:

python train.py \
    --model image2voxel \
    --transformer_config config/3d-retr-b.yaml \
    --annot_path data/ShapeNet.json \
    --model_path $SHAPENET_VOX \
    --image_path $SHAPENET_IMAGES \
    --gpus 1 \
    --precision 16 \
    --deterministic \
    --train_batch_size 16 \
    --val_batch_size 16 \
    --num_workers 4 \
    --check_val_every_n_epoch 1 \
    --accumulate_grad_batches 1 \
    --view_num 1 \
    --sample_batch_num 0 \
    --loss_type dice \

3D-RETR: End-to-End Single and Multi-View3D Reconstruction with Transformers

Related tags

Overview

3D-RETR: End-to-End Single and Multi-View 3D Reconstruction with Transformers (BMVC 2021)

Zai Shi, Zhao Meng, Yiran Xing, Yunpu Ma, Roger Wattenhofer

Citation

Create Environment

Prepare Data

ShapeNet

Train

Owner

Zai Shi

PyTorch framework A simple and complete framework for PyTorch, providing a variety of data loading and simple task solutions that are easy to extend and migrate

Distiller is an open-source Python package for neural network compression research.

PyTorch Extension Library of Optimized Autograd Sparse Matrix Operations

A code copied from google-research which named motion-imitation was rewrited with PyTorch

Differentiable SDE solvers with GPU support and efficient sensitivity analysis.

Official implementations of EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis.

A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-precision, and PyTorch extensions.

PyTorch implementation of TabNet paper : https://arxiv.org/pdf/1908.07442.pdf

A PyTorch implementation of Learning to learn by gradient descent by gradient descent

ocaml-torch provides some ocaml bindings for the PyTorch tensor library.

pip install antialiased-cnns to improve stability and accuracy

Pytorch bindings for Fortran

higher is a pytorch library allowing users to obtain higher order gradients over losses spanning training loops rather than individual training steps.

On the Variance of the Adaptive Learning Rate and Beyond

TorchSSL: A PyTorch-based Toolbox for Semi-Supervised Learning

Kaldi-compatible feature extraction with PyTorch, supporting CUDA, batch processing, chunk processing, and autograd

PyTorch Lightning Optical Flow models, scripts, and pretrained weights.

A Pytorch Implementation for Compact Bilinear Pooling.

TorchShard is a lightweight engine for slicing a PyTorch tensor into parallel shards

Over9000 optimizer

3D-RETR: End-to-End Single and Multi-View3D Reconstruction with Transformers

Related tags

Overview

3D-RETR: End-to-End Single and Multi-View 3D Reconstruction with Transformers (BMVC 2021)

Zai Shi*, Zhao Meng*, Yiran Xing, Yunpu Ma, Roger Wattenhofer

Citation

Create Environment

Prepare Data

ShapeNet

Train

Owner

Zai Shi

PyTorch framework A simple and complete framework for PyTorch, providing a variety of data loading and simple task solutions that are easy to extend and migrate

Distiller is an open-source Python package for neural network compression research.

PyTorch Extension Library of Optimized Autograd Sparse Matrix Operations

A code copied from google-research which named motion-imitation was rewrited with PyTorch

Differentiable SDE solvers with GPU support and efficient sensitivity analysis.

Official implementations of EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis.

A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-precision, and PyTorch extensions.

PyTorch implementation of TabNet paper : https://arxiv.org/pdf/1908.07442.pdf

A PyTorch implementation of Learning to learn by gradient descent by gradient descent

ocaml-torch provides some ocaml bindings for the PyTorch tensor library.

pip install antialiased-cnns to improve stability and accuracy

Pytorch bindings for Fortran

higher is a pytorch library allowing users to obtain higher order gradients over losses spanning training loops rather than individual training steps.

On the Variance of the Adaptive Learning Rate and Beyond

TorchSSL: A PyTorch-based Toolbox for Semi-Supervised Learning

Kaldi-compatible feature extraction with PyTorch, supporting CUDA, batch processing, chunk processing, and autograd

PyTorch Lightning Optical Flow models, scripts, and pretrained weights.

A Pytorch Implementation for Compact Bilinear Pooling.

TorchShard is a lightweight engine for slicing a PyTorch tensor into parallel shards

Over9000 optimizer

Zai Shi, Zhao Meng, Yiran Xing, Yunpu Ma, Roger Wattenhofer