[NeurIPS 2021] Shape from Blur: Recovering Textured 3D Shape and Motion of Fast Moving Objects

Last update: Dec 26, 2022

Overview

[NeurIPS 2021] Shape from Blur: Recovering Textured 3D Shape and Motion of Fast Moving Objects

YouTube | arXiv

Prerequisites

Kaolin is available here: https://github.com/NVIDIAGameWorks/kaolin

Running

The code can be easily run by:

python optimize.py

Running with your inputs:

python optimize.py --im examples/vol_im.png --bgr examples/vol_bgr.png
python optimize.py --im examples/aerobie_im.png --bgr examples/aerobie_bgr.png
python optimize.py --im examples/pen_im.png --bgr examples/pen_bgr.png

The results will be written to the output folder.

Reference

If you use this repository, please cite the following publication:

@misc{sfb,
  title = {Shape from Blur: Recovering Textured 3D Shape and Motion of Fast Moving Objects},
  author = {Denys Rozumnyi and Martin R. Oswald and Vittorio Ferrari and Marc Pollefeys},
  booktitle = {NeurIPS},
  month = {Dec},
  year = {2021}
}

You might also like...

Pop-Out Motion: 3D-Aware Image Deformation via Learning the Shape Laplacian (CVPR 2022)

Pop-Out Motion Pop-Out Motion: 3D-Aware Image Deformation via Learning the Shape Laplacian (CVPR 2022) Jihyun Lee*, Minhyuk Sung*, Hyunjin Kim, Tae-Ky

88 Nov 22, 2022

Code for Discriminative Sounding Objects Localization (NeurIPS 2020)

Discriminative Sounding Objects Localization Code for our NeurIPS 2020 paper Discriminative Sounding Objects Localization via Self-supervised Audiovis

51 Dec 11, 2022

A hand tracking demo made with mediapipe where you can control lights with pinching your fingers and moving your hand up/down.

HandTrackingBrightnessControl A hand tracking demo made with mediapipe where you can control lights with pinching your fingers and moving your hand up

19 Feb 12, 2022

Deep Implicit Moving Least-Squares Functions for 3D Reconstruction

DeepMLS: Deep Implicit Moving Least-Squares Functions for 3D Reconstruction This repository contains the implementation of the paper: Deep Implicit Mo

103 Dec 22, 2022

MonoRec: Semi-Supervised Dense Reconstruction in Dynamic Environments from a Single Moving Camera

494 Jan 6, 2023

Moving Object Segmentation in 3D LiDAR Data: A Learning-based Approach Exploiting Sequential Data

LiDAR-MOS: Moving Object Segmentation in 3D LiDAR Data This repo contains the code for our paper: Moving Object Segmentation in 3D LiDAR Data: A Learn

394 Dec 29, 2022

Simulation of moving particles under microscopic imaging

Simulation of moving particles under microscopic imaging Install scipy numpy scikit-image tiffile Run python simulation.py Read result https://imagej

2 Dec 14, 2021

High-performance moving least squares material point method (MLS-MPM) solver.

High-Performance MLS-MPM Solver with Cutting and Coupling (CPIC) (MIT License) A Moving Least Squares Material Point Method with Displacement Disconti

2.2k Dec 31, 2022

Predict multi paths to a moving person depending on his trajectory history.

Multi-future Trajectory Prediction The project is about using the Multiverse model to make possible multible-future trajectory prediction for a seen p

1 Jan 18, 2022

Comments

cannot import name 'total_variation' from 'kornia'

hi!

what an interesting work!

I have some trouble running the test demo. I have downloaded the newest kornia from pip and tried this https://github.com/kornia/kornia/discussions/1290, but still, get the problem. I wonder if you could give your environment requirements to run the test.

thx :)

Traceback (most recent call last):
  File "optimize.py", line 7, in <module>
    from shapefromblur import *
  File "/dev-data/xxx/projects/SfB/ShapeFromBlur-main/shapefromblur.py", line 12, in <module>
    from models.loss import *
  File "/dev-data/xxx/projects/SfB/ShapeFromBlur-main/models/loss.py", line 3, in <module>
    from kornia import total_variation
ImportError: cannot import name 'total_variation' from 'kornia'

opened by Ayxm1412 2

Releases(v1.0)

v1.0(Jul 9, 2021)

Initial release with simple use-case example.
Source code(tar.gz)
Source code(zip)

Owner

Denys Rozumnyi

PhD student at ETH Zurich.

GitHub Repository https://github.com/rozumden/ShapeFromBlur

Learning to Segment Instances in Videos with Spatial Propagation Network

Learning to Segment Instances in Videos with Spatial Propagation Network This paper is available at the 2017 DAVIS Challenge website. Check our result

145 Sep 28, 2022

PyTorch implementation of the paper Dynamic Data Augmentation with Gating Networks

Dynamic Data Augmentation with Gating Networks This is an official PyTorch implementation of the paper Dynamic Data Augmentation with Gating Networks

3 Oct 26, 2022

A tutorial on training a DarkNet YOLOv4 model for the CrowdHuman dataset

YOLOv4 CrowdHuman Tutorial This is a tutorial demonstrating how to train a YOLOv4 people detector using Darknet and the CrowdHuman dataset. Table of c

118 Nov 10, 2022

LightningFSL: Pytorch-Lightning implementations of Few-Shot Learning models.

LightningFSL: Few-Shot Learning with Pytorch-Lightning In this repo, a number of pytorch-lightning implementations of FSL algorithms are provided, inc

76 Dec 11, 2022

This's an implementation of deepmind Visual Interaction Networks paper using pytorch

Visual-Interaction-Networks An implementation of Deepmind visual interaction networks in Pytorch. Introduction For the purpose of understanding the ch

166 Dec 06, 2022

some classic model used to segment the medical images like CT、X-ray and so on

github_project This is a project for medical image segmentation. This project includes common medical image segmentation models such as U-net, FCN, De

2 Mar 30, 2022

learned_optimization: Training and evaluating learned optimizers in JAX

learned_optimization: Training and evaluating learned optimizers in JAX learned_optimization is a research codebase for training learned optimizers. I

533 Dec 30, 2022

The official PyTorch code implementation of "Human Trajectory Prediction via Counterfactual Analysis" in ICCV 2021.

Human Trajectory Prediction via Counterfactual Analysis (CausalHTP) The official PyTorch code implementation of "Human Trajectory Prediction via Count

46 Dec 03, 2022

Code for the head detector (HeadHunter) proposed in our CVPR 2021 paper Tracking Pedestrian Heads in Dense Crowd.

Head Detector Code for the head detector (HeadHunter) proposed in our CVPR 2021 paper Tracking Pedestrian Heads in Dense Crowd. The head_detection mod

76 Dec 06, 2022

Trained on Simulated Data, Tested in the Real World

43 Nov 18, 2022

Distributing reference energies for SMIRNOFF implementations

Warning: This code is currently experimental and under active development. Is it not yet suitable for distribution or use as reference implementation.

1 Dec 07, 2021

Unofficial implement with paper SpeakerGAN: Speaker identification with conditional generative adversarial network

Introduction This repository is about paper SpeakerGAN , and is unofficially implemented by Mingming Huang ( 7 Jan 03, 2023

Learning a mapping from images to psychological similarity spaces with neural networks.

LearningPsychologicalSpaces v0.1: v1.1: v1.2: v1.3: v1.4: v1.5: The code in this repository explores learning a mapping from images to psychological s

8 Dec 12, 2022

Implementation of the Point Transformer layer, in Pytorch

Point Transformer - Pytorch Implementation of the Point Transformer self-attention layer, in Pytorch. The simple circuit above seemed to have allowed

501 Jan 03, 2023

Deep learning model for EEG artifact removal

DeepSeparator Introduction Electroencephalogram (EEG) recordings are often contaminated with artifacts. Various methods have been developed to elimina

23 Dec 21, 2022

Learning to Prompt for Continual Learning

Learning to Prompt for Continual Learning (L2P) Official Jax Implementation L2P is a novel continual learning technique which learns to dynamically pr

207 Jan 06, 2023

Thermal Control of Laser Powder Bed Fusion using Deep Reinforcement Learning

This repository is the implementation of the paper "Thermal Control of Laser Powder Bed Fusion Using Deep Reinforcement Learning", linked here. The project makes use of the Deep Reinforcement Library

11 Dec 27, 2022

HMLLDB is a collection of LLDB commands to assist in the debugging of iOS apps.

HMLLDB is a collection of LLDB commands to assist in the debugging of iOS apps. 中文介绍 Features Non-intrusive. Your iOS project does not need to be modi

47 Oct 22, 2022

PyTorch implementation of the R2Plus1D convolution based ResNet architecture described in the paper "A Closer Look at Spatiotemporal Convolutions for Action Recognition"

R2Plus1D-PyTorch PyTorch implementation of the R2Plus1D convolution based ResNet architecture described in the paper "A Closer Look at Spatiotemporal

342 Dec 16, 2022

Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Merging

Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Merging This repository contains an implementation

1.1k Jan 02, 2023

[NeurIPS 2021] Shape from Blur: Recovering Textured 3D Shape and Motion of Fast Moving Objects

Related tags

Overview

[NeurIPS 2021] Shape from Blur: Recovering Textured 3D Shape and Motion of Fast Moving Objects

YouTube | arXiv

Prerequisites

Running

Reference

You might also like...

Pop-Out Motion: 3D-Aware Image Deformation via Learning the Shape Laplacian (CVPR 2022)

Code for Discriminative Sounding Objects Localization (NeurIPS 2020)

A hand tracking demo made with mediapipe where you can control lights with pinching your fingers and moving your hand up/down.

Deep Implicit Moving Least-Squares Functions for 3D Reconstruction

MonoRec: Semi-Supervised Dense Reconstruction in Dynamic Environments from a Single Moving Camera

Moving Object Segmentation in 3D LiDAR Data: A Learning-based Approach Exploiting Sequential Data

Simulation of moving particles under microscopic imaging

High-performance moving least squares material point method (MLS-MPM) solver.

Predict multi paths to a moving person depending on his trajectory history.

Comments

cannot import name 'total_variation' from 'kornia'

Releases(v1.0)

v1.0(Jul 9, 2021)

Owner

Denys Rozumnyi

Learning to Segment Instances in Videos with Spatial Propagation Network

PyTorch implementation of the paper Dynamic Data Augmentation with Gating Networks

A tutorial on training a DarkNet YOLOv4 model for the CrowdHuman dataset

LightningFSL: Pytorch-Lightning implementations of Few-Shot Learning models.

This's an implementation of deepmind Visual Interaction Networks paper using pytorch

some classic model used to segment the medical images like CT、X-ray and so on

learned_optimization: Training and evaluating learned optimizers in JAX

The official PyTorch code implementation of "Human Trajectory Prediction via Counterfactual Analysis" in ICCV 2021.

Code for the head detector (HeadHunter) proposed in our CVPR 2021 paper Tracking Pedestrian Heads in Dense Crowd.

Trained on Simulated Data, Tested in the Real World

Distributing reference energies for SMIRNOFF implementations

Unofficial implement with paper SpeakerGAN: Speaker identification with conditional generative adversarial network

Learning a mapping from images to psychological similarity spaces with neural networks.

Implementation of the Point Transformer layer, in Pytorch

Deep learning model for EEG artifact removal

Learning to Prompt for Continual Learning

Thermal Control of Laser Powder Bed Fusion using Deep Reinforcement Learning

HMLLDB is a collection of LLDB commands to assist in the debugging of iOS apps.

PyTorch implementation of the R2Plus1D convolution based ResNet architecture described in the paper "A Closer Look at Spatiotemporal Convolutions for Action Recognition"

Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Merging