Omnidirectional camera calibration in python

Last update: Nov 22, 2022

Related tags

Deep Learning py-omnicalib

Overview

Omnidirectional Camera Calibration

Key features

pure python
initial solution based on A Toolbox for Easily Calibrating Omnidirectional Cameras (Davide Scaramuzza, Agostino Martinelli, Roland Siegwart)
Optimized solution via Levenberg–Marquardt algorithm on reprojection error
Lie algebra based extrinsics optimization

(undistort example)

Usage

Corner detection (see python -m omnicalib.detect --help for detailed argument description)

python -m omnical.detect --chessboard <rows> <columns> <square-size> --max-dim <max-dim> --threads <threads> <image-folder>

The file detections.pickle is written, which contains a pickled dictionary with the following format

{
    'detections': {
        <image_path_0>: {'image_points': <image_points>, 'object_points': <object_points>},
        ...
}

Image paths (pathlib.Path) are absolute
image_points are torch.Tensor with shape N x 2 and dtype torch.float64
object_points are torch.Tensor with shape N x 3 and dtype torch.float64 and third colum, the z coordinate, all zeros

If an external corner detection method is used, this file can simply be written manually.

Calibration (see python -m omnicalib --help for detailed argument description)

python -m omnical --degree <degree> detections.pickle

Result

A calibration.yml file (see example_calibration.yml) containing

extrinsics as list of 3 x 4 matrices
poly_incident_angle_to_radius, a polynom that converts incident angle to image radius
poly_radius_to_z, a polynom that converts radius to z component of view vector
principal_point in pixel

Method

For a detailed description see method.md.

Simulation

Play with the calibration on simulated data with the provided jupyter lab notebook. It generates randomized data for the following ideal projection models

equidistant
stereographic
orthographic
equisolid

, see Large Area 3D Human Pose Detection Via Stereo Reconstruction in Panoramic Cameras for a detailed description.

Example

Jupyter lab notebook, example results

You might also like...

Improving Calibration for Long-Tailed Recognition (CVPR2021)

19 Apr 28, 2021

Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021

SNN_Calibration Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021 Feature Comparison of SNN calibration: Features SNN Direct Tr

60 Dec 27, 2022

S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)

S2-BNN (Self-supervised Binary Neural Networks Using Distillation Loss) This is the official pytorch implementation of our paper: "S2-BNN: Bridging th

52 Dec 24, 2022

[CVPR 2022] Official code for the paper: "A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration"

MDCA Calibration This is the official PyTorch implementation for the paper: "A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved

21 Dec 22, 2022

Omnidirectional camera calibration in python

Related tags

Overview

Omnidirectional Camera Calibration

Key features

Usage

Result

Method

Simulation

Example

You might also like...

Improving Calibration for Long-Tailed Recognition (CVPR2021)

Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021

S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)

the code for paper "Energy-Based Open-World Uncertainty Modeling for Confidence Calibration"

We utilize deep reinforcement learning to obtain favorable trajectories for visual-inertial system calibration.

Improving Calibration for Long-Tailed Recognition (CVPR2021)

Source code of NeurIPS 2021 Paper ''Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibration''

CSAC - Collaborative Semantic Aggregation and Calibration for Separated Domain Generalization

[CVPR 2022] Official code for the paper: "A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration"

Releases(1.0.1)

1.0.1(Mar 1, 2022)

1.0.0(Dec 21, 2021)

Owner

Thomas Pönitz

Source code release of the paper: Knowledge-Guided Deep Fractal Neural Networks for Human Pose Estimation.

RoBERTa Marathi Language model trained from scratch during huggingface 🤗 x flax community week

Fusion-DHL: WiFi, IMU, and Floorplan Fusion for Dense History of Locations in Indoor Environments

Encoding Causal Macrovariables

TCTrack: Temporal Contexts for Aerial Tracking (CVPR2022)

Improving Factual Completeness and Consistency of Image-to-text Radiology Report Generation

Semantic Segmentation for Real Point Cloud Scenes via Bilateral Augmentation and Adaptive Fusion (CVPR 2021)

[WACV 2022] Contextual Gradient Scaling for Few-Shot Learning

Python and C++ implementation of "MarkerPose: Robust real-time planar target tracking for accurate stereo pose estimation". Accepted at LXCV @ CVPR 2021.

Code + pre-trained models for the paper Keeping Your Eye on the Ball Trajectory Attention in Video Transformers

PyTorch implementation of Soft-DTW: a Differentiable Loss Function for Time-Series in CUDA

Pytorch implementation of the paper "Optimization as a Model for Few-Shot Learning"

Dynamic Slimmable Network (CVPR 2021, Oral)

基于Paddle框架的fcanet复现

unofficial pytorch implement of "Squareplus: A Softplus-Like Algebraic Rectifier"

Official PyTorch implementation of "BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generation" (NeurIPS 2021)

Sentiment analysis translations of the Bhagavad Gita

Homepage of paper: Paint Transformer: Feed Forward Neural Painting with Stroke Prediction, ICCV 2021.

[CVPR22] Official codebase of Semantic Segmentation by Early Region Proxy.

Code of the paper "Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognition"