Range Image-based 3D LiDAR Localization
This repo contains the code for our ICRA2021 paper: Range Image-based LiDAR Localization for Autonomous Vehicles.
Developed by Xieyuanli Chen, Ignacio Vizzo, Thomas Läbe and Jens Behley.
It uses a novel sensor model with MCL to achieve 3D LiDAR global localization and pose tracking. The sensor model compares the range image of the current LiDAR scan to the synthetic range images rendered from the triangular mesh to update the weight of particles. This method is simple but can be used with different types of LiDAR scanners in different datasets and environments without fine-tuning.
Online localization demo.
Visualizations: Left: the triangular mesh and the localization results; Right: Sub-tile maps
Table of Contents
Publication
If you use our implementation in your academic work, please cite the corresponding paper:
@inproceedings{chen2021icra,
author = {X. Chen and I. Vizzo and T. L{\"a}be and J. Behley and C. Stachniss},
title = {{Range Image-based LiDAR Localization for Autonomous Vehicles}},
booktitle = icra,
year = 2021,
url = {http://www.ipb.uni-bonn.de/pdfs/chen2021icra.pdf},
codeurl = {https://github.com/PRBonn/range-mcl}
}
Dependencies
The code was tested with Ubuntu 20.04 with its standard python version 3.8.
We are using OpenGL to do achieve fast rendering, so you will need an OpenGL capable graphics card (we use Nvidia cards, e.g. 2080Ti) to be fast.
-
System dependencies related to OpenGL:
sudo apt-get update sudo apt-get install libgl1-mesa-glx
-
Other system dependencies:
sudo apt-get update sudo apt-get install libusb-1.0 # open3d 0.12.0 dependency sudo apt-get install -y python3-pip sudo -H pip3 install --upgrade pip -
Python dependencies (may also work with different versions than mentioned in the requirements file)
sudo -H pip3 install -r requirements.txt
How to use
Quick use
For a quick demo, one could download the mesh map and LiDAR data, extract the them in the /data folder following the recommended data structure, and then run:
cd src/
python3 main_range_mcl.py
One could then get the online visualization of range-based MCL as shown in the gif.
More detailed usage
Here, we provide more detailed information about our range-image-based LiDAR localization method, including building mesh maps, evaluating the localization results and more pre-built maps of different datasets.
Build mesh map
To build a mesh map, we use the Poisson surface reconstruction provided by the Open3D library. One need to download the LiDAR data, extract the them in the /data folder following the recommended data structure, and then run:
python3 build_mesh_map.py
Notice that, we used our moving object segmentation method (coming soon) cleaned the scans before building the map. One could also use other methods to clean the map.
For fast calculating and generating range and normal data for LiDAR scans, one could find more details here.
Evaluation
Once finished the localization process, one would get the localization results at /results. To evaluate the localization results, one could check the evaluation.py. For a quick demo, one just need to run
python3 evaluation.py
Collection of mesh maps
Notice that, the mesh maps were generated using the data from KITTI dataset, MulRan dataset and Apollo dataset. Please register on their official website to apply for the original data.
- KITTI sequence 07 (original data from KITTI dataset)
- MulRan KAIST 02 (original data from MulRan dataset)
- Apollo SouthBay (original data from Apollo dataset)
Related work
Puma: Poisson Surface Reconstruction for LiDAR Odometry and Mapping
We also released the implementation of the algorithms described in our paper Poisson Surface Reconstruction for LiDAR Odometry and Mapping. This is a LiDAR Odometry and Mapping pipeline that uses the Poisson Surface Reconstruction algorithm to build the map as a triangular mesh online.
Overlap-localization: Overlap-based 3D LiDAR Monte Carlo Localization
We previously also proposed a learning-based global localization method, called overlap localization. It uses the OverlapNet to train an observation model for Monte Carlo Localization and achieves global localization with 3D LiDAR scans.
License
Copyright 2021, Xieyuanli Chen, Ignacio Vizzo, Thomas Läbe, Jens Behley, Cyrill Stachniss, Photogrammetry and Robotics Lab, University of Bonn.
This project is free software made available under the MIT License. For details see the LICENSE file.
13 Aug 01, 2022
13 Nov 16, 2022
5 Nov 25, 2022
2.4k Jan 04, 2023
3 Jun 12, 2021
40 Dec 17, 2022
60 Dec 28, 2022
4 Apr 15, 2022
153 Jan 07, 2023
38 Dec 02, 2022
33 Dec 26, 2022
14 Nov 14, 2022
158 Dec 21, 2022
212 Dec 27, 2022
17 Nov 30, 2022
11 Jul 24, 2022
79 Sep 01, 2022
3 Mar 30, 2022
8 Oct 29, 2022
15 Nov 30, 2022