A synthetic texture-invariant dataset for object detection of UAVs

Last update: Aug 13, 2022

Overview

A synthetic dataset for object detection of UAVs

This repository contains a synthetic datasets accompanying the paper Sim2Air - Synthetic aerial dataset for UAV monitoring by Antonella Barisic, Frano Petric and Stjepan Bogdan.

In this paper, we propose to use a texture-invariant representation of objects for aerial object detection. Our approach improves the generalisation and robustness of the object detector. A dataset is created with randomly assigned atypical textures and sufficient diversity and photorealism in all other components such as shape, pose, lighting, scale, background, etc. The results also show improved accuracy in case of distant objects and difficult lighting conditions.

All datasets from the paper are available for download. If you use these datasets for your research, please cite:

@misc{barisic2021sim2air,
      title={Sim2Air - Synthetic aerial dataset for UAV monitoring}, 
      author={Antonella Barisic and Frano Petric and Stjepan Bogdan},
      year={2021},
      eprint={2110.05145},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Datasets

Name	Description
Synthetic Eagle Baseline (SEB)	The SEB dataset is a synthetic dataset with a single UAV model, the custom aerial platform Eagle. Since this dataset serves as the basis for proving our hypothesis, it was created with only one texture, identical to the texture of real-life Eagle. SEB consists of 32 000 images of size 604 x 604 with annotations in YOLO format.
Synthetic Eagle with Textures (SET)	The SET dataset is the main star ⭐ of our work. It is a synthetic dataset of a single model, the custom aerial platform Eagle, with randomly selected atypical textures. The mixture of 32 different textures is applied during the procedural generation of the dataset. SET also consists of 32 000 images of size 604 x 604 with annotations in YOLO format.
Synthetic UAVs with Textures (S-UAV-T)	The S-UAV-T dataset is similar to SET but with many more models of UAVs. The data was created with 10 different multicopter models, 32 atypical textures, and with a variety of poses, backgrounds, viewpoints, etc. S-UAV-T consists of 52 500 images of size 604 x 604 with annotations in YOLO format.

If you want to test your detection results against real data, check out our UAV-Eagle dataset at larics/UAV-Eagle.

Contact

For more information, please contact Antonella Barisic.

A synthetic texture-invariant dataset for object detection of UAVs

Related tags

Overview

A synthetic dataset for object detection of UAVs

Datasets

Contact

Owner

LARICS Lab

Code to train models from "Paraphrastic Representations at Scale".

[CVPR 2021] "Multimodal Motion Prediction with Stacked Transformers": official code implementation and project page.

Food recognition model using convolutional neural network & computer vision

Identifying Stroke Indicators Using Rough Sets

Multi-task Learning of Order-Consistent Causal Graphs (NeuRIPs 2021)

LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT

RoMA: Robust Model Adaptation for Offline Model-based Optimization

Get the partition that a file belongs and the percentage of space that consumes

GAN example for Keras. Cuz MNIST is too small and there should be something more realistic.

Evidential Softmax for Sparse Multimodal Distributions in Deep Generative Models

Official implementation of Rethinking Graph Neural Architecture Search from Message-passing (CVPR2021)

The code for Bi-Mix: Bidirectional Mixing for Domain Adaptive Nighttime Semantic Segmentation

Pytorch implementation of Compressive Transformers, from Deepmind

Denoising Diffusion Probabilistic Models

Official PyTorch implementation of Spatial Dependency Networks.

Official implementation for paper: A Latent Transformer for Disentangled Face Editing in Images and Videos.

Code for ICMI2020 and ICMI2021 papers: "Studying Person-Specific Pointing and Gaze Behavior for Multimodal Referencing of Outside Objects from a Moving Vehicle" and "ML-PersRef: A Machine Learning-based Personalized Multimodal Fusion Approach for Referencing Outside Objects From a Moving Vehicle"

STARCH compuets regional extreme storm physical characteristics and moisture balance based on spatiotemporal precipitation data from reanalysis or climate model data.

Torch-mutable-modules - Use in-place and assignment operations on PyTorch module parameters with support for autograd

Betafold - AlphaFold with tunings