SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Water
- URL: http://arxiv.org/abs/2105.01922v1
- Date: Wed, 5 May 2021 08:18:36 GMT
- Title: SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Water
- Authors: Leon Amadeus Varga, Benjamin Kiefer, Martin Messmer and Andreas Zell
- Abstract summary: This paper introduces a large-scaled visual object detection and tracking benchmark (SeaDronesSee)
We collect and annotate over 54,000 frames with 400,000 instances captured from various altitudes and viewing angles ranging from 5 to 260 meters and 0 to 90 degrees.
We evaluate multiple state-of-the-art computer vision algorithms on this newly established benchmark serving as baselines.
- Score: 13.216389226310987
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Unmanned Aerial Vehicles (UAVs) are of crucial importance in search and
rescue missions in maritime environments due to their flexible and fast
operation capabilities. Modern computer vision algorithms are of great interest
in aiding such missions. However, they are dependent on large amounts of
real-case training data from UAVs, which is only available for traffic
scenarios on land. Moreover, current object detection and tracking data sets
only provide limited environmental information or none at all, neglecting a
valuable source of information. Therefore, this paper introduces a large-scaled
visual object detection and tracking benchmark (SeaDronesSee) aiming to bridge
the gap from land-based vision systems to sea-based ones. We collect and
annotate over 54,000 frames with 400,000 instances captured from various
altitudes and viewing angles ranging from 5 to 260 meters and 0 to 90 degrees
while providing the respective meta information for altitude, viewing angle and
other meta data. We evaluate multiple state-of-the-art computer vision
algorithms on this newly established benchmark serving as baselines. We provide
an evaluation server where researchers can upload their prediction and compare
their results on a central leaderboard
Related papers
- The 2nd Workshop on Maritime Computer Vision (MaCVi) 2024 [71.80200746293505]
2nd Workshop on Maritime Computer Vision (MaCVi) 2024 addresses maritime computer vision for Unmanned Aerial Vehicles (UAV) and Unmanned Surface Vehicles (USV)
arXiv Detail & Related papers (2023-11-23T21:01:14Z) - Deep Learning-Based Object Detection in Maritime Unmanned Aerial Vehicle
Imagery: Review and Experimental Comparisons [10.75221614844458]
We first briefly summarize four challenges for object detection on maritime UAVs, i.e. object feature diversity, device limitation, maritime environment variability, and dataset scarcity.
Next, we review the UAV aerial image/video datasets and propose a maritime UAV aerial dataset named MS2ship for ship detection.
arXiv Detail & Related papers (2023-11-14T07:20:38Z) - Improving Underwater Visual Tracking With a Large Scale Dataset and
Image Enhancement [70.2429155741593]
This paper presents a new dataset and general tracker enhancement method for Underwater Visual Object Tracking (UVOT)
It poses distinct challenges; the underwater environment exhibits non-uniform lighting conditions, low visibility, lack of sharpness, low contrast, camouflage, and reflections from suspended particles.
We propose a novel underwater image enhancement algorithm designed specifically to boost tracking quality.
The method has resulted in a significant performance improvement, of up to 5.0% AUC, of state-of-the-art (SOTA) visual trackers.
arXiv Detail & Related papers (2023-08-30T07:41:26Z) - 1st Workshop on Maritime Computer Vision (MaCVi) 2023: Challenge Results [152.54137779547068]
This report summarizes the main findings of the individual subchallenges and introduces a new benchmark, called SeaDronesSee Object Detection v2.
The datasets, evaluation code and the leaderboard are publicly available at https://seadronessee.cs.uni-tuebingen.de/macvi.
arXiv Detail & Related papers (2022-11-24T09:59:13Z) - AstroVision: Towards Autonomous Feature Detection and Description for
Missions to Small Bodies Using Deep Learning [14.35670544436183]
This paper introduces AstroVision, a large-scale dataset comprised of 115,970 densely annotated, real images of 16 different small bodies captured during past and ongoing missions.
We leverage AstroVision to develop a set of standardized benchmarks and conduct an exhaustive evaluation of both handcrafted and data-driven feature detection and description methods.
Next, we employ AstroVision for end-to-end training of a state-of-the-art, deep feature detection and description network and demonstrate improved performance on multiple benchmarks.
arXiv Detail & Related papers (2022-08-03T13:18:44Z) - KOLOMVERSE: Korea open large-scale image dataset for object detection in the maritime universe [0.5732204366512352]
We present KOLOMVERSE, an open large-scale image dataset for object detection in the maritime domain by KRISO.
We collected 5,845 hours of video data captured from 21 territorial waters of South Korea.
The dataset has images of 3840$times$2160 pixels and to our knowledge, it is by far the largest publicly available dataset for object detection in the maritime domain.
arXiv Detail & Related papers (2022-06-20T16:45:12Z) - SODA10M: Towards Large-Scale Object Detection Benchmark for Autonomous
Driving [94.11868795445798]
We release a Large-Scale Object Detection benchmark for Autonomous driving, named as SODA10M, containing 10 million unlabeled images and 20K images labeled with 6 representative object categories.
To improve diversity, the images are collected every ten seconds per frame within 32 different cities under different weather conditions, periods and location scenes.
We provide extensive experiments and deep analyses of existing supervised state-of-the-art detection models, popular self-supervised and semi-supervised approaches, and some insights about how to develop future models.
arXiv Detail & Related papers (2021-06-21T13:55:57Z) - Perceiving Traffic from Aerial Images [86.994032967469]
We propose an object detection method called Butterfly Detector that is tailored to detect objects in aerial images.
We evaluate our Butterfly Detector on two publicly available UAV datasets (UAVDT and VisDrone 2019) and show that it outperforms previous state-of-the-art methods while remaining real-time.
arXiv Detail & Related papers (2020-09-16T11:37:43Z) - Occupancy Anticipation for Efficient Exploration and Navigation [97.17517060585875]
We propose occupancy anticipation, where the agent uses its egocentric RGB-D observations to infer the occupancy state beyond the visible regions.
By exploiting context in both the egocentric views and top-down maps our model successfully anticipates a broader map of the environment.
Our approach is the winning entry in the 2020 Habitat PointNav Challenge.
arXiv Detail & Related papers (2020-08-21T03:16:51Z) - FathomNet: An underwater image training database for ocean exploration
and discovery [0.0]
FathomNet is a novel baseline image training set optimized to accelerate development of modern, intelligent, and automated analysis of underwater imagery.
To date, there are more than 80,000 images and 106,000 localizations for 233 different classes, including midwater and benthic organisms.
While we find quality results on prediction for this new dataset, our results indicate that we are ultimately in need of a larger data set for ocean exploration.
arXiv Detail & Related papers (2020-06-30T21:23:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.