Search and Rescue with Airborne Optical Sectioning
- URL: http://arxiv.org/abs/2009.08835v1
- Date: Fri, 18 Sep 2020 13:40:19 GMT
- Title: Search and Rescue with Airborne Optical Sectioning
- Authors: David C. Schedl and Indrajit Kurmi and Oliver Bimber
- Abstract summary: We show that automated person detection can be significantly improved by combining multi-perspective images before classification.
Findings lay the foundation for effective future search and rescue technologies that can be applied in combination with autonomous or manned aircraft.
- Score: 7.133136338850781
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We show that automated person detection under occlusion conditions can be
significantly improved by combining multi-perspective images before
classification. Here, we employed image integration by Airborne Optical
Sectioning (AOS)---a synthetic aperture imaging technique that uses camera
drones to capture unstructured thermal light fields---to achieve this with a
precision/recall of 96/93%. Finding lost or injured people in dense forests is
not generally feasible with thermal recordings, but becomes practical with use
of AOS integral images. Our findings lay the foundation for effective future
search and rescue technologies that can be applied in combination with
autonomous or manned aircraft. They can also be beneficial for other fields
that currently suffer from inaccurate classification of partially occluded
people, animals, or objects.
Related papers
- Learning Heavily-Degraded Prior for Underwater Object Detection [59.5084433933765]
This paper seeks transferable prior knowledge from detector-friendly images.
It is based on statistical observations that, the heavily degraded regions of detector-friendly (DFUI) and underwater images have evident feature distribution gaps.
Our method with higher speeds and less parameters still performs better than transformer-based detectors.
arXiv Detail & Related papers (2023-08-24T12:32:46Z) - CarPatch: A Synthetic Benchmark for Radiance Field Evaluation on Vehicle
Components [77.33782775860028]
We introduce CarPatch, a novel synthetic benchmark of vehicles.
In addition to a set of images annotated with their intrinsic and extrinsic camera parameters, the corresponding depth maps and semantic segmentation masks have been generated for each view.
Global and part-based metrics have been defined and used to evaluate, compare, and better characterize some state-of-the-art techniques.
arXiv Detail & Related papers (2023-07-24T11:59:07Z) - ScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural
Rendering [83.75284107397003]
We introduce ScatterNeRF, a neural rendering method which renders scenes and decomposes the fog-free background.
We propose a disentangled representation for the scattering volume and the scene objects, and learn the scene reconstruction with physics-inspired losses.
We validate our method by capturing multi-view In-the-Wild data and controlled captures in a large-scale fog chamber.
arXiv Detail & Related papers (2023-05-03T13:24:06Z) - Synthetic Aperture Anomaly Imaging [2.9443230571766854]
We show that integrating detected anomalies is even more effective than detecting anomalies in integrals.
We present a real-time application that makes our findings practically available for blue-light organizations and others using commercial drone platforms.
arXiv Detail & Related papers (2023-04-26T14:34:43Z) - Inverse Airborne Optical Sectioning [4.640835690336653]
Inverse Airborne Optical Sectioning (IAOS) is an optical analogy to Inverse Synthetic Aperture Radar (ISAR)
Moving targets, such as walking people, that are heavily occluded by vegetation can be made visible and tracked with a stationary optical sensor.
arXiv Detail & Related papers (2022-07-27T07:57:24Z) - Drone Detection and Tracking in Real-Time by Fusion of Different Sensing
Modalities [66.4525391417921]
We design and evaluate a multi-sensor drone detection system.
Our solution integrates a fish-eye camera as well to monitor a wider part of the sky and steer the other cameras towards objects of interest.
The thermal camera is shown to be a feasible solution as good as the video camera, even if the camera employed here has a lower resolution.
arXiv Detail & Related papers (2022-07-05T10:00:58Z) - On the Role of Field of View for Occlusion Removal with Airborne Optical
Sectioning [3.5232085374661284]
Occlusion caused by vegetation is an essential problem for remote sensing applications in areas.
Airborne Optical Sectioning (AOS) is an optical, wavelength-independent synthetic aperture imaging technique.
We demonstrate a relationship between forest density and field of view (FOV) of applied imaging systems.
arXiv Detail & Related papers (2022-04-28T09:26:10Z) - Through-Foliage Tracking with Airborne Optical Sectioning [1.8352113484137622]
We present an initial light-weight and drone-operated 1D camera array that supports parallel synthetic aperture aerial imaging.
We demonstrate, that these two contributions can lead to the detection and tracking of moving people through densely occluding forest.
arXiv Detail & Related papers (2021-11-12T21:54:25Z) - Combined Person Classification with Airborne Optical Sectioning [1.8352113484137622]
Fully autonomous drones have been demonstrated to find lost or injured persons under strongly occluding forest canopy.
Airborne Optical Sectioning (AOS), a novel synthetic aperture imaging technique, together with deep-learning-based classification enables high detection rates under realistic search-and-rescue conditions.
We demonstrate that false detections can be significantly suppressed and true detections boosted by combining classifications from multiple AOS rather than single integral images.
arXiv Detail & Related papers (2021-06-18T11:56:17Z) - Stereo Matching by Self-supervision of Multiscopic Vision [65.38359887232025]
We propose a new self-supervised framework for stereo matching utilizing multiple images captured at aligned camera positions.
A cross photometric loss, an uncertainty-aware mutual-supervision loss, and a new smoothness loss are introduced to optimize the network.
Our model obtains better disparity maps than previous unsupervised methods on the KITTI dataset.
arXiv Detail & Related papers (2021-04-09T02:58:59Z) - Exploring Thermal Images for Object Detection in Underexposure Regions
for Autonomous Driving [67.69430435482127]
Underexposure regions are vital to construct a complete perception of the surroundings for safe autonomous driving.
The availability of thermal cameras has provided an essential alternate to explore regions where other optical sensors lack in capturing interpretable signals.
This work proposes a domain adaptation framework which employs a style transfer technique for transfer learning from visible spectrum images to thermal images.
arXiv Detail & Related papers (2020-06-01T09:59:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.