GAMMA: Generative Augmentation for Attentive Marine Debris Detection
- URL: http://arxiv.org/abs/2212.03759v1
- Date: Wed, 7 Dec 2022 16:30:51 GMT
- Title: GAMMA: Generative Augmentation for Attentive Marine Debris Detection
- Authors: Vaishnavi Khindkar, Janhavi Khindkar
- Abstract summary: We propose an efficient and generative augmentation approach to solve the inadequacy concern of underwater debris data for visual detection.
We use cycleGAN as a data augmentation technique to convert openly available, abundant data of terrestrial plastic to underwater-style images.
We also propose a novel architecture for underwater debris detection using an attention mechanism.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We propose an efficient and generative augmentation approach to solve the
inadequacy concern of underwater debris data for visual detection. We use
cycleGAN as a data augmentation technique to convert openly available, abundant
data of terrestrial plastic to underwater-style images. Prior works just focus
on augmenting or enhancing existing data, which moreover adds bias to the
dataset. Compared to our technique, which devises variation, transforming
additional in-air plastic data to the marine background. We also propose a
novel architecture for underwater debris detection using an attention
mechanism. Our method helps to focus only on relevant instances of the image,
thereby enhancing the detector performance, which is highly obliged while
detecting the marine debris using Autonomous Underwater Vehicle (AUV). We
perform extensive experiments for marine debris detection using our approach.
Quantitative and qualitative results demonstrate the potential of our framework
that significantly outperforms the state-of-the-art methods.
Related papers
- Separated Attention: An Improved Cycle GAN Based Under Water Image Enhancement Method [0.0]
We have utilized the cycle consistent learning technique of the state-of-the-art Cycle GAN model with modification in the loss function.
We trained the Cycle GAN model with the modified loss functions on the benchmarked Enhancing Underwater Visual Perception dataset.
The upgraded images provide better results from conventional models and further for under water navigation, pose estimation, saliency prediction, object detection and tracking.
arXiv Detail & Related papers (2024-04-11T11:12:06Z) - Improving Underwater Visual Tracking With a Large Scale Dataset and
Image Enhancement [70.2429155741593]
This paper presents a new dataset and general tracker enhancement method for Underwater Visual Object Tracking (UVOT)
It poses distinct challenges; the underwater environment exhibits non-uniform lighting conditions, low visibility, lack of sharpness, low contrast, camouflage, and reflections from suspended particles.
We propose a novel underwater image enhancement algorithm designed specifically to boost tracking quality.
The method has resulted in a significant performance improvement, of up to 5.0% AUC, of state-of-the-art (SOTA) visual trackers.
arXiv Detail & Related papers (2023-08-30T07:41:26Z) - Learning Heavily-Degraded Prior for Underwater Object Detection [59.5084433933765]
This paper seeks transferable prior knowledge from detector-friendly images.
It is based on statistical observations that, the heavily degraded regions of detector-friendly (DFUI) and underwater images have evident feature distribution gaps.
Our method with higher speeds and less parameters still performs better than transformer-based detectors.
arXiv Detail & Related papers (2023-08-24T12:32:46Z) - Efficient Real-time Smoke Filtration with 3D LiDAR for Search and Rescue
with Autonomous Heterogeneous Robotic Systems [56.838297900091426]
Smoke and dust affect the performance of any mobile robotic platform due to their reliance on onboard perception systems.
This paper proposes a novel modular computation filtration pipeline based on intensity and spatial information.
arXiv Detail & Related papers (2023-08-14T16:48:57Z) - WaterFlow: Heuristic Normalizing Flow for Underwater Image Enhancement
and Beyond [52.27796682972484]
Existing underwater image enhancement methods mainly focus on image quality improvement, ignoring the effect on practice.
We propose a normalizing flow for detection-driven underwater image enhancement, dubbed WaterFlow.
Considering the differentiability and interpretability, we incorporate the prior into the data-driven mapping procedure.
arXiv Detail & Related papers (2023-08-02T04:17:35Z) - Spectral Analysis of Marine Debris in Simulated and Observed
Sentinel-2/MSI Images using Unsupervised Classification [0.0]
This study uses Radiative Transfer Model (RTM) simulated data and data from the Multispectral Instrument (MSI) of the Sentinel-2 mission in combination with machine learning algorithms.
The results indicate that the spectral behavior of pollutants is influenced by factors such as the type of polymer and pixel coverage percentage.
These insights can guide future research in remote sensing applications for detecting marine plastic pollution.
arXiv Detail & Related papers (2023-06-26T18:46:47Z) - PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN with
Dual-Discriminators [120.06891448820447]
How to obtain clear and visually pleasant images has become a common concern of people.
The task of underwater image enhancement (UIE) has also emerged as the times require.
In this paper, we propose a physical model-guided GAN model for UIE, referred to as PUGAN.
Our PUGAN outperforms state-of-the-art methods in both qualitative and quantitative metrics.
arXiv Detail & Related papers (2023-06-15T07:41:12Z) - Learning-based estimation of in-situ wind speed from underwater
acoustics [58.293528982012255]
We introduce a deep learning approach for the retrieval of wind speed time series from underwater acoustics.
Our approach bridges data assimilation and learning-based frameworks to benefit both from prior physical knowledge and computational efficiency.
arXiv Detail & Related papers (2022-08-18T15:27:40Z) - A Generative Approach for Detection-driven Underwater Image Enhancement [19.957923413999673]
We present a model that integrates generative adversarial network (GAN)-based image enhancement with diver detection task.
Our proposed approach restructures the GAN objective function to include information from a pre-trained diver detector.
We train our network on a large dataset of scuba divers, using a state-of-the-art diver detector, and demonstrate its utility on images collected from oceanic explorations.
arXiv Detail & Related papers (2020-12-10T21:33:12Z) - Perceptual underwater image enhancement with deep learning and physical
priors [35.37760003463292]
We propose two perceptual enhancement models, each of which uses a deep enhancement model with a detection perceptor.
Due to the lack of training data, a hybrid underwater image synthesis model, which fuses physical priors and data-driven cues, is proposed to synthesize training data.
Experimental results show the superiority of our proposed method over several state-of-the-art methods on both real-world and synthetic underwater datasets.
arXiv Detail & Related papers (2020-08-21T22:11:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.