UMono: Physical Model Informed Hybrid CNN-Transformer Framework for Underwater Monocular Depth Estimation

• URL: http://arxiv.org/abs/2407.17838v1
• Date: Thu, 25 Jul 2024 07:52:11 GMT
• Title: UMono: Physical Model Informed Hybrid CNN-Transformer Framework for Underwater Monocular Depth Estimation
• Authors: Jian Wang, Jing Wang, Shenghui Rong, Bo He,
• Abstract summary: Underwater monocular depth estimation serves as the foundation for tasks such as 3D reconstruction of underwater scenes. Existing methods fail to consider the unique characteristics of underwater environments. In this paper, an end-to-end learning framework for underwater monocular depth estimation called UMono is presented.
• Score: 5.596432047035205
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Underwater monocular depth estimation serves as the foundation for tasks such as 3D reconstruction of underwater scenes. However, due to the influence of light and medium, the underwater environment undergoes a distinctive imaging process, which presents challenges in accurately estimating depth from a single image. The existing methods fail to consider the unique characteristics of underwater environments, leading to inadequate estimation results and limited generalization performance. Furthermore, underwater depth estimation requires extracting and fusing both local and global features, which is not fully explored in existing methods. In this paper, an end-to-end learning framework for underwater monocular depth estimation called UMono is presented, which incorporates underwater image formation model characteristics into network architecture, and effectively utilize both local and global features of underwater image. Experimental results demonstrate that the proposed method is effective for underwater monocular depth estimation and outperforms the existing methods in both quantitative and qualitative analyses.

Related papers

• UW-SDF: Exploiting Hybrid Geometric Priors for Neural SDF Reconstruction from Underwater Multi-view Monocular Images [63.32490897641344]
  We propose a framework for reconstructing target objects from multi-view underwater images based on neural SDF. We introduce hybrid geometric priors to optimize the reconstruction process, markedly enhancing the quality and efficiency of neural SDF reconstruction.
  arXiv  Detail & Related papers  (2024-10-10T16:33:56Z)
• FAFA: Frequency-Aware Flow-Aided Self-Supervision for Underwater Object Pose Estimation [65.01601309903971]
  We introduce FAFA, a Frequency-Aware Flow-Aided self-supervised framework for 6D pose estimation of unmanned underwater vehicles (UUVs) Our framework relies solely on the 3D model and RGB images, alleviating the need for any real pose annotations or other-modality data like depths. We evaluate the effectiveness of FAFA on common underwater object pose benchmarks and showcase significant performance improvements compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-09-25T03:54:01Z)
• ScaleDepth: Decomposing Metric Depth Estimation into Scale Prediction and Relative Depth Estimation [62.600382533322325]
  We propose a novel monocular depth estimation method called ScaleDepth. Our method decomposes metric depth into scene scale and relative depth, and predicts them through a semantic-aware scale prediction module. Our method achieves metric depth estimation for both indoor and outdoor scenes in a unified framework.
  arXiv  Detail & Related papers  (2024-07-11T05:11:56Z)
• A Physical Model-Guided Framework for Underwater Image Enhancement and Depth Estimation [19.204227769408725]
  Existing underwater image enhancement approaches fail to accurately estimate imaging model parameters such as depth and veiling light. We propose a model-guided framework for jointly training a Deep Degradation Model with any advanced UIE model. Our framework achieves remarkable enhancement results across diverse underwater scenes.
  arXiv  Detail & Related papers  (2024-07-05T03:10:13Z)
• WaterMono: Teacher-Guided Anomaly Masking and Enhancement Boosting for Robust Underwater Self-Supervised Monocular Depth Estimation [4.909989222186828]
  We propose WaterMono, a novel framework for depth estimation and image enhancement. It incorporates the following key measures: (1) We present a Teacher-Guided Anomaly Mask to identify dynamic regions within the images; (2) We employ depth information combined with the Underwater Image Formation Model to generate enhanced images, which in turn contribute to the depth estimation task; and (3) We utilize a rotated distillation strategy to enhance the model's rotational robustness.
  arXiv  Detail & Related papers  (2024-06-19T08:49:45Z)
• Atlantis: Enabling Underwater Depth Estimation with Stable Diffusion [30.122666238416716]
  We propose a novel pipeline for generating underwater images using accurate terrestrial depth data. This approach facilitates the training of supervised models for underwater depth estimation. We introduce a unique Depth2Underwater ControlNet, trained on specially prepared Underwater, Depth, Text data triplets.
  arXiv  Detail & Related papers  (2023-12-19T08:56:33Z)
• PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN with Dual-Discriminators [120.06891448820447]
  How to obtain clear and visually pleasant images has become a common concern of people. The task of underwater image enhancement (UIE) has also emerged as the times require. In this paper, we propose a physical model-guided GAN model for UIE, referred to as PUGAN. Our PUGAN outperforms state-of-the-art methods in both qualitative and quantitative metrics.
  arXiv  Detail & Related papers  (2023-06-15T07:41:12Z)
• WaterNeRF: Neural Radiance Fields for Underwater Scenes [6.161668246821327]
  We advance state-of-the-art in neural radiance fields (NeRFs) to enable physics-informed dense depth estimation and color correction. Our proposed method, WaterNeRF, estimates parameters of a physics-based model for underwater image formation. We can produce novel views of degraded as well as corrected underwater images, along with dense depth of the scene.
  arXiv  Detail & Related papers  (2022-09-27T00:53:26Z)
• Adversarial Domain Feature Adaptation for Bronchoscopic Depth Estimation [111.89519571205778]
  In this work, we propose an alternative domain-adaptive approach to depth estimation. Our novel two-step structure first trains a depth estimation network with labeled synthetic images in a supervised manner. The results of our experiments show that the proposed method improves the network's performance on real images by a considerable margin.
  arXiv  Detail & Related papers  (2021-09-24T08:11:34Z)
• Underwater Image Restoration via Contrastive Learning and a Real-world Dataset [59.35766392100753]
  We present a novel method for underwater image restoration based on unsupervised image-to-image translation framework. Our proposed method leveraged contrastive learning and generative adversarial networks to maximize the mutual information between raw and restored images.
  arXiv  Detail & Related papers  (2021-06-20T16:06:26Z)
• Domain Adaptive Adversarial Learning Based on Physics Model Feedback for Underwater Image Enhancement [10.143025577499039]
  We propose a new robust adversarial learning framework via physics model based feedback control and domain adaptation mechanism for enhancing underwater images. A new method for simulating underwater-like training dataset from RGB-D data by underwater image formation model is proposed. Final enhanced results on synthetic and real underwater images demonstrate the superiority of the proposed method.
  arXiv  Detail & Related papers  (2020-02-20T07:50:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.