A Lightweight Target-Driven Network of Stereo Matching for Inland Waterways

• URL: http://arxiv.org/abs/2410.07915v1
• Date: Thu, 10 Oct 2024 13:40:30 GMT
• Title: A Lightweight Target-Driven Network of Stereo Matching for Inland Waterways
• Abstract summary: LTNet is a lightweight target-driven stereo matching neural network. In experiments on two datasets, LTNet achieves competitive results, with only 3.7M parameters.
• Score: 24.432957277833562
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Stereo matching for inland waterways is one of the key technologies for the autonomous navigation of Unmanned Surface Vehicles (USVs), which involves dividing the stereo images into reference images and target images for pixel-level matching. However, due to the challenges of the inland waterway environment, such as blurred textures, large spatial scales, and computational resource constraints of the USVs platform, the participation of geometric features from the target image is required for efficient target-driven matching. Based on this target-driven concept, we propose a lightweight target-driven stereo matching neural network, named LTNet. Specifically, a lightweight and efficient 4D cost volume, named the Geometry Target Volume (GTV), is designed to fully utilize the geometric information of target features by employing the shifted target features as the filtered feature volume. Subsequently, to address the substantial texture interference and object occlusions present in the waterway environment, a Left-Right Consistency Refinement (LRR) module is proposed. The \text{LRR} utilizes the pixel-level differences in left and right disparities to introduce soft constraints, thereby enhancing the accuracy of predictions during the intermediate stages of the network. Moreover, knowledge distillation is utilized to enhance the generalization capability of lightweight models on the USVInland dataset. Furthermore, a new large-scale benchmark, named Spring, is utilized to validate the applicability of LTNet across various scenarios. In experiments on the aforementioned two datasets, LTNet achieves competitive results, with only 3.7M parameters. The code is available at https://github.com/Open-YiQingZhou/LTNet .

Related papers

• LightAVSeg: Lightweight Audio-Visual Segmentation [67.18006751024687]
  LightAVSeg replaces heavy attention with a decoupled design for semantic filtering and spatial grounding.<n>Experiments demonstrate it achieves a new state-of-the-art among lightweight methods.<n>It reaches 50.4 mIoU on the MS3 benchmark and enables efficient inference on a mobile processor.
  arXiv  Detail & Related papers  (2026-05-09T08:47:54Z)
• SFFNet: Synergistic Feature Fusion Network With Dual-Domain Edge Enhancement for UAV Image Object Detection [25.963089047314963]
  Object detection in unmanned aerial vehicle (UAV) images remains a highly challenging task.<n>We have developed a synergistic feature fusion network (SFFNet) with dual-domain edge enhancement specifically tailored for object detection in UAV images.<n> Experiments on two challenging aerial datasets demonstrate the outstanding performance of SFFNet-X.
  arXiv  Detail & Related papers  (2026-04-03T16:52:49Z)
• GAPNet: A Lightweight Framework for Image and Video Salient Object Detection via Granularity-Aware Paradigm [19.018378225862474]
  GAPNet is a lightweight network built on the granularity-aware paradigm for both image and video object detection.<n>Our decoder is built with granularity-aware connections which fuse high-level features of low granularity and low-level features of high granularity.<n>On top of the encoder, a self-attention module is built to learn global information, enabling accurate object localization with negligible computational cost.
  arXiv  Detail & Related papers  (2025-08-11T03:30:59Z)
• DISTA-Net: Dynamic Closely-Spaced Infrared Small Target Unmixing [55.366556355538954]
  We propose the Dynamic Iterative Shrinkage Thresholding Network (DISTA-Net), which reconceptualizes traditional sparse reconstruction within a dynamic framework.<n>DISTA-Net is the first deep learning model designed specifically for the unmixing of closely-spaced infrared small targets.<n>We have established the first open-source ecosystem to foster further research in this field.
  arXiv  Detail & Related papers  (2025-05-25T13:52:00Z)
• Low-Level Matters: An Efficient Hybrid Architecture for Robust Multi-frame Infrared Small Target Detection [5.048364655933007]
  Multi-frame infrared small target detection plays a crucial role in low-altitude and maritime surveillance. The hybrid architecture combining CNNs and Transformers shows great promise for enhancing multi-frame IRSTD. We propose LVNet, a simple yet powerful hybrid architecture that redefines low-level feature learning hybrid frameworks.
  arXiv  Detail & Related papers  (2025-03-04T02:53:25Z)
• UL-VIO: Ultra-lightweight Visual-Inertial Odometry with Noise Robust Test-time Adaptation [12.511829774226113]
  We propose an ultra-lightweight (1M) visual-inertial odometry (VIO) network capable of test-time adaptation (TTA) based on visual-inertial consistency. It achieves 36X smaller network size than state-of-the-art with a minute increase in error -- 1% on the KITTI dataset.
  arXiv  Detail & Related papers  (2024-09-19T22:24:14Z)
• ELGC-Net: Efficient Local-Global Context Aggregation for Remote Sensing Change Detection [65.59969454655996]
  We propose an efficient change detection framework, ELGC-Net, which leverages rich contextual information to precisely estimate change regions. Our proposed ELGC-Net sets a new state-of-the-art performance in remote sensing change detection benchmarks. We also introduce ELGC-Net-LW, a lighter variant with significantly reduced computational complexity, suitable for resource-constrained settings.
  arXiv  Detail & Related papers  (2024-03-26T17:46:25Z)
• HEAL-SWIN: A Vision Transformer On The Sphere [4.379414115481346]
  High-resolution wide-angle fisheye images are becoming more important for robotics applications such as autonomous driving. We introduce the HEAL-SWIN transformer, which combines the highly uniform Hierarchical Equal Area iso-Latitude Pixelation grid used in astrophysics and cosmology. In HEAL-SWIN, the nested structure of the HEALPix grid is used to perform the patching and windowing operations of the SWIN transformer, enabling the network to process spherical representations with minimal computational overhead.
  arXiv  Detail & Related papers  (2023-07-14T12:46:59Z)
• Progressive Meta-Pooling Learning for Lightweight Image Classification Model [20.076610051602618]
  We propose the Meta-Pooling framework to make the receptive field learnable for a lightweight network. We present a Progressive Meta-Pooling Learning (PMPL) strategy for the parameterized spatial enhancer to acquire a suitable receptive field size. The results on the ImageNet dataset demonstrate that MobileNetV2 using Meta-Pooling achieves top1 accuracy of 74.6%, which outperforms MobileNetV2 by 2.3%.
  arXiv  Detail & Related papers  (2023-01-24T14:28:05Z)
• Lightweight Salient Object Detection in Optical Remote-Sensing Images via Semantic Matching and Edge Alignment [61.45639694373033]
  We propose a novel lightweight network for optical remote sensing images (ORSI-SOD) based on semantic matching and edge alignment, termed SeaNet. Specifically, SeaNet includes a lightweight MobileNet-V2 for feature extraction, a dynamic semantic matching module (DSMM) for high-level features, and a portable decoder for inference.
  arXiv  Detail & Related papers  (2023-01-07T04:33:51Z)
• Content-aware Warping for View Synthesis [110.54435867693203]
  We propose content-aware warping, which adaptively learns the weights for pixels of a relatively large neighborhood from their contextual information via a lightweight neural network. Based on this learnable warping module, we propose a new end-to-end learning-based framework for novel view synthesis from two source views. Experimental results on structured light field datasets with wide baselines and unstructured multi-view datasets show that the proposed method significantly outperforms state-of-the-art methods both quantitatively and visually.
  arXiv  Detail & Related papers  (2022-01-22T11:35:05Z)
• Location-Sensitive Visual Recognition with Cross-IOU Loss [177.86369890708457]
  This paper proposes a unified solution named location-sensitive network (LSNet) for object detection, instance segmentation, and pose estimation. Based on a deep neural network as the backbone, LSNet predicts an anchor point and a set of landmarks which together define the shape of the target object.
  arXiv  Detail & Related papers  (2021-04-11T02:17:14Z)
• PLADE-Net: Towards Pixel-Level Accuracy for Self-Supervised Single-View Depth Estimation with Neural Positional Encoding and Distilled Matting Loss [49.66736599668501]
  We propose a self-supervised single-view pixel-level accurate depth estimation network, called PLADE-Net. Our method shows unprecedented accuracy levels, exceeding 95% in terms of the $delta1$ metric on the KITTI dataset.
  arXiv  Detail & Related papers  (2021-03-12T15:54:46Z)
• A Parallel Down-Up Fusion Network for Salient Object Detection in Optical Remote Sensing Images [82.87122287748791]
  We propose a novel Parallel Down-up Fusion network (PDF-Net) for salient object detection in optical remote sensing images (RSIs) It takes full advantage of the in-path low- and high-level features and cross-path multi-resolution features to distinguish diversely scaled salient objects and suppress the cluttered backgrounds. Experiments on the ORSSD dataset demonstrate that the proposed network is superior to the state-of-the-art approaches both qualitatively and quantitatively.
  arXiv  Detail & Related papers  (2020-10-02T05:27:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.