LiteMatch: Lightweight Zero-Shot Stereo Matching via Cost Volume Stabilization
- URL: http://arxiv.org/abs/2606.31636v1
- Date: Tue, 30 Jun 2026 13:20:08 GMT
- Title: LiteMatch: Lightweight Zero-Shot Stereo Matching via Cost Volume Stabilization
- Abstract summary: We present textitLiteMatch, a lightweight stereo matching framework that achieves strong zero-shot generalization without expensive 3D convolutions.<n>LiteMatch employs two complementary encoders: a Cross-View Correspondence (CVCE) to capture global cross-view interactions, and a High-Frequency Driving (HFE) that enhances fine structural details via FFT-based frequency cues.<n>With a flexible design ranging from 3.36M to 9.58M parameters, LiteMatch achieves exceptional zero-shot generalization, delivering competitive EPE and D1 performance across Scene Flow, KITTI, Middlebury, ETH3D
- Score: 21.209111801863546
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Despite rapid progress in learning-based stereo matching, high accuracy is often achieved at the cost of heavy backbones and computationally intensive 3D cost volume processing, resulting in substantial memory and runtime overhead. More critically, these methods frequently struggle to generalize across domains, limiting their practical deployment. We present \textit{LiteMatch}, a lightweight stereo matching framework that achieves strong zero-shot generalization through cost volume stabilization-without expensive 3D convolutions. LiteMatch employs two complementary encoders: a Cross-View Correspondence Encoder (CVCE) to capture global cross-view interactions, and a High-Frequency Encoder (HFE) that enhances fine structural details via FFT-based frequency cues. To stabilize the cost volume, we introduce the \textit{Cost Volume Consistency Loss (CVC-Loss)}, a voxel-wise binary cross-entropy objective applied to softmax-normalized cost distributions. By encouraging sharp and unimodal disparity probabilities, CVC-Loss promotes stable cost distributions and enables rapid convergence. A lightweight refinement module further produces sharp full-resolution disparities with low-iteration updates, avoiding heavy recurrent refinement. With a flexible design ranging from 3.36M to 9.58M parameters, LiteMatch achieves exceptional zero-shot generalization, delivering competitive EPE and D1 performance across Scene Flow, KITTI, Middlebury, ETH3D, and DrivingStereo. Our results establish that lightweight architectures can indeed generalize across domains without sacrificing accuracy. \href{https://mdraqibkhan.github.io/Litematch}{\textcolor{blue}{Code}}
Related papers
- Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching [96.63979376005277]
Lite Any Stereo V2 is an ultra-fast model series designed for efficient zero-shot stereo matching.<n>LAS2 is developed from both architecture and training perspectives.<n>LAS2-H achieves stronger overall zero-shot performance than the iterative method Fast-FoundationStereo.
arXiv Detail & Related papers (2026-06-23T11:45:09Z) - LightAVSeg: Lightweight Audio-Visual Segmentation [67.18006751024687]
LightAVSeg replaces heavy attention with a decoupled design for semantic filtering and spatial grounding.<n>Experiments demonstrate it achieves a new state-of-the-art among lightweight methods.<n>It reaches 50.4 mIoU on the MS3 benchmark and enables efficient inference on a mobile processor.
arXiv Detail & Related papers (2026-05-09T08:47:54Z) - $D^3$-RSMDE: 40$\times$ Faster and High-Fidelity Remote Sensing Monocular Depth Estimation [72.9912717963138]
Real-time, high-fidelity monocular depth estimation from remote sensing imagery is crucial for numerous applications.<n>Although using Vision Transformer (ViT) backbones for dense prediction is fast, they often exhibit poor perceptual quality.<n>We propose Depth Detail Diffusion for Remote Sensing Monocular Depth Estimation ($D3$-RSMDE) to overcome these limitations.<n>$D3$-RSMDE achieves a notable 11.85% reduction in the Learned Perceptual Image Patch Similarity (LPIPS) perceptual metric.
arXiv Detail & Related papers (2026-03-17T10:50:36Z) - Cost-Aware Contrastive Routing for LLMs [57.30288453580456]
We introduce Cost-Spectrum Contrastive Routing (CSCR), a lightweight framework that maps both prompts and models into a shared embedding space.<n>CSCR consistently outperforms baselines, improving the accuracy-cost tradeoff by up to 25%.
arXiv Detail & Related papers (2025-08-17T20:16:44Z) - ESMStereo: Enhanced ShuffleMixer Disparity Upsampling for Real-Time and Accurate Stereo Matching [0.0]
We propose the Enhanced Shuffle Mixer (ESM) to mitigate information loss associated with small-scale cost volumes.<n>ESM restores critical details by integrating primary features into the disparity upsampling unit.<n> compact version of ESMStereo achieves an inference speed of 116 FPS on high-end GPUs and 91 FPS on the AGX Orin.
arXiv Detail & Related papers (2025-06-26T08:34:51Z) - LightStereo: Channel Boost Is All You Need for Efficient 2D Cost Aggregation [27.00836175513738]
LightStereo is a cutting-edge stereo-matching network crafted to accelerate the matching process.<n>Our breakthrough lies in enhancing performance through a dedicated focus on the channel dimension of the 3D cost volume.<n>LightStereo achieves a competitive EPE metric in the SceneFlow datasets while demanding a minimum of only 22 GFLOPs and 17 ms of runtime.
arXiv Detail & Related papers (2024-06-28T11:11:24Z) - Accurate and Efficient Stereo Matching via Attention Concatenation
Volume [33.615312186946866]
We present a novel cost volume construction method, named attention concatenation volume (ACV)
ACV generates attention weights from correlation clues to suppress redundant information and enhance matching-related information in the concatenation volume.
We further design a fast version of ACV to enable real-time performance, named Fast-ACV, which generates high likelihood disparity hypotheses.
arXiv Detail & Related papers (2022-09-23T08:14:30Z) - Correlate-and-Excite: Real-Time Stereo Matching via Guided Cost Volume
Excitation [65.83008812026635]
We construct Guided Cost volume Excitation (GCE) and show that simple channel excitation of cost volume guided by image can improve performance considerably.
We present an end-to-end network that we call Correlate-and-Excite (CoEx)
arXiv Detail & Related papers (2021-08-12T14:32:26Z) - CFNet: Cascade and Fused Cost Volume for Robust Stereo Matching [27.313740022587442]
We propose CFNet, a Cascade and Fused cost volume based network to improve the robustness of the stereo matching network.
We employ a variance-based uncertainty estimation to adaptively adjust the next stage disparity search space.
Our proposed method achieves the state-of-the-art overall performance and obtains the 1st place on the stereo task of Robust Vision Challenge 2020.
arXiv Detail & Related papers (2021-04-09T11:38:59Z) - AANet: Adaptive Aggregation Network for Efficient Stereo Matching [33.39794232337985]
Current state-of-the-art stereo models are mostly based on costly 3D convolutions.
We propose a sparse points based intra-scale cost aggregation method to alleviate the edge-fattening issue.
We also approximate traditional cross-scale cost aggregation algorithm with neural network layers to handle large textureless regions.
arXiv Detail & Related papers (2020-04-20T18:07:55Z) - AdaStereo: A Simple and Efficient Approach for Adaptive Stereo Matching [50.06646151004375]
A novel domain-adaptive pipeline called AdaStereo aims to align multi-level representations for deep stereo matching networks.
Our AdaStereo models achieve state-of-the-art cross-domain performance on multiple stereo benchmarks, including KITTI, Middlebury, ETH3D, and DrivingStereo.
arXiv Detail & Related papers (2020-04-09T16:15:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.