AdaStereo: A Simple and Efficient Approach for Adaptive Stereo Matching
- URL: http://arxiv.org/abs/2004.04627v3
- Date: Sat, 27 Mar 2021 03:40:13 GMT
- Title: AdaStereo: A Simple and Efficient Approach for Adaptive Stereo Matching
- Authors: Xiao Song, Guorun Yang, Xinge Zhu, Hui Zhou, Zhe Wang, Jianping Shi
- Abstract summary: A novel domain-adaptive pipeline called AdaStereo aims to align multi-level representations for deep stereo matching networks.
Our AdaStereo models achieve state-of-the-art cross-domain performance on multiple stereo benchmarks, including KITTI, Middlebury, ETH3D, and DrivingStereo.
- Score: 50.06646151004375
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Recently, records on stereo matching benchmarks are constantly broken by
end-to-end disparity networks. However, the domain adaptation ability of these
deep models is quite poor. Addressing such problem, we present a novel
domain-adaptive pipeline called AdaStereo that aims to align multi-level
representations for deep stereo matching networks. Compared to previous methods
for adaptive stereo matching, our AdaStereo realizes a more standard, complete
and effective domain adaptation pipeline. Firstly, we propose a non-adversarial
progressive color transfer algorithm for input image-level alignment. Secondly,
we design an efficient parameter-free cost normalization layer for internal
feature-level alignment. Lastly, a highly related auxiliary task,
self-supervised occlusion-aware reconstruction is presented to narrow down the
gaps in output space. Our AdaStereo models achieve state-of-the-art
cross-domain performance on multiple stereo benchmarks, including KITTI,
Middlebury, ETH3D, and DrivingStereo, even outperforming disparity networks
finetuned with target-domain ground-truths.
Related papers
- SR-Stereo & DAPE: Stepwise Regression and Pre-trained Edges for Practical Stereo Matching [2.8908326904081334]
We propose a novel stepwise regression architecture to overcome domain discrepancies.
To enhance the edge awareness of models adapting new domains with sparse ground truth, we propose Domain Adaptation based on Pre-trained Edges (DAPE)
The proposed SR-Stereo and DAPE are extensively evaluated on SceneFlow, KITTI, Middbury 2014 and ETH3D.
arXiv Detail & Related papers (2024-06-11T05:25:25Z) - RomniStereo: Recurrent Omnidirectional Stereo Matching [6.153793254880079]
We propose a recurrent omnidirectional stereo matching (RomniStereo) algorithm.
Our best model improves the average MAE metric by 40.7% over the previous SOTA baseline.
When visualizing the results, our models demonstrate clear advantages on both synthetic and realistic examples.
arXiv Detail & Related papers (2024-01-09T04:06:01Z) - Uncertainty Guided Adaptive Warping for Robust and Efficient Stereo
Matching [77.133400999703]
Correlation based stereo matching has achieved outstanding performance.
Current methods with a fixed model do not work uniformly well across various datasets.
This paper proposes a new perspective to dynamically calculate correlation for robust stereo matching.
arXiv Detail & Related papers (2023-07-26T09:47:37Z) - PointFix: Learning to Fix Domain Bias for Robust Online Stereo
Adaptation [67.41325356479229]
We propose to incorporate an auxiliary point-selective network into a meta-learning framework, called PointFix.
In a nutshell, our auxiliary network learns to fix local variants intensively by effectively back-propagating local information through the meta-gradient.
This network is model-agnostic, so can be used in any kind of architectures in a plug-and-play manner.
arXiv Detail & Related papers (2022-07-27T07:48:29Z) - Revisiting Domain Generalized Stereo Matching Networks from a Feature
Consistency Perspective [65.37571681370096]
We propose a simple pixel-wise contrastive learning across the viewpoints.
A stereo selective whitening loss is introduced to better preserve the stereo feature consistency across domains.
Our method achieves superior performance over several state-of-the-art networks.
arXiv Detail & Related papers (2022-03-21T11:21:41Z) - AdaStereo: An Efficient Domain-Adaptive Stereo Matching Approach [50.855679274530615]
We present a novel domain-adaptive approach called AdaStereo to align multi-level representations for deep stereo matching networks.
Our models achieve state-of-the-art cross-domain performance on multiple benchmarks, including KITTI, Middlebury, ETH3D and DrivingStereo.
Our method is robust to various domain adaptation settings, and can be easily integrated into quick adaptation application scenarios and real-world deployments.
arXiv Detail & Related papers (2021-12-09T15:10:47Z) - Continual Adaptation for Deep Stereo [52.181067640300014]
We propose a continual adaptation paradigm for deep stereo networks designed to deal with challenging and ever-changing environments.
In our paradigm, the learning signals needed to continuously adapt models online can be sourced from self-supervision via right-to-left image warping or from traditional stereo algorithms.
Our network architecture and adaptation algorithms realize the first real-time self-adaptive deep stereo system.
arXiv Detail & Related papers (2020-07-10T08:15:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.