Symmetric Parallax Attention for Stereo Image Super-Resolution

• URL: http://arxiv.org/abs/2011.03802v2
• Date: Tue, 20 Apr 2021 07:37:52 GMT
• Title: Symmetric Parallax Attention for Stereo Image Super-Resolution
• Authors: Yingqian Wang, Xinyi Ying, Longguang Wang, Jungang Yang, Wei An, Yulan Guo
• Abstract summary: We improve the performance of stereo image SR by exploiting symmetry cues in stereo image pairs. We design a Siamese network equipped with a biPAM to super-resolve both sides of views. Experiments on four public datasets demonstrate the superior performance of our method.
• Score: 46.20494593243566
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Although recent years have witnessed the great advances in stereo image super-resolution (SR), the beneficial information provided by binocular systems has not been fully used. Since stereo images are highly symmetric under epipolar constraint, in this paper, we improve the performance of stereo image SR by exploiting symmetry cues in stereo image pairs. Specifically, we propose a symmetric bi-directional parallax attention module (biPAM) and an inline occlusion handling scheme to effectively interact cross-view information. Then, we design a Siamese network equipped with a biPAM to super-resolve both sides of views in a highly symmetric manner. Finally, we design several illuminance-robust losses to enhance stereo consistency. Experiments on four public datasets demonstrate the superior performance of our method. Source code is available at https://github.com/YingqianWang/iPASSR.

Related papers

• Multi-Level Feature Fusion Network for Lightweight Stereo Image Super-Resolution [12.066710423371559]
  We propose an efficient Multi-Level Feature Fusion Network for Lightweight Stereo Image Super-Resolution (MFFSSR) MFFSSR utilizes the Hybrid Attention Feature Extraction Block (HAFEB) to extract multi-level intra-view features. We achieve superior performance with fewer parameters.
  arXiv  Detail & Related papers  (2024-05-09T02:01:51Z)
• PS-Transformer: Learning Sparse Photometric Stereo Network using Self-Attention Mechanism [4.822598110892846]
  Existing deep calibrated photometric stereo networks aggregate observations under different lights based on pre-defined operations such as linear projection and max pooling. To tackle this issue, this paper presents a deep sparse calibrated photometric stereo network named it PS-Transformer which leverages the learnable self-attention mechanism to properly capture the complex inter-image interactions.
  arXiv  Detail & Related papers  (2022-11-21T11:58:25Z)
• Symmetry-Aware Transformer-based Mirror Detection [85.47570468668955]
  We propose a dual-path Symmetry-Aware Transformer-based mirror detection Network (SATNet) SATNet includes two novel modules: Symmetry-Aware Attention Module (SAAM) and Contrast and Fusion Decoder Module (CFDM) Experimental results show that SATNet outperforms both RGB and RGB-D mirror detection methods on all available mirror detection datasets.
  arXiv  Detail & Related papers  (2022-07-13T16:40:01Z)
• Degradation-agnostic Correspondence from Resolution-asymmetric Stereo [96.03964515969652]
  We study the problem of stereo matching from a pair of images with different resolutions, e.g., those acquired with a tele-wide camera system. We propose to impose the consistency between two views in a feature space instead of the image space, named feature-metric consistency. We find that, although a stereo matching network trained with the photometric loss is not optimal, its feature extractor can produce degradation-agnostic and matching-specific features.
  arXiv  Detail & Related papers  (2022-04-04T12:24:34Z)
• Stereo Unstructured Magnification: Multiple Homography Image for View Synthesis [72.09193030350396]
  We study the problem of view synthesis with certain amount of rotations from a pair of images, what we called stereo unstructured magnification. We propose a novel multiple homography image representation, comprising of a set of scene planes with fixed normals and distances. We derive an angle-based cost to guide the blending of multi-normal images by exploiting per-normal geometry.
  arXiv  Detail & Related papers  (2022-04-01T01:39:28Z)
• Neural Radiance Fields Approach to Deep Multi-View Photometric Stereo [103.08512487830669]
  We present a modern solution to the multi-view photometric stereo problem (MVPS) We procure the surface orientation using a photometric stereo (PS) image formation model and blend it with a multi-view neural radiance field representation to recover the object's surface geometry. Our method performs neural rendering of multi-view images while utilizing surface normals estimated by a deep photometric stereo network.
  arXiv  Detail & Related papers  (2021-10-11T20:20:03Z)
• Parallax Attention for Unsupervised Stereo Correspondence Learning [46.035892564279564]
  Stereo image pairs encode 3D scene cues into stereo correspondences between the left and right images. Recent CNN based methods commonly use cost volume techniques to capture stereo correspondence over large disparities. We propose a generic parallax-attention mechanism (PAM) to capture stereo correspondence regardless of disparity variations.
  arXiv  Detail & Related papers  (2020-09-16T01:30:13Z)
• Stereo Endoscopic Image Super-Resolution Using Disparity-Constrained Parallel Attention [29.536587392367025]
  We propose a disparity-constrained stereo super-resolution network (DCSSRnet) to simultaneously compute a super-resolved image in a stereo image pair. Experiment results on laparoscopic images demonstrate that the proposed framework outperforms current SR methods on both quantitative and qualitative evaluations.
  arXiv  Detail & Related papers  (2020-03-19T02:12:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.