Learning Residual Elastic Warps for Image Stitching under Dirichlet Boundary Condition

• URL: http://arxiv.org/abs/2309.01406v3
• Date: Wed, 18 Oct 2023 14:47:54 GMT
• Title: Learning Residual Elastic Warps for Image Stitching under Dirichlet Boundary Condition
• Authors: Minsu Kim, Yongjun Lee, Woo Kyoung Han, Kyong Hwan Jin
• Abstract summary: We suggest Recurrent Elastic Warps (REwarp) that address the problem with Dirichlet boundary condition. REwarp predicts a homography and a Thin-plate Spline (TPS) under the boundary constraint for discontinuity and hole-free image stitching. Our experiments show the favorable aligns and the competitive computational costs of REwarp compared to the existing stitching methods.
• Score: 28.627775495233692
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Trendy suggestions for learning-based elastic warps enable the deep image stitchings to align images exposed to large parallax errors. Despite the remarkable alignments, the methods struggle with occasional holes or discontinuity between overlapping and non-overlapping regions of a target image as the applied training strategy mostly focuses on overlap region alignment. As a result, they require additional modules such as seam finder and image inpainting for hiding discontinuity and filling holes, respectively. In this work, we suggest Recurrent Elastic Warps (REwarp) that address the problem with Dirichlet boundary condition and boost performances by residual learning for recurrent misalign correction. Specifically, REwarp predicts a homography and a Thin-plate Spline (TPS) under the boundary constraint for discontinuity and hole-free image stitching. Our experiments show the favorable aligns and the competitive computational costs of REwarp compared to the existing stitching methods. Our source code is available at https://github.com/minshu-kim/REwarp.

Related papers

• Learning to Rank Patches for Unbiased Image Redundancy Reduction [80.93989115541966]
  Images suffer from heavy spatial redundancy because pixels in neighboring regions are spatially correlated. Existing approaches strive to overcome this limitation by reducing less meaningful image regions. We propose a self-supervised framework for image redundancy reduction called Learning to Rank Patches.
  arXiv  Detail & Related papers  (2024-03-31T13:12:41Z)
• RecDiffusion: Rectangling for Image Stitching with Diffusion Models [53.824503710254206]
  We introduce a novel diffusion-based learning framework, textbfRecDiffusion, for image stitching rectangling. This framework combines Motion Diffusion Models (MDM) to generate motion fields, effectively transitioning from the stitched image's irregular borders to a geometrically corrected intermediary.
  arXiv  Detail & Related papers  (2024-03-28T06:22:45Z)
• Semi-Supervised Coupled Thin-Plate Spline Model for Rotation Correction and Beyond [84.56978780892783]
  We propose CoupledTPS, which iteratively couples multiple TPS with limited control points into a more flexible and powerful transformation. In light of the laborious annotation cost, we develop a semi-supervised learning scheme to improve warping quality by exploiting unlabeled data. Experiments demonstrate the superiority and universality of CoupledTPS over the existing state-of-the-art solutions for rotation correction.
  arXiv  Detail & Related papers  (2024-01-24T13:03:28Z)
• Implicit Neural Image Stitching [41.28311406845525]
  We propose a novel approach, implicit Neural Image Stitching (NIS) that extends arbitrary-scale super-resolution. Our method estimates Fourier coefficients of images for quality-enhancing warps. Our experiments show that our approach achieves improvement in resolving the low-definition imaging of the previous deep image stitching.
  arXiv  Detail & Related papers  (2023-09-04T07:40:30Z)
• Parallax-Tolerant Unsupervised Deep Image Stitching [57.76737888499145]
  We propose UDIS++, a parallax-tolerant unsupervised deep image stitching technique. First, we propose a robust and flexible warp to model the image registration from global homography to local thin-plate spline motion. To further eliminate the parallax artifacts, we propose to composite the stitched image seamlessly by unsupervised learning for seam-driven composition masks.
  arXiv  Detail & Related papers  (2023-02-16T10:40:55Z)
• RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning [62.86400614141706]
  We propose a new learning model, i.e., Rectangling Rectification Network (RecRecNet) Our model can flexibly warp the source structure to the target domain and achieves an end-to-end unsupervised deformation. Experiments show the superiority of our solution over the compared methods on both quantitative and qualitative evaluations.
  arXiv  Detail & Related papers  (2023-01-04T15:12:57Z)
• Manifold-Inspired Single Image Interpolation [17.304301226838614]
  Many approaches to single image use manifold models to exploit semi-local similarity. aliasing in the input image makes it challenging for both parts. We propose a carefully-designed adaptive technique to remove aliasing in severely aliased regions. This technique enables reliable identification of similar patches even in the presence of strong aliasing.
  arXiv  Detail & Related papers  (2021-07-31T04:29:05Z)
• Contrastive Rendering for Ultrasound Image Segmentation [59.23915581079123]
  The lack of sharp boundaries in US images remains an inherent challenge for segmentation. We propose a novel and effective framework to improve boundary estimation in US images. Our proposed method outperforms state-of-the-art methods and has the potential to be used in clinical practice.
  arXiv  Detail & Related papers  (2020-10-10T07:14:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.