A Robust Method for Image Stitching

• URL: http://arxiv.org/abs/2004.03860v3
• Date: Wed, 28 Jul 2021 04:52:35 GMT
• Title: A Robust Method for Image Stitching
• Authors: Matti Pellikka and Valtteri Lahtinen
• Abstract summary: We propose a novel method for large-scale image stitching that is robust against repetitive patterns and featureless regions in the imagery. Our method augments the current methods by collecting all the plausible pairwise image registration candidates.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose a novel method for large-scale image stitching that is robust against repetitive patterns and featureless regions in the imagery. In such cases, state-of-the-art image stitching methods easily produce image alignment artifacts, since they may produce false pairwise image registrations that are in conflict within the global connectivity graph. Our method augments the current methods by collecting all the plausible pairwise image registration candidates, among which globally consistent candidates are chosen. This enables the stitching process to determine the correct pairwise registrations by utilizing all the available information from the whole imagery, such as unambiguous registrations outside the repeating pattern and featureless regions. We formalize the method as a weighted multigraph whose nodes represent the individual image transformations from the composite image, and whose sets of multiple edges between two nodes represent all the plausible transformations between the pixel coordinates of the two images. The edge weights represent the plausibility of the transformations. The image transformations and the edge weights are solved from a non-linear minimization problem with linear constraints, for which a projection method is used. As an example, we apply the method in a large-scale scanning application where the transformations are primarily translations with only slight rotation and scaling component. Despite these simplifications, the state-of-the-art methods do not produce adequate results in such applications, since the image overlap is small, which can be featureless or repetitive, and misalignment artifacts and their concealment are unacceptable.

Related papers

• Rasterized Edge Gradients: Handling Discontinuities Differentiably [25.85191317712521]
  We present a novel method for computing gradients at discontinuities for rendering approximations. Our method elegantly simplifies the traditionally complex problem through a carefully designed approximation strategy. We showcase our method in human head scene reconstruction, demonstrating handling of camera images and segmentation masks.
  arXiv  Detail & Related papers  (2024-05-03T22:42:00Z)
• RecDiffusion: Rectangling for Image Stitching with Diffusion Models [53.824503710254206]
  We introduce a novel diffusion-based learning framework, textbfRecDiffusion, for image stitching rectangling. This framework combines Motion Diffusion Models (MDM) to generate motion fields, effectively transitioning from the stitched image's irregular borders to a geometrically corrected intermediary.
  arXiv  Detail & Related papers  (2024-03-28T06:22:45Z)
• Learning Accurate Template Matching with Differentiable Coarse-to-Fine Correspondence Refinement [28.00275083733545]
  We propose an accurate template matching method based on differentiable coarse-to-fine correspondence refinement. An initial warp is estimated using coarse correspondences based on novel structure-aware information provided by transformers. Our method is significantly better than state-of-the-art methods and baselines, providing good generalization ability and visually plausible results even on unseen real data.
  arXiv  Detail & Related papers  (2023-03-15T08:24:10Z)
• Smooth image-to-image translations with latent space interpolations [64.8170758294427]
  Multi-domain image-to-image (I2I) translations can transform a source image according to the style of a target domain. We show that our regularization techniques can improve the state-of-the-art I2I translations by a large margin.
  arXiv  Detail & Related papers  (2022-10-03T11:57:30Z)
• Automatic Registration of Images with Inconsistent Content Through Line-Support Region Segmentation and Geometrical Outlier Removal [17.90609572352273]
  This paper proposes an automatic image registration approach through line-support region segmentation and geometrical outlier removal (ALRS-GOR) It is designed to address the problems associated with the registration of images with affine deformations and inconsistent content. Various image sets have been considered for the evaluation of the proposed approach, including aerial images with simulated affine deformations.
  arXiv  Detail & Related papers  (2022-04-02T10:47:16Z)
• A training-free recursive multiresolution framework for diffeomorphic deformable image registration [6.929709872589039]
  We propose a novel diffeomorphic training-free approach for deformable image registration. The proposed architecture is simple in design. The moving image is warped successively at each resolution and finally aligned to the fixed image. The entire system is end-to-end and optimized for each pair of images from scratch.
  arXiv  Detail & Related papers  (2022-02-01T15:17:17Z)
• Dual-Flow Transformation Network for Deformable Image Registration with Region Consistency Constraint [95.30864269428808]
  Current deep learning (DL)-based image registration approaches learn the spatial transformation from one image to another by leveraging a convolutional neural network. We present a novel dual-flow transformation network with region consistency constraint which maximizes the similarity of ROIs within a pair of images. Experiments on four public 3D MRI datasets show that the proposed method achieves the best registration performance in accuracy and generalization.
  arXiv  Detail & Related papers  (2021-12-04T05:30:44Z)
• A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detection [93.38607559281601]
  We devise a hierarchical generative model that captures the multi-scale patch distribution of each training image. The anomaly score is obtained by aggregating the patch-based votes of the correct transformation across scales and image regions.
  arXiv  Detail & Related papers  (2021-04-29T17:49:48Z)
• Image Matching with Scale Adjustment [57.18604132027697]
  We show how to represent and extract interest points at variable scales. We devise a method allowing the comparison of two images at two different resolutions.
  arXiv  Detail & Related papers  (2020-12-10T11:03:25Z)
• Transformation Consistency Regularization- A Semi-Supervised Paradigm for Image-to-Image Translation [18.870983535180457]
  We propose Transformation Consistency Regularization, which delves into a more challenging setting of image-to-image translation. We evaluate the efficacy of our algorithm on three different applications: image colorization, denoising and super-resolution. Our method is significantly data efficient, requiring only around 10 - 20% of labeled samples to achieve similar image reconstructions to its fully-supervised counterpart.
  arXiv  Detail & Related papers  (2020-07-15T17:41:35Z)
• Image-to-image Mapping with Many Domains by Sparse Attribute Transfer [71.28847881318013]
  Unsupervised image-to-image translation consists of learning a pair of mappings between two domains without known pairwise correspondences between points. Current convention is to approach this task with cycle-consistent GANs. We propose an alternate approach that directly restricts the generator to performing a simple sparse transformation in a latent layer.
  arXiv  Detail & Related papers  (2020-06-23T19:52:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.