Interpolating Points on a Non-Uniform Grid using a Mixture of Gaussians
- URL: http://arxiv.org/abs/2012.13257v1
- Date: Thu, 24 Dec 2020 13:59:39 GMT
- Title: Interpolating Points on a Non-Uniform Grid using a Mixture of Gaussians
- Authors: Ivan Skorokhodov
- Abstract summary: We propose an approach to perform non-uniform image based on a Gaussian Mixture Model.
Traditional image methods assume that the coordinates you want to interpolate from, are positioned on a uniform grid.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this work, we propose an approach to perform non-uniform image
interpolation based on a Gaussian Mixture Model. Traditional image
interpolation methods, like nearest neighbor, bilinear, Hamming, Lanczos, etc.
assume that the coordinates you want to interpolate from, are positioned on a
uniform grid. However, it is not always the case in practice and we develop an
interpolation method that is able to generate an image from arbitrarily
positioned pixel values. We do this by representing each known pixel as a 2D
normal distribution and considering each output image pixel as a sample from
the mixture of all the known ones. Apart from the ability to reconstruct an
image from arbitrarily positioned set of pixels, this also allows us to
differentiate through the interpolation procedure, which might be helpful for
downstream applications. Our optimized CUDA kernel and the source code to
reproduce the benchmarks is located at
https://github.com/universome/non-uniform-interpolation.
Related papers
- AID: Attention Interpolation of Text-to-Image Diffusion [64.87754163416241]
We introduce a training-free technique named Attention Interpolation via Diffusion (AID)
AID fuses the interpolated attention with self-attention to boost fidelity.
We also present a variant, Conditional-guided Attention Interpolation via Diffusion (AID), that considers as a condition-dependent generative process.
arXiv Detail & Related papers (2024-03-26T17:57:05Z) - Hermite coordinate interpolation kernels: application to image zooming [0.0]
A number of basic image processing tasks, such as any geometric transformation require at subpixel image values.
In this work we utilize the multidimensional Hermite spline defined on non-equal spaced rectilinear grids.
We show that despite the increased complexity of the interpolant, once the kernels are constructed, the Hermite spline can be applied to images as efficiently as any other less complicated method.
arXiv Detail & Related papers (2024-03-19T23:06:10Z) - Dilated Convolution with Learnable Spacings: beyond bilinear
interpolation [10.89964981012741]
Dilated Convolution with Learnable Spacings is a proposed variation of the dilated convolution.
Non-integer positions are handled via gradients.
The method code is based on PyTorch.
arXiv Detail & Related papers (2023-06-01T15:42:08Z) - $PC^2$: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D
Reconstruction [97.06927852165464]
Reconstructing the 3D shape of an object from a single RGB image is a long-standing and highly challenging problem in computer vision.
We propose a novel method for single-image 3D reconstruction which generates a sparse point cloud via a conditional denoising diffusion process.
arXiv Detail & Related papers (2023-02-21T13:37:07Z) - Adaptive Local Implicit Image Function for Arbitrary-scale
Super-resolution [61.95533972380704]
Local implicit image function (LIIF) denotes images as a continuous function where pixel values are expansion by using the corresponding coordinates as inputs.
LIIF can be adopted for arbitrary-scale image super-resolution tasks, resulting in a single effective and efficient model for various up-scaling factors.
We propose a novel adaptive local image function (A-LIIF) to alleviate this problem.
arXiv Detail & Related papers (2022-08-07T11:23:23Z) - FRIH: Fine-grained Region-aware Image Harmonization [49.420765789360836]
We propose a novel global-local two stages framework for Fine-grained Region-aware Image Harmonization (FRIH)
Our algorithm achieves the best performance on iHarmony4 dataset (PSNR is 38.19 dB) with a lightweight model.
arXiv Detail & Related papers (2022-05-13T04:50:26Z) - Spatial-Separated Curve Rendering Network for Efficient and
High-Resolution Image Harmonization [59.19214040221055]
We propose a novel spatial-separated curve rendering network (S$2$CRNet) for efficient and high-resolution image harmonization.
The proposed method reduces more than 90% parameters compared with previous methods.
Our method can work smoothly on higher resolution images in real-time which is more than 10$times$ faster than the existing methods.
arXiv Detail & Related papers (2021-09-13T07:20:16Z) - AlignMix: Improving representation by interpolating aligned features [19.465347590276114]
We introduce AlignMix, where we geometrically align two images in the feature space.
We show that an autoencoder can still improve representation learning under mixup, without the ever seeing decoded images.
arXiv Detail & Related papers (2021-03-29T07:03:18Z) - Superpixel Based Graph Laplacian Regularization for Sparse Hyperspectral
Unmixing [1.14219428942199]
We use a superpixel segmentation algorithm to extract the homogeneous regions by considering the image boundaries.
We first extract the homogeneous regions, which are called superpixels, then a weighted graph in each superpixel is constructed by selecting $K$-nearest pixels in each superpixel.
The spatial similarity is investigated using graph Laplacian regularization.
arXiv Detail & Related papers (2020-07-28T07:30:50Z) - Locally Masked Convolution for Autoregressive Models [107.4635841204146]
LMConv is a simple modification to the standard 2D convolution that allows arbitrary masks to be applied to the weights at each location in the image.
We learn an ensemble of distribution estimators that share parameters but differ in generation order, achieving improved performance on whole-image density estimation.
arXiv Detail & Related papers (2020-06-22T17:59:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.