Guided Linear Upsampling
- URL: http://arxiv.org/abs/2307.09582v1
- Date: Thu, 13 Jul 2023 08:04:24 GMT
- Title: Guided Linear Upsampling
- Authors: Shuangbing Song, Fan Zhong, Tianju Wang, Xueying Qin, Changhe Tu
- Abstract summary: Guided upsampling is an effective approach for accelerating high-resolution image processing.
Our method can better preserve detail effects while suppressing artifacts such as bleeding and blurring.
We demonstrate the advantages of our method for both interactive image editing and real-time high-resolution video processing.
- Score: 8.819059777836628
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Guided upsampling is an effective approach for accelerating high-resolution
image processing. In this paper, we propose a simple yet effective guided
upsampling method. Each pixel in the high-resolution image is represented as a
linear interpolation of two low-resolution pixels, whose indices and weights
are optimized to minimize the upsampling error. The downsampling can be jointly
optimized in order to prevent missing small isolated regions. Our method can be
derived from the color line model and local color transformations. Compared to
previous methods, our method can better preserve detail effects while
suppressing artifacts such as bleeding and blurring. It is efficient, easy to
implement, and free of sensitive parameters. We evaluate the proposed method
with a wide range of image operators, and show its advantages through
quantitative and qualitative analysis. We demonstrate the advantages of our
method for both interactive image editing and real-time high-resolution video
processing. In particular, for interactive editing, the joint optimization can
be precomputed, thus allowing for instant feedback without hardware
acceleration.
Related papers
- Learning Efficient and Effective Trajectories for Differential Equation-based Image Restoration [59.744840744491945]
We reformulate the trajectory optimization of this kind of method, focusing on enhancing both reconstruction quality and efficiency.
We propose cost-aware trajectory distillation to streamline complex paths into several manageable steps with adaptable sizes.
Experiments showcase the significant superiority of the proposed method, achieving a maximum PSNR improvement of 2.1 dB over state-of-the-art methods.
arXiv Detail & Related papers (2024-10-07T07:46:08Z) - Rethinking Score Distillation as a Bridge Between Image Distributions [97.27476302077545]
We show that our method seeks to transport corrupted images (source) to the natural image distribution (target)
Our method can be easily applied across many domains, matching or beating the performance of specialized methods.
We demonstrate its utility in text-to-2D, text-based NeRF optimization, translating paintings to real images, optical illusion generation, and 3D sketch-to-real.
arXiv Detail & Related papers (2024-06-13T17:59:58Z) - Rasterized Edge Gradients: Handling Discontinuities Differentiably [25.85191317712521]
We present a novel method for computing gradients at discontinuities for rendering approximations.
Our method elegantly simplifies the traditionally complex problem through a carefully designed approximation strategy.
We showcase our method in human head scene reconstruction, demonstrating handling of camera images and segmentation masks.
arXiv Detail & Related papers (2024-05-03T22:42:00Z) - Towards Efficient and Accurate CT Segmentation via Edge-Preserving Probabilistic Downsampling [2.1465347972460367]
Downsampling images and labels, often necessitated by limited resources or to expedite network training, leads to the loss of small objects and thin boundaries.
This undermines the segmentation network's capacity to interpret images accurately and predict detailed labels, resulting in diminished performance compared to processing at original resolutions.
We introduce a novel method named Edge-preserving Probabilistic Downsampling (EPD)
It utilizes class uncertainty within a local window to produce soft labels, with the window size dictating the downsampling factor.
arXiv Detail & Related papers (2024-04-05T10:01:31Z) - Layered Rendering Diffusion Model for Zero-Shot Guided Image Synthesis [60.260724486834164]
This paper introduces innovative solutions to enhance spatial controllability in diffusion models reliant on text queries.
We present two key innovations: Vision Guidance and the Layered Rendering Diffusion framework.
We apply our method to three practical applications: bounding box-to-image, semantic mask-to-image and image editing.
arXiv Detail & Related papers (2023-11-30T10:36:19Z) - Pixel Adapter: A Graph-Based Post-Processing Approach for Scene Text
Image Super-Resolution [22.60056946339325]
We propose the Pixel Adapter Module (PAM) based on graph attention to address pixel distortion caused by upsampling.
The PAM effectively captures local structural information by allowing each pixel to interact with its neighbors and update features.
We demonstrate that our proposed method generates high-quality super-resolution images, surpassing existing methods in recognition accuracy.
arXiv Detail & Related papers (2023-09-16T08:12:12Z) - LUT-GCE: Lookup Table Global Curve Estimation for Fast Low-light Image
Enhancement [62.17015413594777]
We present an effective and efficient approach for low-light image enhancement, named LUT-GCE.
We estimate a global curve for the entire image that allows corrections for both under- and over-exposure.
Our approach outperforms the state of the art in terms of inference speed, especially on high-definition images (e.g., 1080p and 4k)
arXiv Detail & Related papers (2023-06-12T12:53:06Z) - Learning Spatio-Temporal Downsampling for Effective Video Upscaling [20.07194339353278]
In this paper, we aim to solve the space-time aliasing problem by learning a-temporal downsampling and upsampling.
Our framework enables a variety of applications, including arbitrary video resampling, blurry frame reconstruction, and efficient video storage.
arXiv Detail & Related papers (2022-03-15T17:59:00Z) - Toward Real-World Super-Resolution via Adaptive Downsampling Models [58.38683820192415]
This study proposes a novel method to simulate an unknown downsampling process without imposing restrictive prior knowledge.
We propose a generalizable low-frequency loss (LFL) in the adversarial training framework to imitate the distribution of target LR images without using any paired examples.
arXiv Detail & Related papers (2021-09-08T06:00:32Z) - Learning Spatial and Spatio-Temporal Pixel Aggregations for Image and
Video Denoising [104.59305271099967]
We present a pixel aggregation network and learn the pixel sampling and averaging strategies for image denoising.
We develop a pixel aggregation network for video denoising to sample pixels across the spatial-temporal space.
Our method is able to solve the misalignment issues caused by large motion in dynamic scenes.
arXiv Detail & Related papers (2021-01-26T13:00:46Z) - Towards Lightweight Lane Detection by Optimizing Spatial Embedding [31.26216243950601]
pixel embedding in proposal-free instance segmentation based lane detection is difficult to optimize.
We propose a lane detection method based on proposal-free instance segmentation, directly optimizing spatial embedding of pixels using image coordinate.
The proposed method enables real-time lane detection through the simplicity of post-processing and the adoption of a lightweight backbone.
arXiv Detail & Related papers (2020-08-19T07:37:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.