Image Super-Resolution Using T-Tetromino Pixels
- URL: http://arxiv.org/abs/2111.09013v2
- Date: Wed, 22 Mar 2023 19:13:46 GMT
- Title: Image Super-Resolution Using T-Tetromino Pixels
- Authors: Simon Grosche, Andy Regensky, J\"urgen Seiler, Andr\'e Kaup
- Abstract summary: Single-image super-resolution techniques can be applied for upscaling.
We propose a novel binning concept using tetromino-shaped pixels.
We achieve superior image quality in terms of PSNR, SSIM, and visually compared to conventional single-image super-resolution.
- Score: 3.8233569758620054
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: For modern high-resolution imaging sensors, pixel binning is performed in
low-lighting conditions and in case high frame rates are required. To recover
the original spatial resolution, single-image super-resolution techniques can
be applied for upscaling. To achieve a higher image quality after upscaling, we
propose a novel binning concept using tetromino-shaped pixels. It is embedded
into the field of compressed sensing and the coherence is calculated to
motivate the sensor layouts used. Next, we investigate the reconstruction
quality using tetromino pixels for the first time in literature. Instead of
using different types of tetrominoes as proposed elsewhere, we show that using
a small repeating cell consisting of only four T-tetrominoes is sufficient. For
reconstruction, we use a locally fully connected reconstruction (LFCR) network
as well as two classical reconstruction methods from the field of compressed
sensing. Using the LFCR network in combination with the proposed tetromino
layout, we achieve superior image quality in terms of PSNR, SSIM, and visually
compared to conventional single-image super-resolution using the very deep
super-resolution (VDSR) network. For PSNR, a gain of up to
\SI[retain-explicit-plus]{+1.92}{dB} is achieved.
Related papers
- Spatially Varying Exposure with 2-by-2 Multiplexing: Optimality and
Universality [15.525314212209564]
We propose a new concept known as the spatially varying exposure risk (SVE-Risk) which is a pseudo-idealistic enumeration of the amount of recoverable pixels.
We show that given a multiplex pattern, the conventional optimality criteria based on the input/output-referred signal-to-noise ratio can lead to flawed decisions.
We report a design observation that the design universality pattern can be decoupled from the image reconstruction algorithm.
arXiv Detail & Related papers (2023-06-30T02:08:25Z) - A Novel End-To-End Network for Reconstruction of Non-Regularly Sampled
Image Data Using Locally Fully Connected Layers [3.452491349203391]
We propose a novel end-to-end neural network to reconstruct high resolution images from non-regularly sampled sensor data.
The network is a concatenation of a locally fully connected reconstruction network (LFCR) and a standard VDSR network.
Compared to a low-resolution sensor with VDSR, a gain of 1.11 dB is achieved.
arXiv Detail & Related papers (2022-03-17T09:02:52Z) - Spatial-Separated Curve Rendering Network for Efficient and
High-Resolution Image Harmonization [59.19214040221055]
We propose a novel spatial-separated curve rendering network (S$2$CRNet) for efficient and high-resolution image harmonization.
The proposed method reduces more than 90% parameters compared with previous methods.
Our method can work smoothly on higher resolution images in real-time which is more than 10$times$ faster than the existing methods.
arXiv Detail & Related papers (2021-09-13T07:20:16Z) - Spatially-Adaptive Image Restoration using Distortion-Guided Networks [51.89245800461537]
We present a learning-based solution for restoring images suffering from spatially-varying degradations.
We propose SPAIR, a network design that harnesses distortion-localization information and dynamically adjusts to difficult regions in the image.
arXiv Detail & Related papers (2021-08-19T11:02:25Z) - SPI-GAN: Towards Single-Pixel Imaging through Generative Adversarial
Network [6.722629246312285]
We propose a generative adversarial network-based reconstruction framework for single-pixel imaging, referred to as SPI-GAN.
Our method can reconstruct images with 17.92 dB PSNR and 0.487 SSIM, even if the sampling ratio drops to 5%.
arXiv Detail & Related papers (2021-07-03T03:06:09Z) - TWIST-GAN: Towards Wavelet Transform and Transferred GAN for
Spatio-Temporal Single Image Super Resolution [4.622977798361014]
Single Image Super-resolution (SISR) produces high-resolution images with fine spatial resolutions from a remotely sensed image with low spatial resolution.
Deep learning and generative adversarial networks (GANs) have made breakthroughs for the challenging task of single image super-resolution (SISR)
arXiv Detail & Related papers (2021-04-20T22:12:38Z) - Deep Unfolded Recovery of Sub-Nyquist Sampled Ultrasound Image [94.42139459221784]
We propose a reconstruction method from sub-Nyquist samples in the time and spatial domain, that is based on unfolding the ISTA algorithm.
Our method allows reducing the number of array elements, sampling rate, and computational time while ensuring high quality imaging performance.
arXiv Detail & Related papers (2021-03-01T19:19:38Z) - Hyperspectral Image Super-resolution via Deep Progressive Zero-centric
Residual Learning [62.52242684874278]
Cross-modality distribution of spatial and spectral information makes the problem challenging.
We propose a novel textitlightweight deep neural network-based framework, namely PZRes-Net.
Our framework learns a high resolution and textitzero-centric residual image, which contains high-frequency spatial details of the scene.
arXiv Detail & Related papers (2020-06-18T06:32:11Z) - The Power of Triply Complementary Priors for Image Compressive Sensing [89.14144796591685]
We propose a joint low-rank deep (LRD) image model, which contains a pair of complementaryly trip priors.
We then propose a novel hybrid plug-and-play framework based on the LRD model for image CS.
To make the optimization tractable, a simple yet effective algorithm is proposed to solve the proposed H-based image CS problem.
arXiv Detail & Related papers (2020-05-16T08:17:44Z) - Image Fine-grained Inpainting [89.17316318927621]
We present a one-stage model that utilizes dense combinations of dilated convolutions to obtain larger and more effective receptive fields.
To better train this efficient generator, except for frequently-used VGG feature matching loss, we design a novel self-guided regression loss.
We also employ a discriminator with local and global branches to ensure local-global contents consistency.
arXiv Detail & Related papers (2020-02-07T03:45:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.