Full-resolution quality assessment for pansharpening

• URL: http://arxiv.org/abs/2108.06144v1
• Date: Fri, 13 Aug 2021 09:35:45 GMT
• Title: Full-resolution quality assessment for pansharpening
• Authors: Giuseppe Scarpa and Matteo Ciotola
• Abstract summary: A reliable quality assessment procedure for pansharpening methods is of critical importance for the development of the related solutions. We introduce a protocol, namely the reprojection protocol, which allows to handle the spectral fidelity problem. On the other side, a new index of the spatial consistency between the pansharpened image and the panchromatic band at full resolution is proposed.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: A reliable quality assessment procedure for pansharpening methods is of critical importance for the development of the related solutions. Unfortunately, the lack of ground-truths to be used as guidance for an objective evaluation has pushed the community to resort to either reference-based reduced-resolution indexes or to no-reference subjective quality indexes that can be applied on full-resolution datasets. In particular, the reference-based approach leverages on Wald's protocol, a resolution degradation process that allows one to synthesize data with related ground truth. Both solutions, however, present critical shortcomings that we aim to mitigate in this work by means of an alternative no-reference full-resolution framework. On one side we introduce a protocol, namely the reprojection protocol, which allows to handle the spectral fidelity problem. On the other side, a new index of the spatial consistency between the pansharpened image and the panchromatic band at full resolution is proposed. The experimental results show the effectiveness of the proposed approach which is confirmed also by visual inspection.

Related papers

• Hyperspectral Pansharpening: Critical Review, Tools and Future Perspectives [23.833438162665715]
  Hyperspectral pansharpening consists of fusing a high-resolution panchromatic band and a low-resolution hyperspectral image to obtain a new image with high resolution in both the spatial and spectral domains. This paper attempts to address the lack of a comprehensive framework for the rapid development and accurate evaluation of new methods.
  arXiv  Detail & Related papers  (2024-07-01T15:10:50Z)
• Optimal Baseline Corrections for Off-Policy Contextual Bandits [61.740094604552475]
  We aim to learn decision policies that optimize an unbiased offline estimate of an online reward metric. We propose a single framework built on their equivalence in learning scenarios. Our framework enables us to characterize the variance-optimal unbiased estimator and provide a closed-form solution for it.
  arXiv  Detail & Related papers  (2024-05-09T12:52:22Z)
• Text-guided Explorable Image Super-resolution [14.83045604603449]
  We propose two approaches for zero-shot text-guided super-resolution. We show that the proposed approaches result in diverse solutions that match the semantic meaning provided by the text prompt.
  arXiv  Detail & Related papers  (2024-03-02T08:10:54Z)
• Revisiting Proposal-based Object Detection [59.97295544455179]
  We revisit the pipeline for detecting objects in images with proposals. We solve a simple problem where we regress to the area of intersection between proposal and ground truth. Our revisited approach comes with minimal changes to the detection pipeline and can be plugged into any existing method.
  arXiv  Detail & Related papers  (2023-11-30T12:40:23Z)
• CCFace: Classification Consistency for Low-Resolution Face Recognition [12.129404936688752]
  Deep face recognition methods have shown a significant decline in performance when applied to real-world low-resolution benchmarks like TinyFace or SCFace. We propose a novel classification consistency knowledge distillation approach that transfers the learned classifier from a high-resolution model to a low-resolution network. Our proposed method outperforms state-of-the-art approaches on low-resolution benchmarks, with a three percent improvement on TinyFace while maintaining performance on high-resolution benchmarks.
  arXiv  Detail & Related papers  (2023-08-18T01:24:52Z)
• View Consistent Purification for Accurate Cross-View Localization [59.48131378244399]
  This paper proposes a fine-grained self-localization method for outdoor robotics. The proposed method addresses limitations in existing cross-view localization methods. It is the first sparse visual-only method that enhances perception in dynamic environments.
  arXiv  Detail & Related papers  (2023-08-16T02:51:52Z)
• PARL: A Unified Framework for Policy Alignment in Reinforcement Learning from Human Feedback [106.63518036538163]
  We present a novel unified bilevel optimization-based framework, textsfPARL, formulated to address the recently highlighted critical issue of policy alignment in reinforcement learning. Our framework addressed these concerns by explicitly parameterizing the distribution of the upper alignment objective (reward design) by the lower optimal variable. Our empirical results substantiate that the proposed textsfPARL can address the alignment concerns in RL by showing significant improvements.
  arXiv  Detail & Related papers  (2023-08-03T18:03:44Z)
• HQDec: Self-Supervised Monocular Depth Estimation Based on a High-Quality Decoder [14.67433946077953]
  We propose a high-quality decoder (HQDec) to recover scene depths. The code and models will be publicly available at hrefhttps://github.com/fwucas/HQDecHQDec.
  arXiv  Detail & Related papers  (2023-05-30T03:03:11Z)
• Best-Effort Adaptation [62.00856290846247]
  We present a new theoretical analysis of sample reweighting methods, including bounds holding uniformly over the weights. We show how these bounds can guide the design of learning algorithms that we discuss in detail. We report the results of a series of experiments demonstrating the effectiveness of our best-effort adaptation and domain adaptation algorithms.
  arXiv  Detail & Related papers  (2023-05-10T00:09:07Z)
• Handling Image and Label Resolution Mismatch in Remote Sensing [10.009103959118931]
  We show how to handle resolution mismatch between overhead imagery and ground-truth label sources. We present a method that is supervised using low-resolution labels, but takes advantage of an exemplar set of high-resolution labels. Our method incorporates region aggregation, adversarial learning, and self-supervised pretraining to generate fine-supervised predictions.
  arXiv  Detail & Related papers  (2022-11-28T21:56:07Z)
• Uncovering the Over-smoothing Challenge in Image Super-Resolution: Entropy-based Quantification and Contrastive Optimization [67.99082021804145]
  We propose an explicit solution to the COO problem, called Detail Enhanced Contrastive Loss (DECLoss) DECLoss utilizes the clustering property of contrastive learning to directly reduce the variance of the potential high-resolution distribution. We evaluate DECLoss on multiple super-resolution benchmarks and demonstrate that it improves the perceptual quality of PSNR-oriented models.
  arXiv  Detail & Related papers  (2022-01-04T08:30:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.