Optimal Weighted Convolution for Classification and Denosing

• URL: http://arxiv.org/abs/2505.24558v1
• Date: Fri, 30 May 2025 13:10:46 GMT
• Title: Optimal Weighted Convolution for Classification and Denosing
• Authors: Simone Cammarasana, Giuseppe Patanè,
• Abstract summary: We introduce a novel weighted convolution operator that enhances traditional convolutional neural networks (CNNs)<n>This extension enables the network to differentially weight neighbouring pixels based on their relative position to the reference pixel.<n>Although developed for 2D image data, the framework is generalisable to signals on regular grids of arbitrary dimensions.
• Score: 6.6942213231641805
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce a novel weighted convolution operator that enhances traditional convolutional neural networks (CNNs) by integrating a spatial density function into the convolution operator. This extension enables the network to differentially weight neighbouring pixels based on their relative position to the reference pixel, improving spatial characterisation and feature extraction. The proposed operator maintains the same number of trainable parameters and is fully compatible with existing CNN architectures. Although developed for 2D image data, the framework is generalisable to signals on regular grids of arbitrary dimensions, such as 3D volumetric data or 1D time series. We propose an efficient implementation of the weighted convolution by pre-computing the density function and achieving execution times comparable to standard convolution layers. We evaluate our method on two deep learning tasks: image classification using the CIFAR-100 dataset [KH+09] and image denoising using the DIV2K dataset [AT17]. Experimental results with state-of-the-art classification (e.g., VGG [SZ15], ResNet [HZRS16]) and denoising (e.g., DnCNN [ZZC+17], NAFNet [CCZS22]) methods show that the weighted convolution improves performance with respect to standard convolution across different quantitative metrics. For example, VGG achieves an accuracy of 66.94% with weighted convolution versus 56.89% with standard convolution on the classification problem, while DnCNN improves the PSNR value from 20.17 to 22.63 on the denoising problem. All models were trained on the CINECA Leonardo cluster to reduce the execution time and improve the tuning of the density function values. The PyTorch implementation of the weighted convolution is publicly available at: https://github.com/cammarasana123/weightedConvolution2.0.

Related papers

• Optimal Density Functions for Weighted Convolution in Learning Models [6.6942213231641805]
  The paper introduces the weighted convolution, a novel approach to the convolution for signals defined on regular grids.<n>The weighted convolution can be applied to convolutional neural network problems to improve the approximation accuracy.<n>Future work will apply the weighted convolution to real-case 2D and 3D image convolutional learning problems.
  arXiv  Detail & Related papers  (2025-05-30T12:36:36Z)
• GMConv: Modulating Effective Receptive Fields for Convolutional Kernels [52.50351140755224]
  In convolutional neural networks, the convolutions are performed using a square kernel with a fixed N $times$ N receptive field (RF) Inspired by the property that ERFs typically exhibit a Gaussian distribution, we propose a Gaussian Mask convolutional kernel (GMConv) in this work. Our GMConv can directly replace the standard convolutions in existing CNNs and can be easily trained end-to-end by standard back-propagation.
  arXiv  Detail & Related papers  (2023-02-09T10:17:17Z)
• An Improved Normed-Deformable Convolution for Crowd Counting [70.02434289611566]
  Deformable convolution is proposed to exploit the scale-adaptive capabilities for CNN features in the heads. An improved Normed-Deformable Convolution (textiti.e.,NDConv) is proposed in this paper. Our method outperforms state-of-the-art methods on ShanghaiTech A, ShanghaiTech B, UCF_QNRF, and UCF_CC_50 dataset.
  arXiv  Detail & Related papers  (2022-06-16T10:56:26Z)
• Dilated convolution with learnable spacings [6.6389732792316005]
  CNNs need receptive fields (RF) to compete with visual transformers. RFs can simply be enlarged by increasing the convolution kernel sizes. The number of trainable parameters, which scales quadratically with the kernel's size in the 2D case, rapidly becomes prohibitive. This paper presents a new method to increase the RF size without increasing the number of parameters.
  arXiv  Detail & Related papers  (2021-12-07T14:54:24Z)
• Content-Aware Convolutional Neural Networks [98.97634685964819]
  Convolutional Neural Networks (CNNs) have achieved great success due to the powerful feature learning ability of convolution layers. We propose a Content-aware Convolution (CAC) that automatically detects the smooth windows and applies a 1x1 convolutional kernel to replace the original large kernel.
  arXiv  Detail & Related papers  (2021-06-30T03:54:35Z)
• Why Approximate Matrix Square Root Outperforms Accurate SVD in Global Covariance Pooling? [59.820507600960745]
  We propose a new GCP meta-layer that uses SVD in the forward pass, and Pad'e Approximants in the backward propagation to compute the gradients. The proposed meta-layer has been integrated into different CNN models and achieves state-of-the-art performances on both large-scale and fine-grained datasets.
  arXiv  Detail & Related papers  (2021-05-06T08:03:45Z)
• Decoupled Dynamic Filter Networks [85.38058820176047]
  We propose the Decoupled Dynamic Filter (DDF) that can simultaneously tackle both of these shortcomings. Inspired by recent advances in attention, DDF decouples a depth-wise dynamic filter into spatial and channel dynamic filters. We observe a significant boost in performance when replacing standard convolution with DDF in classification networks.
  arXiv  Detail & Related papers  (2021-04-29T04:55:33Z)
• Efficient Deep Image Denoising via Class Specific Convolution [24.103826414190216]
  We propose an efficient deep neural network for image denoising based on pixel-wise classification. The proposed method can reduce the computational costs without sacrificing the performance.
  arXiv  Detail & Related papers  (2021-03-02T10:28:15Z)
• Locally Masked Convolution for Autoregressive Models [107.4635841204146]
  LMConv is a simple modification to the standard 2D convolution that allows arbitrary masks to be applied to the weights at each location in the image. We learn an ensemble of distribution estimators that share parameters but differ in generation order, achieving improved performance on whole-image density estimation.
  arXiv  Detail & Related papers  (2020-06-22T17:59:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.