Image Segmentation via Divisive Normalization: dealing with environmental diversity

• URL: http://arxiv.org/abs/2407.17829v1
• Date: Thu, 25 Jul 2024 07:38:27 GMT
• Title: Image Segmentation via Divisive Normalization: dealing with environmental diversity
• Authors: Pablo Hernández-Cámara, Jorge Vila-Tomás, Paula Dauden-Oliver, Nuria Alabau-Bosque, Valero Laparra, Jesús Malo,
• Abstract summary: We put segmentation U-nets augmented with Divisive Normalization to work far from training conditions. We categorize scenes according to their radiance level and dynamic range (day/night), and according to their achromatic/chromatic contrasts. Results show that neural networks with Divisive Normalization get better results in all the scenarios.
• Score: 0.8796261172196743
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Autonomous driving is a challenging scenario for image segmentation due to the presence of uncontrolled environmental conditions and the eventually catastrophic consequences of failures. Previous work suggested that a biologically motivated computation, the so-called Divisive Normalization, could be useful to deal with image variability, but its effects have not been systematically studied over different data sources and environmental factors. Here we put segmentation U-nets augmented with Divisive Normalization to work far from training conditions to find where this adaptation is more critical. We categorize the scenes according to their radiance level and dynamic range (day/night), and according to their achromatic/chromatic contrasts. We also consider video game (synthetic) images to broaden the range of environments. We check the performance in the extreme percentiles of such categorization. Then, we push the limits further by artificially modifying the images in perceptually/environmentally relevant dimensions: luminance, contrasts and spectral radiance. Results show that neural networks with Divisive Normalization get better results in all the scenarios and their performance remains more stable with regard to the considered environmental factors and nature of the source. Finally, we explain the improvements in segmentation performance in two ways: (1) by quantifying the invariance of the responses that incorporate Divisive Normalization, and (2) by illustrating the adaptive nonlinearity of the different layers that depends on the local activity.

Related papers

• Distractors-Immune Representation Learning with Cross-modal Contrastive Regularization for Change Captioning [71.14084801851381]
  Change captioning aims to succinctly describe the semantic change between a pair of similar images. Most existing methods directly capture the difference between them, which risk obtaining error-prone difference features. We propose a distractors-immune representation learning network that correlates the corresponding channels of two image representations.
  arXiv  Detail & Related papers  (2024-07-16T13:00:33Z)
• Transparency Distortion Robustness for SOTA Image Segmentation Tasks [4.1119273264193685]
  We propose a method to synthetically augment existing datasets with spatially varying distortions. Our experiments show, that these distortion effects degrade the performance of state-of-the-art segmentation models.
  arXiv  Detail & Related papers  (2024-05-21T15:30:25Z)
• Deep Intrinsic Decomposition with Adversarial Learning for Hyperspectral Image Classification [9.051982753583232]
  This work develops a novel deep intrinsic decomposition with adversarial learning, namely AdverDecom, for hyperspectral image classification. A discriminative network is constructed to distinguish different environmental categories. Experiments are conducted over three commonly used real-world datasets.
  arXiv  Detail & Related papers  (2023-10-28T00:41:25Z)
• Fine-grained Recognition with Learnable Semantic Data Augmentation [68.48892326854494]
  Fine-grained image recognition is a longstanding computer vision challenge. We propose diversifying the training data at the feature-level to alleviate the discriminative region loss problem. Our method significantly improves the generalization performance on several popular classification networks.
  arXiv  Detail & Related papers  (2023-09-01T11:15:50Z)
• Causal Transportability for Visual Recognition [70.13627281087325]
  We show that standard classifiers fail because the association between images and labels is not transportable across settings. We then show that the causal effect, which severs all sources of confounding, remains invariant across domains. This motivates us to develop an algorithm to estimate the causal effect for image classification.
  arXiv  Detail & Related papers  (2022-04-26T15:02:11Z)
• Neural Networks with Divisive normalization for image segmentation with application in cityscapes dataset [2.960890352853005]
  We show that including divisive normalization in current deep networks makes them more invariant to non-informative changes in the images. Experiments show that the inclusion of divisive normalization in the U-Net architecture leads to better segmentation results with respect to conventional U-Net.
  arXiv  Detail & Related papers  (2022-03-25T10:26:39Z)
• Non-Homogeneous Haze Removal via Artificial Scene Prior and Bidimensional Graph Reasoning [52.07698484363237]
  We propose a Non-Homogeneous Haze Removal Network (NHRN) via artificial scene prior and bidimensional graph reasoning. Our method achieves superior performance over many state-of-the-art algorithms for both the single image dehazing and hazy image understanding tasks.
  arXiv  Detail & Related papers  (2021-04-05T13:04:44Z)
• Discriminative Residual Analysis for Image Set Classification with Posture and Age Variations [27.751472312581228]
  Discriminant Residual Analysis (DRA) is proposed to improve the classification performance. DRA attempts to obtain a powerful projection which casts the residual representations into a discriminant subspace. Two regularization approaches are used to deal with the probable small sample size problem.
  arXiv  Detail & Related papers  (2020-08-23T08:53:06Z)
• Adversarial Semantic Data Augmentation for Human Pose Estimation [96.75411357541438]
  We propose Semantic Data Augmentation (SDA), a method that augments images by pasting segmented body parts with various semantic granularity. We also propose Adversarial Semantic Data Augmentation (ASDA), which exploits a generative network to dynamiclly predict tailored pasting configuration. State-of-the-art results are achieved on challenging benchmarks.
  arXiv  Detail & Related papers  (2020-08-03T07:56:04Z)
• Phase Consistent Ecological Domain Adaptation [76.75730500201536]
  We focus on the task of semantic segmentation, where annotated synthetic data are aplenty, but annotating real data is laborious. The first criterion, inspired by visual psychophysics, is that the map between the two image domains be phase-preserving. The second criterion aims to leverage ecological statistics, or regularities in the scene which are manifest in any image of it, regardless of the characteristics of the illuminant or the imaging sensor.
  arXiv  Detail & Related papers  (2020-04-10T06:58:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.