ConCA: Concentration-Aware Channel Attention for Fine-Grained Visual Recognition

• URL: http://arxiv.org/abs/2608.30183v1
• Date: Mon, 31 Aug 2026 03:07:59 GMT
• Title: ConCA: Concentration-Aware Channel Attention for Fine-Grained Visual Recognition
• Abstract summary: Concentration-Aware Channel Attention (ConCA) is a dual descriptor that encodes magnitude and concentration.<n>On six fine-grained benchmarks, ConCA improves over attention-free, SE-Net, and ECA-Net baselines.<n>These results indicate that the channel descriptor, together with the per-channel gating that maps it to attention weights, is an important but underexplored aspect of lightweight channel attention in visual recognition.
• Score: 0.41073293267048777
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Lightweight channel attention mechanisms are widely used in image classification, yet their effectiveness in fine-grained visual recognition (FGVR) remains limited. Most modules summarize each channel by global average pooling (GAP), which captures activation magnitude but ignores spatial concentration, so channels with different spatial distributions but identical means receive the same descriptor. We propose Concentration-Aware Channel Attention (ConCA), which pairs the mean with a shift-invariant negative-input entropy (NegEnt), computed via a softmax over the negated activations, forming a dual descriptor that jointly encodes magnitude and concentration. A depthwise 1-D convolutional multi-layer perceptron (MLP), whose parameter count is linear in the number of channels, maps the pair to a per-channel weight. On six fine-grained benchmarks, ConCA improves over attention-free, SE-Net, and ECA-Net baselines as well as four richer descriptor-based modules under a controlled from-scratch protocol, and it generalizes across eight backbones on iNat2021-mini. These results indicate that the channel descriptor, together with the per-channel gating that maps it to attention weights, is an important but underexplored aspect of lightweight channel attention in FGVR.

Related papers

• OScaR: The Occam's Razor for Extreme KV Cache Quantization in LLMs and Beyond [50.440302567029654]
  Multi-modal intelligence has made the Key-Value cache a dominant memory bottleneck for efficient deployment.<n>In this work, we revisit the inherent limitations of the per-channel quantization paradigm.<n>We propose OScaR, an accurate and lightweight KV cache compression framework for X-LLMs.
  arXiv  Detail & Related papers  (2026-05-19T10:53:03Z)
• CI-ICM: Channel Importance-driven Learned Image Coding for Machines [56.1188469769241]
  We propose a Channel Importance-driven learned Image Coding for Machines (CI-ICM) to maximize the performance of machine vision tasks.<n>The proposed CI-ICM achieves BD-mAP@50:95 gains of 16.25%$ in object detection and 13.72%$ in instance segmentation over the established baseline.
  arXiv  Detail & Related papers  (2026-04-07T02:36:47Z)
• Channel-Aware Probing for Multi-Channel Imaging [9.507520646516719]
  Training and evaluating vision encoders on Multi-Channel Imaging (MCI) data remains challenging.<n>ChannelAware Probing (CAP) exploits intrinsic inter-channel diversity by controlling feature flow at both encoder and probe levels.
  arXiv  Detail & Related papers  (2026-02-13T08:03:27Z)
• Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising [94.09442506816724]
  Blind-spot networks (BSN) have been prevalent neural architectures in self-supervised image denoising (SSID)<n>We build a Transformer-based Blind-Spot Network (TBSN) which shows strong local fitting and global perspective abilities.
  arXiv  Detail & Related papers  (2024-04-11T15:39:10Z)
• Joint Channel Estimation and Feedback with Masked Token Transformers in Massive MIMO Systems [74.52117784544758]
  This paper proposes an encoder-decoder based network that unveils the intrinsic frequency-domain correlation within the CSI matrix. The entire encoder-decoder network is utilized for channel compression. Our method outperforms state-of-the-art channel estimation and feedback techniques in joint tasks.
  arXiv  Detail & Related papers  (2023-06-08T06:15:17Z)
• Efficient Multi-Scale Attention Module with Cross-Spatial Learning [4.046170185945849]
  A novel efficient multi-scale attention (EMA) module is proposed. We focus on retaining the information on per channel and decreasing the computational overhead. We conduct extensive ablation studies and experiments on image classification and object detection tasks.
  arXiv  Detail & Related papers  (2023-05-23T00:35:47Z)
• Channel-Based Attention for LCC Using Sentinel-2 Time Series [0.0]
  This paper proposes an architecture expressing predictions with respect to input channels. It relies on convolutional layers and an attention mechanism weighting the importance of each channel in the final classification decision. Experiments based on a Sentinel-2 SITS show promising results.
  arXiv  Detail & Related papers  (2021-03-31T06:24:15Z)
• Channelized Axial Attention for Semantic Segmentation [70.14921019774793]
  We propose the Channelized Axial Attention (CAA) to seamlessly integratechannel attention and axial attention with reduced computationalcomplexity. Our CAA not onlyrequires much less computation resources compared with otherdual attention models such as DANet, but also outperforms the state-of-the-art ResNet-101-based segmentation models on alltested datasets.
  arXiv  Detail & Related papers  (2021-01-19T03:08:03Z)
• Channel-wise Knowledge Distillation for Dense Prediction [73.99057249472735]
  We propose to align features channel-wise between the student and teacher networks. We consistently achieve superior performance on three benchmarks with various network structures.
  arXiv  Detail & Related papers  (2020-11-26T12:00:38Z)
• Channel Pruning Guided by Spatial and Channel Attention for DNNs in Intelligent Edge Computing [15.248962858090431]
  A critical challenge is to determine which channels are to be removed, so that the model accuracy will not be negatively affected. We propose a new attention module combining both spatial and channel attention. With the guidance of SCA, our CPSCA approach achieves higher inference accuracy than other state-of-the-art pruning methods.
  arXiv  Detail & Related papers  (2020-11-08T02:40:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.