Channel-Based Attention for LCC Using Sentinel-2 Time Series

• URL: http://arxiv.org/abs/2103.16836v1
• Date: Wed, 31 Mar 2021 06:24:15 GMT
• Title: Channel-Based Attention for LCC Using Sentinel-2 Time Series
• Authors: Hermann Courteille (LISTIC), A. Beno\^it (LISTIC), N M\'eger (LISTIC), A Atto (LISTIC), D. Ienco (UMR TETIS)
• Abstract summary: This paper proposes an architecture expressing predictions with respect to input channels. It relies on convolutional layers and an attention mechanism weighting the importance of each channel in the final classification decision. Experiments based on a Sentinel-2 SITS show promising results.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep Neural Networks (DNNs) are getting increasing attention to deal with Land Cover Classification (LCC) relying on Satellite Image Time Series (SITS). Though high performances can be achieved, the rationale of a prediction yielded by a DNN often remains unclear. An architecture expressing predictions with respect to input channels is thus proposed in this paper. It relies on convolutional layers and an attention mechanism weighting the importance of each channel in the final classification decision. The correlation between channels is taken into account to set up shared kernels and lower model complexity. Experiments based on a Sentinel-2 SITS show promising results.

Related papers

• CSA-Net: Channel-wise Spatially Autocorrelated Attention Networks [19.468704622654357]
  We present a channel-wise spatially autocorrelated (CSA) attention mechanism for deep CNNs. Inspired by geographical analysis, the proposed CSA exploits the spatial relationships between channels of feature maps to produce an effective channel descriptor. We validate the effectiveness of the proposed CSA networks through extensive experiments and analysis on ImageNet, and MS COCO benchmark datasets.
  arXiv  Detail & Related papers  (2024-05-09T13:21:03Z)
• From Similarity to Superiority: Channel Clustering for Time Series Forecasting [61.96777031937871]
  We develop a novel and adaptable Channel Clustering Module ( CCM) CCM dynamically groups channels characterized by intrinsic similarities and leverages cluster information instead of individual channel identities. CCM can boost the performance of CI and CD models by an average margin of 2.4% and 7.2% on long-term and short-term forecasting, respectively.
  arXiv  Detail & Related papers  (2024-03-31T02:46:27Z)
• Joint Channel Estimation and Feedback with Masked Token Transformers in Massive MIMO Systems [74.52117784544758]
  This paper proposes an encoder-decoder based network that unveils the intrinsic frequency-domain correlation within the CSI matrix. The entire encoder-decoder network is utilized for channel compression. Our method outperforms state-of-the-art channel estimation and feedback techniques in joint tasks.
  arXiv  Detail & Related papers  (2023-06-08T06:15:17Z)
• Time Gated Convolutional Neural Networks for Crop Classification [0.9176056742068814]
  State-of-the-art framework, Time Gated Convolutional Neural Network (TGCNN) TGCNN takes advantage of temporal information and gating mechanisms for the crop classification problem. Our experiments demonstrate that TGCNN is advantageous in this earth observation time series classification task.
  arXiv  Detail & Related papers  (2022-06-20T13:05:29Z)
• SAR Despeckling Using Overcomplete Convolutional Networks [53.99620005035804]
  despeckling is an important problem in remote sensing as speckle degrades SAR images. Recent studies show that convolutional neural networks(CNNs) outperform classical despeckling methods. This study employs an overcomplete CNN architecture to focus on learning low-level features by restricting the receptive field. We show that the proposed network improves despeckling performance compared to recent despeckling methods on synthetic and real SAR images.
  arXiv  Detail & Related papers  (2022-05-31T15:55:37Z)
• BA-Net: Bridge Attention for Deep Convolutional Neural Networks [4.459779019776622]
  Bridge Attention Net (BA-Net) is proposed for better channel attention mechanisms. BA-Net can not only provide richer features to calculate channel weight when feedforward, but also multiply paths of parameters updating when backforward.
  arXiv  Detail & Related papers  (2021-12-08T07:39:18Z)
• Two-Timescale End-to-End Learning for Channel Acquisition and Hybrid Precoding [94.40747235081466]
  We propose an end-to-end deep learning-based joint transceiver design algorithm for millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) systems. We develop a DNN architecture that maps the received pilots into feedback bits at the receiver, and then further maps the feedback bits into the hybrid precoder at the transmitter.
  arXiv  Detail & Related papers  (2021-10-22T20:49:02Z)
• Channel redundancy and overlap in convolutional neural networks with channel-wise NNK graphs [36.479195100553085]
  Feature spaces in the deep layers of convolutional neural networks (CNNs) are often very high-dimensional and difficult to interpret. We analyze theoretically channel-wise non-negative kernel (CW-NNK) regression graphs to quantify the overlap between channels. We find that redundancy between channels is significant and varies with the layer depth and the level of regularization.
  arXiv  Detail & Related papers  (2021-10-18T22:50:07Z)
• Channelized Axial Attention for Semantic Segmentation [70.14921019774793]
  We propose the Channelized Axial Attention (CAA) to seamlessly integratechannel attention and axial attention with reduced computationalcomplexity. Our CAA not onlyrequires much less computation resources compared with otherdual attention models such as DANet, but also outperforms the state-of-the-art ResNet-101-based segmentation models on alltested datasets.
  arXiv  Detail & Related papers  (2021-01-19T03:08:03Z)
• Channel-wise Knowledge Distillation for Dense Prediction [73.99057249472735]
  We propose to align features channel-wise between the student and teacher networks. We consistently achieve superior performance on three benchmarks with various network structures.
  arXiv  Detail & Related papers  (2020-11-26T12:00:38Z)
• Channel Pruning Guided by Spatial and Channel Attention for DNNs in Intelligent Edge Computing [15.248962858090431]
  A critical challenge is to determine which channels are to be removed, so that the model accuracy will not be negatively affected. We propose a new attention module combining both spatial and channel attention. With the guidance of SCA, our CPSCA approach achieves higher inference accuracy than other state-of-the-art pruning methods.
  arXiv  Detail & Related papers  (2020-11-08T02:40:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.