Deep Reinforcement Learning for Band Selection in Hyperspectral Image Classification

• URL: http://arxiv.org/abs/2103.08741v1
• Date: Mon, 15 Mar 2021 22:06:15 GMT
• Title: Deep Reinforcement Learning for Band Selection in Hyperspectral Image Classification
• Authors: Lichao Mou and Sudipan Saha and Yuansheng Hua and Francesca Bovolo and Lorenzo Bruzzone and Xiao Xiang Zhu
• Abstract summary: Band selection refers to the process of choosing the most relevant bands in a hyperspectral image. In this paper, we are interested in training an intelligent agent that is capable of automatically learning policy to select an optimal band subset. We frame the problem of unsupervised band selection as a Markov decision process, propose an effective method to parameterize it, and finally solve the problem by deep reinforcement learning.
• Score: 21.098473348205726
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Band selection refers to the process of choosing the most relevant bands in a hyperspectral image. By selecting a limited number of optimal bands, we aim at speeding up model training, improving accuracy, or both. It reduces redundancy among spectral bands while trying to preserve the original information of the image. By now many efforts have been made to develop unsupervised band selection approaches, of which the majority are heuristic algorithms devised by trial and error. In this paper, we are interested in training an intelligent agent that, given a hyperspectral image, is capable of automatically learning policy to select an optimal band subset without any hand-engineered reasoning. To this end, we frame the problem of unsupervised band selection as a Markov decision process, propose an effective method to parameterize it, and finally solve the problem by deep reinforcement learning. Once the agent is trained, it learns a band-selection policy that guides the agent to sequentially select bands by fully exploiting the hyperspectral image and previously picked bands. Furthermore, we propose two different reward schemes for the environment simulation of deep reinforcement learning and compare them in experiments. This, to the best of our knowledge, is the first study that explores a deep reinforcement learning model for hyperspectral image analysis, thus opening a new door for future research and showcasing the great potential of deep reinforcement learning in remote sensing applications. Extensive experiments are carried out on four hyperspectral data sets, and experimental results demonstrate the effectiveness of the proposed method.

Related papers

• Multi-Teacher Multi-Objective Meta-Learning for Zero-Shot Hyperspectral Band Selection [50.30291173608449]
  We propose a novel multi-objective meta-learning network (M$3$BS) for zero-shot hyperspectral band selection. In M$3$BS, a generalizable graph convolution network (GCN) is constructed to generate dataset-agnostic base. The acquired meta-knowledge can be directly transferred to unseen datasets without any retraining or fine-tuning.
  arXiv  Detail & Related papers  (2024-06-12T07:13:31Z)
• Multi-Armed Bandits with Abstention [62.749500564313834]
  We introduce a novel extension of the canonical multi-armed bandit problem that incorporates an additional strategic element: abstention. In this enhanced framework, the agent is not only tasked with selecting an arm at each time step, but also has the option to abstain from accepting the instantaneous reward before observing it.
  arXiv  Detail & Related papers  (2024-02-23T06:27:12Z)
• Embedded Hyperspectral Band Selection with Adaptive Optimization for Image Semantic Segmentation [0.0]
  We introduce a pioneering approach for hyperspectral band selection that offers an embedded solution. Our proposed method, embedded Hyperspectral Band Selection (EHBS), excels in selecting the best bands without the need for prior processing. The adaptability of our approach to other tasks opens up promising avenues for broader applications.
  arXiv  Detail & Related papers  (2024-01-21T07:48:39Z)
• Pure Exploration under Mediators' Feedback [63.56002444692792]
  Multi-armed bandits are a sequential-decision-making framework, where, at each interaction step, the learner selects an arm and observes a reward. We consider the scenario in which the learner has access to a set of mediators, each of which selects the arms on the agent's behalf according to a and possibly unknown policy. We propose a sequential decision-making strategy for discovering the best arm under the assumption that the mediators' policies are known to the learner.
  arXiv  Detail & Related papers  (2023-08-29T18:18:21Z)
• Bandit approach to conflict-free multi-agent Q-learning in view of photonic implementation [0.0]
  Previous studies have used quantum interference of photons to solve the competitive multi-armed bandit problem. This study extends the conventional approach to a more general multi-agent reinforcement learning. A successful photonic reinforcement learning scheme requires both a photonic system that contributes to the quality of learning and a suitable algorithm.
  arXiv  Detail & Related papers  (2022-12-20T00:27:29Z)
• A new band selection approach based on information theory and support vector machine for hyperspectral images reduction and classification [0.0]
  spectral band selection is an essential step for removing the irrelevant, noisy and redundant bands. We propose a new strategy based on joint mutual information to measure the statistical dependence and correlation between the selected bands. The proposed filter approach is compared to an effective reproduced filters based on mutual information.
  arXiv  Detail & Related papers  (2022-10-26T10:54:23Z)
• A Novel Approach for Dimensionality Reduction and Classification of Hyperspectral Images based on Normalized Synergy [0.0]
  A new filter approach normalized mutual synergy (NMS) is proposed in order to detect relevant bands that are complementary in the class prediction. The proposed approach measures the discriminative power of the selected bands based on a combination of their maximal normalized synergic information. Experimental results on three benchmark hyperspectral images proposed by the NASA demonstrated the robustness, effectiveness and the discriminative power of the proposed approach.
  arXiv  Detail & Related papers  (2022-10-25T10:36:26Z)
• SelectAugment: Hierarchical Deterministic Sample Selection for Data Augmentation [72.58308581812149]
  We propose an effective approach, dubbed SelectAugment, to select samples to be augmented in a deterministic and online manner. Specifically, in each batch, we first determine the augmentation ratio, and then decide whether to augment each training sample under this ratio. In this way, the negative effects of the randomness in selecting samples to augment can be effectively alleviated and the effectiveness of DA is improved.
  arXiv  Detail & Related papers  (2021-12-06T08:38:38Z)
• Hyperspectral Band Selection for Multispectral Image Classification with Convolutional Networks [0.0]
  We propose a novel band selection method to select a reduced set of wavelengths from hyperspectral images. We show that our method produces more suitable results for a multispectral sensor design.
  arXiv  Detail & Related papers  (2021-06-01T17:24:35Z)
• Semi-supervised Facial Action Unit Intensity Estimation with Contrastive Learning [54.90704746573636]
  Our method does not require to manually select key frames, and produces state-of-the-art results with as little as $2%$ of annotated frames. We experimentally validate that our method outperforms existing methods when working with as little as $2%$ of randomly chosen data.
  arXiv  Detail & Related papers  (2020-11-03T17:35:57Z)
• Self-Supervised Reinforcement Learning for Recommender Systems [77.38665506495553]
  We propose self-supervised reinforcement learning for sequential recommendation tasks. Our approach augments standard recommendation models with two output layers: one for self-supervised learning and the other for RL. Based on such an approach, we propose two frameworks namely Self-Supervised Q-learning(SQN) and Self-Supervised Actor-Critic(SAC)
  arXiv  Detail & Related papers  (2020-06-10T11:18:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.