Feature selection intelligent algorithm with mutual information and
steepest ascent strategy
- URL: http://arxiv.org/abs/2210.12296v1
- Date: Fri, 21 Oct 2022 23:15:42 GMT
- Title: Feature selection intelligent algorithm with mutual information and
steepest ascent strategy
- Authors: Elkebir Sarhrouni, Ahmed Hammouch and Driss Aboutajdine
- Abstract summary: In principle hyperspectral images (HSIs) is a remote sensing tool that provides precise classification of regions.
Some images are carrying relevant information, but others describe redundant information, or they are affected by atmospheric noise.
Many studies use mutual information (MI) or normalised forms of MI to select appropriate bands.
In this paper we design an algorithm based also on MI, and we combine MI with steepest ascent algorithm, to improve a symmetric uncertainty coefficient-based strategy.
- Score: 0.4297070083645048
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Remote sensing is a higher technology to produce knowledge for data mining
applications. In principle hyperspectral images (HSIs) is a remote sensing tool
that provides precise classification of regions. The HSI contains more than a
hundred of images of the ground truth (GT) map. Some images are carrying
relevant information, but others describe redundant information, or they are
affected by atmospheric noise. The aim is to reduce dimensionality of HSI. Many
studies use mutual information (MI) or normalised forms of MI to select
appropriate bands. In this paper we design an algorithm based also on MI, and
we combine MI with steepest ascent algorithm, to improve a symmetric
uncertainty coefficient-based strategy to select relevant bands for
classification of HSI. This algorithm is a feature selection tool and a wrapper
strategy. We perform our study on HSI AVIRIS 92AV3C. This is an artificial
intelligent system to control redundancy; we had to clear the difference of the
result's algorithm and the human decision, and this can be viewed as case study
which human decision is perhaps different to an intelligent algorithm. Index
Terms - Hyperspectral images, Classification, Fea-ture selection, Mutual
Information, Redundancy, Steepest Ascent. Artificial Intelligence
Related papers
- Feature selection algorithm based on incremental mutual information and
cockroach swarm optimization [12.297966427336124]
We propose an incremental mutual information based improved swarm intelligent optimization method (IMIICSO)
This method extracts decision table reduction knowledge to guide group algorithm global search.
The accuracy of feature subsets selected by the improved cockroach swarm algorithm based on incremental mutual information is better or almost the same as that of the original swarm intelligent optimization algorithm.
arXiv Detail & Related papers (2023-02-21T08:51:05Z) - Hyperspectral images classification and Dimensionality Reduction using
Homogeneity feature and mutual information [0.0]
In this paper, a categorization of dimensionality reduction methods, according to the generation process, is presented.
We reproduce an algorithm based on mutual information (MI) to reduce dimensionality by features selection and we introduce an algorithm using mutual information and homogeneity.
arXiv Detail & Related papers (2022-10-25T23:55:04Z) - Band selection and classification of hyperspectral images by minimizing
normalized mutual information [0.0]
Hyperspectral images (HSI) classification is a high technical remote sensing tool.
Main goal is to classify the point of a region.
Some bands contain redundant information, others are affected by the noise, and the high dimensionalities of features make the accuracy of classification lower.
In this paper we use mutual information (MI) to select the relevant bands; and the Normalized Mutual Information coefficient to avoid and control redundant ones.
arXiv Detail & Related papers (2022-10-22T04:10:10Z) - A Dashboard to Analysis and Synthesis of Dimensionality Reduction
Methods in Remote Sensing [0.4297070083645048]
Hyperspectral images (HSI) classification is a high technical remote sensing software.
The purpose is to reproduce a thematic map.
Unfortunately, some bands are redundant features, others are noisily measured, and the high dimensionality of features made classification accuracy poor.
arXiv Detail & Related papers (2022-10-18T10:42:14Z) - Towards Automated Imbalanced Learning with Deep Hierarchical
Reinforcement Learning [57.163525407022966]
Imbalanced learning is a fundamental challenge in data mining, where there is a disproportionate ratio of training samples in each class.
Over-sampling is an effective technique to tackle imbalanced learning through generating synthetic samples for the minority class.
We propose AutoSMOTE, an automated over-sampling algorithm that can jointly optimize different levels of decisions.
arXiv Detail & Related papers (2022-08-26T04:28:01Z) - DAAS: Differentiable Architecture and Augmentation Policy Search [107.53318939844422]
This work considers the possible coupling between neural architectures and data augmentation and proposes an effective algorithm jointly searching for them.
Our approach achieves 97.91% accuracy on CIFAR-10 and 76.6% Top-1 accuracy on ImageNet dataset, showing the outstanding performance of our search algorithm.
arXiv Detail & Related papers (2021-09-30T17:15:17Z) - Selection-Expansion: A Unifying Framework for Motion-Planning and
Diversity Search Algorithms [69.87173070473717]
We investigate the properties of two diversity search algorithms, the Novelty Search and the Goal Exploration Process algorithms.
The relation to MP algorithms reveals that the smoothness, or lack of smoothness of the mapping between the policy parameter space and the outcome space plays a key role in the search efficiency.
arXiv Detail & Related papers (2021-04-10T13:52:27Z) - Coded Stochastic ADMM for Decentralized Consensus Optimization with Edge
Computing [113.52575069030192]
Big data, including applications with high security requirements, are often collected and stored on multiple heterogeneous devices, such as mobile devices, drones and vehicles.
Due to the limitations of communication costs and security requirements, it is of paramount importance to extract information in a decentralized manner instead of aggregating data to a fusion center.
We consider the problem of learning model parameters in a multi-agent system with data locally processed via distributed edge nodes.
A class of mini-batch alternating direction method of multipliers (ADMM) algorithms is explored to develop the distributed learning model.
arXiv Detail & Related papers (2020-10-02T10:41:59Z) - MS-RANAS: Multi-Scale Resource-Aware Neural Architecture Search [94.80212602202518]
We propose Multi-Scale Resource-Aware Neural Architecture Search (MS-RANAS)
We employ a one-shot architecture search approach in order to obtain a reduced search cost.
We achieve state-of-the-art results in terms of accuracy-speed trade-off.
arXiv Detail & Related papers (2020-09-29T11:56:01Z) - Review of Swarm Intelligence-based Feature Selection Methods [3.8848561367220276]
Data mining applications with high dimensional datasets require high speed and accuracy.
One of the dimensionality reduction approaches is feature selection that can increase the accuracy of the data mining task.
State-of-the-art swarm intelligence are studied, and the recent feature selection methods based on these algorithms are reviewed.
arXiv Detail & Related papers (2020-08-07T05:18:58Z) - High-Order Information Matters: Learning Relation and Topology for
Occluded Person Re-Identification [84.43394420267794]
We propose a novel framework by learning high-order relation and topology information for discriminative features and robust alignment.
Our framework significantly outperforms state-of-the-art by6.5%mAP scores on Occluded-Duke dataset.
arXiv Detail & Related papers (2020-03-18T12:18:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.