Neighborhood Structure Assisted Non-negative Matrix Factorization and
its Application in Unsupervised Point-wise Anomaly Detection
- URL: http://arxiv.org/abs/2001.06541v3
- Date: Fri, 5 Feb 2021 03:04:25 GMT
- Title: Neighborhood Structure Assisted Non-negative Matrix Factorization and
its Application in Unsupervised Point-wise Anomaly Detection
- Authors: Imtiaz Ahmed, Xia Ben Hu, Mithun P. Acharya and Yu Ding
- Abstract summary: We propose to incorporate the neighborhood structure information within the NMF framework by modeling the data through a minimum spanning tree.
We label the resulting method as the neighborhood structure assisted NMF.
Empirical comparisons using twenty benchmark datasets as well as an industrial dataset extracted from a hydropower plant demonstrate the superiority of the neighborhood structure assisted NMF.
- Score: 6.859284479314336
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Dimensionality reduction is considered as an important step for ensuring
competitive performance in unsupervised learning such as anomaly detection.
Non-negative matrix factorization (NMF) is a popular and widely used method to
accomplish this goal. But NMF do not have the provision to include the
neighborhood structure information and, as a result, may fail to provide
satisfactory performance in presence of nonlinear manifold structure. To
address that shortcoming, we propose to consider and incorporate the
neighborhood structural similarity information within the NMF framework by
modeling the data through a minimum spanning tree. We label the resulting
method as the neighborhood structure assisted NMF. We further devise both
offline and online algorithmic versions of the proposed method. Empirical
comparisons using twenty benchmark datasets as well as an industrial dataset
extracted from a hydropower plant demonstrate the superiority of the
neighborhood structure assisted NMF and support our claim of merit. Looking
closer into the formulation and properties of the neighborhood structure
assisted NMF with other recent, enhanced versions of NMF reveals that inclusion
of the neighborhood structure information using MST plays a key role in
attaining the enhanced performance in anomaly detection.
Related papers
- Nonnegative Matrix Factorization in Dimensionality Reduction: A Survey [45.06188379747932]
Dimensionality Reduction plays a pivotal role in improving feature learning accuracy and reducing training time.
Nonnegative Matrix Factorization (NMF) has emerged as a popular and powerful method for dimensionality reduction.
This paper presents a comprehensive survey of NMF, focusing on its applications in both feature extraction and feature selection.
arXiv Detail & Related papers (2024-05-06T16:32:01Z) - Graph Regularized NMF with L20-norm for Unsupervised Feature Learning [6.894518335015327]
Graph Regularized Non-negative Matrix Factorization (GNMF) is an extension of NMF that incorporates graph regularization constraints.
We propose an unsupervised feature learning framework based on GNMF and devise an algorithm based on PALM.
arXiv Detail & Related papers (2024-03-16T12:10:01Z) - Rethinking Clustered Federated Learning in NOMA Enhanced Wireless
Networks [60.09912912343705]
This study explores the benefits of integrating the novel clustered federated learning (CFL) approach with non-independent and identically distributed (non-IID) datasets.
A detailed theoretical analysis of the generalization gap that measures the degree of non-IID in the data distribution is presented.
Solutions to address the challenges posed by non-IID conditions are proposed with the analysis of the properties.
arXiv Detail & Related papers (2024-03-05T17:49:09Z) - Ensemble Kalman Filtering Meets Gaussian Process SSM for Non-Mean-Field and Online Inference [47.460898983429374]
We introduce an ensemble Kalman filter (EnKF) into the non-mean-field (NMF) variational inference framework to approximate the posterior distribution of the latent states.
This novel marriage between EnKF and GPSSM not only eliminates the need for extensive parameterization in learning variational distributions, but also enables an interpretable, closed-form approximation of the evidence lower bound (ELBO)
We demonstrate that the resulting EnKF-aided online algorithm embodies a principled objective function by ensuring data-fitting accuracy while incorporating model regularizations to mitigate overfitting.
arXiv Detail & Related papers (2023-12-10T15:22:30Z) - Efficient Multi-View Graph Clustering with Local and Global Structure
Preservation [59.49018175496533]
We propose a novel anchor-based multi-view graph clustering framework termed Efficient Multi-View Graph Clustering with Local and Global Structure Preservation (EMVGC-LG)
Specifically, EMVGC-LG jointly optimize anchor construction and graph learning to enhance the clustering quality.
In addition, EMVGC-LG inherits the linear complexity of existing AMVGC methods respecting the sample number.
arXiv Detail & Related papers (2023-08-31T12:12:30Z) - Supervised Class-pairwise NMF for Data Representation and Classification [2.7320863258816512]
Non-negative Matrix factorization (NMF) based methods add new terms to the cost function to adapt the model to specific tasks.
NMF method adopts unsupervised approaches to estimate the factorizing matrices.
arXiv Detail & Related papers (2022-09-28T04:33:03Z) - Finding Rule-Interpretable Non-Negative Data Representation [2.817412580574242]
We present a version of the NMF approach that merges rule-based descriptions with advantages of part-based representation.
The proposed approach provides numerous advantages in tasks such as focused embedding or performing supervised multi-label NMF.
arXiv Detail & Related papers (2022-06-03T10:20:46Z) - Hyperspectral Unmixing Based on Nonnegative Matrix Factorization: A
Comprehensive Review [25.50091058791411]
Hyperspectral unmixing estimates a set of endmembers and their corresponding abundances from a hyperspectral image.
Nonnegative matrix factorization (NMF) plays an increasingly significant role in solving this problem.
We show how to improve NMF by utilizing the main properties of HSIs.
arXiv Detail & Related papers (2022-05-20T02:48:43Z) - Log-based Sparse Nonnegative Matrix Factorization for Data
Representation [55.72494900138061]
Nonnegative matrix factorization (NMF) has been widely studied in recent years due to its effectiveness in representing nonnegative data with parts-based representations.
We propose a new NMF method with log-norm imposed on the factor matrices to enhance the sparseness.
A novel column-wisely sparse norm, named $ell_2,log$-(pseudo) norm, is proposed to enhance the robustness of the proposed method.
arXiv Detail & Related papers (2022-04-22T11:38:10Z) - Non-Linear Spectral Dimensionality Reduction Under Uncertainty [107.01839211235583]
We propose a new dimensionality reduction framework, called NGEU, which leverages uncertainty information and directly extends several traditional approaches.
We show that the proposed NGEU formulation exhibits a global closed-form solution, and we analyze, based on the Rademacher complexity, how the underlying uncertainties theoretically affect the generalization ability of the framework.
arXiv Detail & Related papers (2022-02-09T19:01:33Z) - Two-Dimensional Semi-Nonnegative Matrix Factorization for Clustering [50.43424130281065]
We propose a new Semi-Nonnegative Matrix Factorization method for 2-dimensional (2D) data, named TS-NMF.
It overcomes the drawback of existing methods that seriously damage the spatial information of the data by converting 2D data to vectors in a preprocessing step.
arXiv Detail & Related papers (2020-05-19T05:54:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.