Curvature Augmented Manifold Embedding and Learning

• URL: http://arxiv.org/abs/2403.14813v1
• Date: Thu, 21 Mar 2024 19:59:07 GMT
• Title: Curvature Augmented Manifold Embedding and Learning
• Authors: Yongming Liu,
• Abstract summary: A new dimensional reduction (DR) and data visualization method, Curvature-Augmented Manifold Embedding and Learning (CAMEL), is proposed. The key novel contribution is to formulate the DR problem as a mechanistic/physics model. Compared with many existing attractive-repulsive force-based methods, one unique contribution of the proposed method is to include a non-pairwise force.
• Score: 9.195829534223982
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: A new dimensional reduction (DR) and data visualization method, Curvature-Augmented Manifold Embedding and Learning (CAMEL), is proposed. The key novel contribution is to formulate the DR problem as a mechanistic/physics model, where the force field among nodes (data points) is used to find an n-dimensional manifold representation of the data sets. Compared with many existing attractive-repulsive force-based methods, one unique contribution of the proposed method is to include a non-pairwise force. A new force field model is introduced and discussed, inspired by the multi-body potential in lattice-particle physics and Riemann curvature in topology. A curvature-augmented force is included in CAMEL. Following this, CAMEL formulation for unsupervised learning, supervised learning, semi-supervised learning/metric learning, and inverse learning are provided. Next, CAMEL is applied to many benchmark datasets by comparing existing models, such as tSNE, UMAP, TRIMAP, and PacMap. Both visual comparison and metrics-based evaluation are performed. 14 open literature and self-proposed metrics are employed for a comprehensive comparison. Conclusions and future work are suggested based on the current investigation. Related code and demonstration are available on https://github.com/ymlasu/CAMEL for interested readers to reproduce the results and other applications.

Related papers

• A Distance Metric Learning Model Based On Variational Information Bottleneck [34.06440004780627]
  This paper proposes a new metric learning model VIB-DML (Variational Information Bottleneck Distance Metric Learning) for rating prediction. The results show that the generalization of VIB-DML is excellent. Compared with the general metric learning model MetricF, the prediction error is reduced by 7.29%.
  arXiv  Detail & Related papers  (2024-03-05T09:08:20Z)
• An Interpretable Evaluation of Entropy-based Novelty of Generative Models [36.29214321258605]
  We propose a Kernel-based Entropic Novelty (KEN) score to quantify the mode-based novelty of generative models. We present numerical results on synthetic and real image datasets, indicating the framework's effectiveness in detecting novel modes.
  arXiv  Detail & Related papers  (2024-02-27T08:00:52Z)
• NPEFF: Non-Negative Per-Example Fisher Factorization [52.44573961263344]
  We introduce a novel interpretability method called NPEFF that is readily applicable to any end-to-end differentiable model. We demonstrate that NPEFF has interpretable tunings through experiments on language and vision models.
  arXiv  Detail & Related papers  (2023-10-07T02:02:45Z)
• BroadCAM: Outcome-agnostic Class Activation Mapping for Small-scale Weakly Supervised Applications [69.22739434619531]
  We propose an outcome-agnostic CAM approach, called BroadCAM, for small-scale weakly supervised applications. By evaluating BroadCAM on VOC2012 and BCSS-WSSS for WSSS and OpenImages30k for WSOL, BroadCAM demonstrates superior performance.
  arXiv  Detail & Related papers  (2023-09-07T06:45:43Z)
• Maximum Covariance Unfolding Regression: A Novel Covariate-based Manifold Learning Approach for Point Cloud Data [11.34706571302446]
  Point cloud data are widely used in manufacturing applications for process inspection, modeling, monitoring and optimization. The state-of-art tensor regression techniques have effectively been used for analysis of structured point cloud data. However, these techniques are not capable of handling unstructured point cloud data.
  arXiv  Detail & Related papers  (2023-03-31T07:29:36Z)
• CAMEL: Curvature-Augmented Manifold Embedding and Learning [21.945022912830044]
  Curvature-Augmented Manifold Embedding and Learning (CAMEL) is proposed for high dimensional data classification, dimension reduction, and visualization. CAMEL has been evaluated on various benchmark datasets and has shown to outperform state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-03-05T03:12:50Z)
• The Manifold Hypothesis for Gradient-Based Explanations [55.01671263121624]
  gradient-based explanation algorithms provide perceptually-aligned explanations. We show that the more a feature attribution is aligned with the tangent space of the data, the more perceptually-aligned it tends to be. We suggest that explanation algorithms should actively strive to align their explanations with the data manifold.
  arXiv  Detail & Related papers  (2022-06-15T08:49:24Z)
• MACE: An Efficient Model-Agnostic Framework for Counterfactual Explanation [132.77005365032468]
  We propose a novel framework of Model-Agnostic Counterfactual Explanation (MACE) In our MACE approach, we propose a novel RL-based method for finding good counterfactual examples and a gradient-less descent method for improving proximity. Experiments on public datasets validate the effectiveness with better validity, sparsity and proximity.
  arXiv  Detail & Related papers  (2022-05-31T04:57:06Z)
• Learning new physics efficiently with nonparametric methods [11.970219534238444]
  We present a machine learning approach for model-independent new physics searches. The corresponding algorithm is powered by recent large-scale implementations of kernel methods. We show that our approach has dramatic advantages compared to neural network implementations in terms of training times and computational resources.
  arXiv  Detail & Related papers  (2022-04-05T16:17:59Z)
• Hyperbolic Vision Transformers: Combining Improvements in Metric Learning [116.13290702262248]
  We propose a new hyperbolic-based model for metric learning. At the core of our method is a vision transformer with output embeddings mapped to hyperbolic space. We evaluate the proposed model with six different formulations on four datasets.
  arXiv  Detail & Related papers  (2022-03-21T09:48:23Z)
• Mix Dimension in Poincar\'{e} Geometry for 3D Skeleton-based Action Recognition [57.98278794950759]
  Graph Convolutional Networks (GCNs) have already demonstrated their powerful ability to model the irregular data. We present a novel spatial-temporal GCN architecture which is defined via the Poincar'e geometry. We evaluate our method on two current largest scale 3D datasets.
  arXiv  Detail & Related papers  (2020-07-30T18:23:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.