TopoMap: A Feature-based Semantic Discriminator of the Topographical Regions in the Test Input Space

• URL: http://arxiv.org/abs/2509.03242v1
• Date: Wed, 03 Sep 2025 11:57:42 GMT
• Title: TopoMap: A Feature-based Semantic Discriminator of the Topographical Regions in the Test Input Space
• Abstract summary: Testing Deep Learning (DL)-based systems is an open challenge.<n>We create an explicit topographical map of the input feature space.<n>Our approach, named TopoMap, is both black-box and model-agnostic.
• Score: 8.844699137494105
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Testing Deep Learning (DL)-based systems is an open challenge. Although it is relatively easy to find inputs that cause a DL model to misbehave, the grouping of inputs by features that make the DL model under test fail is largely unexplored. Existing approaches for DL testing introduce perturbations that may focus on specific failure-inducing features, while neglecting others that belong to different regions of the feature space. In this paper, we create an explicit topographical map of the input feature space. Our approach, named TopoMap, is both black-box and model-agnostic as it relies solely on features that characterise the input space. To discriminate the inputs according to the specific features they share, we first apply dimensionality reduction to obtain input embeddings, which are then subjected to clustering. Each DL model might require specific embedding computations and clustering algorithms to achieve a meaningful separation of inputs into discriminative groups. We propose a novel way to evaluate alternative configurations of embedding and clustering techniques. We used a deep neural network (DNN) as an approximation of a human evaluator who could tell whether a pair of clusters can be discriminated based on the features of the included elements. We use such a DNN to automatically select the optimal topographical map of the inputs among all those that are produced by different embedding/clustering configurations. The evaluation results show that the maps generated by TopoMap consist of distinguishable and meaningful regions. In addition, we evaluate the effectiveness of TopoMap using mutation analysis. In particular, we assess whether the clusters in our topographical map allow for an effective selection of mutation-killing inputs. Experimental results show that our approach outperforms random selection by 35% on average on killable mutants; by 61% on non-killable ones.

Related papers

• Diversity-Based Active Learning: An Evaluation of Metric Spaces for Active Learning Selection [0.0]
  Pool-based active learning minimizes costs by querying only the most informative samples from an unlabeled dataset.<n> Diversity-based approaches, on the other hand, attempt to select a representative subset of the data.<n>We will focus on evaluating the performance of Greedy K-center across a variety of metric spaces.
  arXiv  Detail & Related papers  (2026-08-24T16:30:10Z)
• Model-based feature selection for neural networks: A mixed-integer programming approach [0.9281671380673306]
  We develop a novel input feature selection framework for ReLU-based deep neural networks (DNNs) We focus on finding input features for image classification for clarity of presentation. We show that the proposed input feature selection allows us to drastically reduce the size of the input to $sim$15% while maintaining a good classification accuracy.
  arXiv  Detail & Related papers  (2023-02-20T22:19:50Z)
• Self-Supervised Clustering on Image-Subtracted Data with Deep-Embedded Self-Organizing Map [0.0]
  Self-supervised machine learning model, the deep-embedded self-organizing map (DESOM) is applied to real-bogus classification problem. We demonstrate different model training approaches, and find that our best DESOM classifier shows a missed detection rate of 6.6% with a false positive rate of 1.5%.
  arXiv  Detail & Related papers  (2022-09-14T02:37:06Z)
• Combating Mode Collapse in GANs via Manifold Entropy Estimation [70.06639443446545]
  Generative Adversarial Networks (GANs) have shown compelling results in various tasks and applications. We propose a novel training pipeline to address the mode collapse issue of GANs.
  arXiv  Detail & Related papers  (2022-08-25T12:33:31Z)
• Smoothed Embeddings for Certified Few-Shot Learning [63.68667303948808]
  We extend randomized smoothing to few-shot learning models that map inputs to normalized embeddings. Our results are confirmed by experiments on different datasets.
  arXiv  Detail & Related papers  (2022-02-02T18:19:04Z)
• Attentive Prototypes for Source-free Unsupervised Domain Adaptive 3D Object Detection [85.11649974840758]
  3D object detection networks tend to be biased towards the data they are trained on. We propose a single-frame approach for source-free, unsupervised domain adaptation of lidar-based 3D object detectors.
  arXiv  Detail & Related papers  (2021-11-30T18:42:42Z)
• CAMERAS: Enhanced Resolution And Sanity preserving Class Activation Mapping for image saliency [61.40511574314069]
  Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input. We propose CAMERAS, a technique to compute high-fidelity backpropagation saliency maps without requiring any external priors.
  arXiv  Detail & Related papers  (2021-06-20T08:20:56Z)
• DAAIN: Detection of Anomalous and Adversarial Input using Normalizing Flows [52.31831255787147]
  We introduce a novel technique, DAAIN, to detect out-of-distribution (OOD) inputs and adversarial attacks (AA) Our approach monitors the inner workings of a neural network and learns a density estimator of the activation distribution. Our model can be trained on a single GPU making it compute efficient and deployable without requiring specialized accelerators.
  arXiv  Detail & Related papers  (2021-05-30T22:07:13Z)
• A Boundary Regression Model for Nested Named Entity Recognition [17.968819067122418]
  Recognizing named entities (NEs) is commonly conducted as a classification problem that predicts a class tag for an NE candidate in a sentence. Recent developments in neural networks have adopted deep structures that map categorized features into continuous representations. In this paper, the regression operation is introduced to locate NEs in a sentence.
  arXiv  Detail & Related papers  (2020-11-29T10:04:38Z)
• A Survey and Implementation of Performance Metrics for Self-Organized Maps [0.0]
  Self-Organizing Map algorithms have been used for almost 40 years across various application domains. This paper introduces each metric available in our module along with usage examples.
  arXiv  Detail & Related papers  (2020-11-11T15:28:33Z)
• Differentiable Hierarchical Graph Grouping for Multi-Person Pose Estimation [95.72606536493548]
  Multi-person pose estimation is challenging because it localizes body keypoints for multiple persons simultaneously. We propose a novel differentiable Hierarchical Graph Grouping (HGG) method to learn the graph grouping in bottom-up multi-person pose estimation task.
  arXiv  Detail & Related papers  (2020-07-23T08:46:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.