Model-Agnostic Signal Discovery with Machine Learning: Bridging the Gap Between Theory and Practice

• URL: http://arxiv.org/abs/2605.31103v1
• Date: Fri, 29 May 2026 10:14:58 GMT
• Title: Model-Agnostic Signal Discovery with Machine Learning: Bridging the Gap Between Theory and Practice
• Abstract summary: We review the conceptual framework behind the main classes of AI-based model-agnostic strategies.<n>We discuss the potential pitfalls of these methods, and strategies for their validation and interpretation.
• Score: 0.18352113484137625
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Searches for new phenomena in complex scientific data are predominantly model-dependent, optimized for specific hypotheses, and therefore limited in their coverage of the space of possible signals. Recently, new AI-based model-agnostic search strategies, many of which have been pioneered in high-energy physics, have been proposed which provide a complementary paradigm, prioritizing broad exploration over tailored analyses. These techniques offer an opportunity to enhance the overall discovery potential of modern experiments, especially in regimes where theoretical guidance is scarce. In this document, we review the conceptual framework behind the main classes of AI-based model-agnostic strategies. We discuss the potential pitfalls of these methods, and strategies for their validation and interpretation. We aim for this document to serve as a useful reference both for practitioners and for researchers interested in learning more about these model-agnostic search strategies.

Related papers

• Accelerating Scientific Research with Gemini: Case Studies and Common Techniques [105.15622072347811]
  Large language models (LLMs) have opened new avenues for accelerating scientific research.<n>We present a collection of case studies demonstrating how researchers have successfully collaborated with advanced AI models.
  arXiv  Detail & Related papers  (2026-02-03T18:56:17Z)
• Part I: Tricks or Traps? A Deep Dive into RL for LLM Reasoning [53.85659415230589]
  This paper systematically reviews widely adoptedReinforcement learning techniques.<n>We present clear guidelines for selecting RL techniques tailored to specific setups.<n>We also reveal that a minimalist combination of two techniques can unlock the learning capability of critic-free policies.
  arXiv  Detail & Related papers  (2025-08-11T17:39:45Z)
• Model Steering: Learning with a Reference Model Improves Generalization Bounds and Scaling Laws [52.10468229008941]
  This paper formalizes an emerging learning paradigm that uses a trained model as a reference to guide and enhance the training of a target model through strategic data selection or weighting.<n>We provide theoretical insights into why this approach improves generalization and data efficiency compared to training without a reference model.<n>Building on these insights, we introduce a novel method for Contrastive Language-Image Pretraining with a reference model, termed DRRho-CLIP.
  arXiv  Detail & Related papers  (2025-05-10T16:55:03Z)
• Speculative Decoding and Beyond: An In-Depth Survey of Techniques [9.362838127921458]
  Sequential dependencies present a fundamental bottleneck in deploying large-scale autoregressive models.<n>Recent advances in generation-refinement frameworks demonstrate that this trade-off can be significantly mitigated.
  arXiv  Detail & Related papers  (2025-02-27T03:53:45Z)
• Methods and Trends in Detecting AI-Generated Images: A Comprehensive Review [0.17188280334580194]
  Generative Adversarial Networks (GANs), Diffusion Models, and Variational Autoencoders (VAEs) have enabled the synthesis of high-quality multimedia data.<n>These advancements have also raised significant concerns regarding adversarial attacks, unethical usage, and societal harm.<n>This survey provides a comprehensive review of state-of-the-art techniques for detecting and classifying synthetic images generated by advanced generative AI models.
  arXiv  Detail & Related papers  (2025-02-21T03:16:18Z)
• Exploring the Precise Dynamics of Single-Layer GAN Models: Leveraging Multi-Feature Discriminators for High-Dimensional Subspace Learning [0.0]
  We study the training dynamics of a single-layer GAN model from the perspective of subspace learning. By bridging our analysis to the realm of subspace learning, we systematically compare the efficacy of GAN-based methods against conventional approaches.
  arXiv  Detail & Related papers  (2024-11-01T10:21:12Z)
• Coding for Intelligence from the Perspective of Category [66.14012258680992]
  Coding targets compressing and reconstructing data, and intelligence. Recent trends demonstrate the potential homogeneity of these two fields. We propose a novel problem of Coding for Intelligence from the category theory view.
  arXiv  Detail & Related papers  (2024-07-01T07:05:44Z)
• Model-Free Active Exploration in Reinforcement Learning [53.786439742572995]
  We study the problem of exploration in Reinforcement Learning and present a novel model-free solution. Our strategy is able to identify efficient policies faster than state-of-the-art exploration approaches.
  arXiv  Detail & Related papers  (2024-06-30T19:00:49Z)
• Pioneering EEG Motor Imagery Classification Through Counterfactual Analysis [26.859082755430595]
  We introduce and explore a novel non-generative approach to counterfactual explanation (CE) This approach assesses the model's decision-making process by strategically swapping patches derived from time-frequency analyses. The empirical results serve not only to validate the efficacy of our proposed approach but also to reinforce human confidence in the model's predictive capabilities.
  arXiv  Detail & Related papers  (2023-11-10T08:22:09Z)
• Provable Reward-Agnostic Preference-Based Reinforcement Learning [61.39541986848391]
  Preference-based Reinforcement Learning (PbRL) is a paradigm in which an RL agent learns to optimize a task using pair-wise preference-based feedback over trajectories. We propose a theoretical reward-agnostic PbRL framework where exploratory trajectories that enable accurate learning of hidden reward functions are acquired.
  arXiv  Detail & Related papers  (2023-05-29T15:00:09Z)
• A Multi-criteria Approach to Evolve Sparse Neural Architectures for Stock Market Forecasting [0.0]
  This study proposes a new framework to evolve efficacious yet parsimonious neural architectures for the movement prediction of stock market indices. A new search paradigm, Two-Dimensional Swarms (2DS) is proposed for the multi-criteria neural architecture search. The results of this study convincingly demonstrate that the proposed approach can evolve parsimonious networks with better generalization capabilities.
  arXiv  Detail & Related papers  (2021-11-15T19:44:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.