Diversified Residual Symbolic Regression

• URL: http://arxiv.org/abs/2605.15809v1
• Date: Fri, 15 May 2026 10:04:03 GMT
• Title: Diversified Residual Symbolic Regression
• Abstract summary: We propose a diversified residual symbolic regression approach.<n>It achieves high predictive accuracy while promoting diversity with respect to residual patterns.<n>On a real-world astronomical dataset, it discovers multiple expressions consistent with known physical relationships.
• Score: 5.2966238638941645
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Symbolic regression (SR) aims to discover explicit mathematical expressions that explain observed data and is widely used in domains where interpretability is essential. Because interpretability requires expressions to reflect meaningful regularities, SR is sensitive to observations that deviate from the dominant relationship. Such irregular observations, or outliers, are common in real-world data and can hinder SR from identifying underlying regularities. Robust regression mitigates this by downweighting observations with large residuals. However, deciding which observations should be treated as outliers is often ambiguous and depends on user interpretation and domain knowledge, a perspective largely overlooked in existing SR studies. This motivates approaches that present multiple candidate expressions, allowing users to examine different residual patterns and choose expressions consistent with their expertise. We propose diversified residual symbolic regression (DRSR), which achieves high predictive accuracy while promoting diversity with respect to residual patterns based on the Quality-Diversity paradigm. DRSR collects multiple expressions that fit the data well but differ in how residuals are distributed, enabling post-search selection aligned with domain knowledge. On a synthetic mixture dataset, DRSR produces more diverse expressions than conventional SR while capturing multiple underlying relationships. On a real-world astronomical dataset, DRSR discovers multiple expressions consistent with known physical relationships.

Related papers

• C$^{2}$R: Cross-sample Consistency Regularization Mitigates Feature Splitting and Absorption in Sparse Autoencoders [56.67585330425431]
  Sparse Autoencoders (SAEs) are widely used to interpret large language models by decomposing activations into sparse, human-understandable features.<n>These issues stem from inconsistent latent assignment across samples.<n>We introduce C$2$R, which penalizes the co-activation of directionally similar latents.
  arXiv  Detail & Related papers  (2026-06-29T17:45:31Z)
• Towards Anomaly Detection on Relational Data [51.473064583839296]
  We propose a reconstruction-based framework that captures anomalies from both attribute and relational edge reconstruction.<n>RelAD consistently outperforms other baselines while achieving competitive efficiency.
  arXiv  Detail & Related papers  (2026-06-17T02:36:32Z)
• Thinking Before Matching: A Reinforcement Reasoning Paradigm Towards General Person Re-Identification [77.51622646061314]
  ReID-R is proposed as a novel reasoning-driven paradigm that achieves explicit identity understanding and reasoning.<n>Experiments on multiple ReID benchmarks demonstrate that ReID-R achieves competitive identity discrimination as superior methods.
  arXiv  Detail & Related papers  (2026-04-21T08:24:07Z)
• Learning Invariant Modality Representation for Robust Multimodal Learning from a Causal Inference Perspective [6.3310165899037045]
  We propose a causal modality-invariant representation (CmIR) learning framework for robust multimodal learning.<n>CmIR ensures that the learned invariant representations retain stable predictive relationships with labels across different environments.<n>CmIR excels on out-of-distribution data and noisy data, confirming its robustness and generalizability.
  arXiv  Detail & Related papers  (2026-04-20T16:16:36Z)
• Context-Aware Search and Retrieval Under Token Erasure [10.728269379368099]
  This paper introduces and analyzes a search and retrieval model for RAG-like systems under token erasures.<n>We provide an information-theoretic analysis of remote document retrieval when query representations are only partially preserved.
  arXiv  Detail & Related papers  (2026-04-20T15:42:12Z)
• Human Label Variation in Implicit Discourse Relation Recognition [14.762949592713914]
  Implicit Discourse Relation Recognition (IDRR) is a highly ambiguous task where disagreement often arises from cognitive complexity rather than ideological bias.<n>Our experiments show that existing annotator-specific models perform poorly in IDRR unless ambiguity is reduced.<n>Further analysis indicates that frequent cognitively demanding cases drive inconsistency in human interpretation, posing challenges for perspectivist modeling in IDRR.
  arXiv  Detail & Related papers  (2026-02-26T07:56:24Z)
• rEGGression: an Interactive and Agnostic Tool for the Exploration of Symbolic Regression Models [0.0]
  We introduce rEGGression, a tool using e-graphs to enable the exploration of a large set of symbolic expressions.<n>The main highlight is its focus in the exploration of the building blocks found during the search that can help the experts to find insights about the studied phenomena.
  arXiv  Detail & Related papers  (2025-01-29T18:57:44Z)
• Multi-View Symbolic Regression [1.2334534968968969]
  We present Multi-View Symbolic Regression (MvSR), which takes into account multiple datasets simultaneously. MvSR fits the evaluated expression to each independent dataset and returns a parametric family of functions. We demonstrate the effectiveness of MvSR using data generated from known expressions, as well as real-world data from astronomy, chemistry and economy.
  arXiv  Detail & Related papers  (2024-02-06T15:53:49Z)
• Equivariance Allows Handling Multiple Nuisance Variables When Analyzing Pooled Neuroimaging Datasets [53.34152466646884]
  In this paper, we show how bringing recent results on equivariant representation learning instantiated on structured spaces together with simple use of classical results on causal inference provides an effective practical solution. We demonstrate how our model allows dealing with more than one nuisance variable under some assumptions and can enable analysis of pooled scientific datasets in scenarios that would otherwise entail removing a large portion of the samples.
  arXiv  Detail & Related papers  (2022-03-29T04:54:06Z)
• Regularizing Variational Autoencoder with Diversity and Uncertainty Awareness [61.827054365139645]
  Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. We propose an alternative model, DU-VAE, for learning a more Diverse and less Uncertain latent space.
  arXiv  Detail & Related papers  (2021-10-24T07:58:13Z)
• A comprehensive comparative evaluation and analysis of Distributional Semantic Models [61.41800660636555]
  We perform a comprehensive evaluation of type distributional vectors, either produced by static DSMs or obtained by averaging the contextualized vectors generated by BERT. The results show that the alleged superiority of predict based models is more apparent than real, and surely not ubiquitous. We borrow from cognitive neuroscience the methodology of Representational Similarity Analysis (RSA) to inspect the semantic spaces generated by distributional models.
  arXiv  Detail & Related papers  (2021-05-20T15:18:06Z)
• Deconfounded Score Method: Scoring DAGs with Dense Unobserved Confounding [101.35070661471124]
  We show that unobserved confounding leaves a characteristic footprint in the observed data distribution that allows for disentangling spurious and causal effects. We propose an adjusted score-based causal discovery algorithm that may be implemented with general-purpose solvers and scales to high-dimensional problems.
  arXiv  Detail & Related papers  (2021-03-28T11:07:59Z)
• When Relation Networks meet GANs: Relation GANs with Triplet Loss [110.7572918636599]
  Training stability is still a lingering concern of generative adversarial networks (GANs) In this paper, we explore a relation network architecture for the discriminator and design a triplet loss which performs better generalization and stability. Experiments on benchmark datasets show that the proposed relation discriminator and new loss can provide significant improvement on variable vision tasks.
  arXiv  Detail & Related papers  (2020-02-24T11:35:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.