Cross-domain benchmarks reveal when coordinated AI agents improve scientific inference from partial evidence

• URL: http://arxiv.org/abs/2605.22300v1
• Date: Thu, 21 May 2026 10:46:50 GMT
• Title: Cross-domain benchmarks reveal when coordinated AI agents improve scientific inference from partial evidence
• Abstract summary: We evaluate when coordinated AI agents add value over simpler scientific provenance tasks.<n>Cases include mapping molecular structure into musical representations, detecting historical paradigm shifts in science, and vetting transiting-exoplanet candidates.<n>Results: When different disciplines each capture only part of the phenomenon, cross-channel composites improve over single-channel baselines.
• Score: 1.1458853556386797
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Scientific evidence often spans instruments, databases, and disciplines, so no single source records the full phenomenon. This makes it difficult to determine when coordinated AI agents add value over simpler scientific workflows. We evaluate this question with a cross-domain benchmark spanning four scientific tasks: mapping molecular structure into musical representations, detecting historical paradigm shifts in science, identifying vector-borne disease emergence, and vetting transiting-exoplanet candidates. Each case uses a frozen evaluation panel, predefined scoring protocols, explicit baselines, ablations or null controls, and stated limitations. The results define three operating regimes. When different disciplines each capture only part of the phenomenon, cross-channel composites improve over single-channel baselines: climate-vector emergence reaches AUROC 0.944 and exoplanet vetting reaches AUROC 0.955. However, the exoplanet workflow is effectively tied with a strong combined-summary baseline, showing that decomposition does not always improve top-line performance. When one signal dominates, as in paradigm-shift detection, coordination mainly improves interpretation and traceability. For molecular sonification, the gain is representational rather than predictive. ScienceClaw x Infinite provides the auditable artifact and provenance layer for this evaluation. The benchmark therefore assigns value to coordination only when the corresponding performance, provenance, or representation claim is supported by explicit comparators.

Related papers

• A Multi-Branch Feature Fusion Approach for Health Misinformation Detection and Propagation [0.0]
  This paper presents a multi-branch fusion framework for detecting and characterising the propagation of health misinformation in online social networks (OSNs)<n>The framework fuses transformer-based semantics with rhetorical cues, stance representations, and psychologically motivated proxies.<n> Experiments on three benchmark datasets, Constraint, COVID--19_FNIR, and Monkeypox, show strong classification performance.
  arXiv  Detail & Related papers  (2026-08-31T21:36:43Z)
• Inter-X++: A Comprehensive Benchmark for Multimodal Human-Human Interaction Analysis [55.78822230833247]
  We present Inter-X++, a comprehensive and large-scale benchmark designed to empower versatile HHI analysis.<n>Inter-X++ provides 11,388 high-fidelity interaction sequences and over 8.1M frames, featuring precise whole-body movements and detailed finger articulations.<n>We propose OpenHHI, a single and unified HHI representation and modeling framework that jointly optimize interaction reconstruction and semantic understanding.
  arXiv  Detail & Related papers  (2026-08-20T17:51:48Z)
• Compositional Benchmark Synthesis for Hierarchical Human Action Recognition [4.812022454180755]
  A benchmark-generation and evaluation frameworkis proposed that synthesizes a four-level hierarchical-intention benchmark.<n> Episodes are assembled by a transition model under a subject-consistency constraint.<n>A coverage-aware sampler reduces the subject usage Gini from 0.566 to 0.248.
  arXiv  Detail & Related papers  (2026-08-11T10:22:22Z)
• Beyond Pairwise Relations: Dynamic Manipulation Hypergraphs for Vision-Based Human Activity Recognition [0.0]
  Fine-grained manipulation recognition requires modeling evolving relations among hands, objects, tools, and supporting surfaces.<n>We propose a dynamic manipulation hypergraph framework that represents multi-entity configurations as higher-order relational units.
  arXiv  Detail & Related papers  (2026-07-15T20:26:53Z)
• Where Black-box Drug-Target Interaction Prediction Models Look: Cross-Method Explainability [4.792942098478821]
  We present an interpretability audit of BridgeDPI architecture on three different datasets.<n>We summarize sensitivity and signed effects at raw inputs, at the bridge similarity scaffold, and through the graph convolution.<n>Results show that explainability is most informative when treated as model criticism.
  arXiv  Detail & Related papers  (2026-06-12T08:22:43Z)
• Beyond Binary Success: A Diagnostic Meta-Evaluation Framework for Fine-Grained Manipulation [98.79811866787263]
  We introduce MetaFine, a diagnostic meta-evaluation framework that disentangles manipulation competency along three axes.<n>We identify the visual encoder's ability to preserve local spatial structure as a key bottleneck for fine-grained precision.<n>By shifting evaluation from ranking to diagnosis, MetaFine turns benchmarking into an actionable compass for repairing the layered capacities underlying genuine physical dexterity.
  arXiv  Detail & Related papers  (2026-05-19T15:25:13Z)
• Sheaf-Theoretic Transport and Obstruction for Detecting Scientific Theory Shift in AI Agents [0.0]
  This paper develops a finite sheaf-theoretic framework for detecting theory-shift candidates through transport and obstruction.<n>We evaluate the framework on a controlled transition-card benchmark designed to separate deformation within a source language from extension of that language.
  arXiv  Detail & Related papers  (2026-05-13T18:46:17Z)
• How to Interpret Agent Behavior [56.59836196946289]
  We introduce ACT*ONOMY, a taxonomy for describing and analyzing agent behavior at runtime.<n>By providing a shared vocabulary, ACT*ONOMY helps researchers, agent designers, and end users interpret agent behavior more consistently.
  arXiv  Detail & Related papers  (2026-05-13T14:52:40Z)
• Validation of Whole-Slide Foundation Models for Image Retrieval in TCGA Data [1.834937230572996]
  We benchmarked ten pipelines on 9,387 diagnostic slides spanning 17 organs and 60 diagnoses from The Cancer Genome Atlas.<n>Methods included four pre-trained slide foundation models, a supervised attention-based multiple instance learning (ABMIL) aggregator on patch embeddings, and patch-level retrieval.
  arXiv  Detail & Related papers  (2026-04-28T19:19:53Z)
• NeuroTrace: Inference Provenance-Based Detection of Adversarial Examples [1.096626056612224]
  We introduce NeuroTrace, a framework for analyzing inference provenance through Inference Provenance Graphs (IPGs)<n>IPGs are heterogeneous graphs that capture both activation behavior and parameter-induced dataflow during a model's forward pass.<n>We evaluate IPG-based detectors for adversarial example detection under intra-attack, multi-attack, and cross-threat transfer settings.
  arXiv  Detail & Related papers  (2026-04-15T22:23:40Z)
• Autonomous Agents Coordinating Distributed Discovery Through Emergent Artifact Exchange [3.923443951480117]
  ScienceClaw + Infinite is a framework for autonomous scientific investigation in which independent agents conduct research without central coordination.<n>The system is built around three components: an interoperable registry of over 300 scientific skills, an artifact layer that preserves full computational lineage, and a structured platform for agent-based scientific discourse.
  arXiv  Detail & Related papers  (2026-03-15T10:06:57Z)
• RPG-AE: Neuro-Symbolic Graph Autoencoders with Rare Pattern Mining for Provenance-Based Anomaly Detection [0.8373057326694192]
  This paper presents a neuro-symbolic anomaly detection framework that combines a Graph Autoencoder with rare pattern mining.<n>Anomaly candidates are identified through deviations between observed and reconstructed graph structure.<n>We evaluate the proposed method on the DARPA Transparent Computing datasets and show that rare-pattern boosting yields substantial gains in anomaly ranking quality.
  arXiv  Detail & Related papers  (2026-02-03T00:02:37Z)
• Degree-Conscious Spiking Graph for Cross-Domain Adaptation [51.58506501415558]
  Spiking Graph Networks (SGNs) have demonstrated significant potential in graph classification.<n>We introduce a novel framework named Degree-Consicious Spiking Graph for Cross-Domain Adaptation (DeSGraDA)<n>DeSGraDA enhances generalization across domains with three key components.
  arXiv  Detail & Related papers  (2024-10-09T13:45:54Z)
• What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding [67.59552859593985]
  Graph Transformers, which incorporate self-attention and positional encoding, have emerged as a powerful architecture for various graph learning tasks. This paper introduces first theoretical investigation of a shallow Graph Transformer for semi-supervised classification.
  arXiv  Detail & Related papers  (2024-06-04T05:30:16Z)
• Optimizing OOD Detection in Molecular Graphs: A Novel Approach with Diffusion Models [71.39421638547164]
  We propose to detect OOD molecules by adopting an auxiliary diffusion model-based framework, which compares similarities between input molecules and reconstructed graphs. Due to the generative bias towards reconstructing ID training samples, the similarity scores of OOD molecules will be much lower to facilitate detection. Our research pioneers an approach of Prototypical Graph Reconstruction for Molecular OOD Detection, dubbed as PGR-MOOD and hinges on three innovations.
  arXiv  Detail & Related papers  (2024-04-24T03:25:53Z)
• Self-Challenging Improves Cross-Domain Generalization [81.99554996975372]
  Convolutional Neural Networks (CNN) conduct image classification by activating dominant features that correlated with labels. We introduce a simple training, Self-Challenging Representation (RSC), that significantly improves the generalization of CNN to the out-of-domain data. RSC iteratively challenges the dominant features activated on the training data, and forces the network to activate remaining features that correlates with labels.
  arXiv  Detail & Related papers  (2020-07-05T21:42:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.