From Inference to Prediction: How Machine Learning is Reconfiguring Science (1990-2025)

• URL: http://arxiv.org/abs/2606.20995v1
• Date: Fri, 19 Jun 2026 00:06:50 GMT
• Title: From Inference to Prediction: How Machine Learning is Reconfiguring Science (1990-2025)
• Abstract summary: We analyze 4.9 million scientific publications from OpenAlex (1990-2025)<n>We show a core-periphery structure with physical sciences forming the methodological core and health sciences representing the primary growth area.<n>We observe the displacement of inference-oriented techniques by predictive architectures in domains that have traditionally prioritized interpretability.
• Score: 0.669087470775851
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Machine learning (ML) has reshaped scientific practice across disciplines, yet its epistemic consequences remain poorly understood. This paper analyzes how its broad diffusion reconfigures the conditions under which scientific claims are produced and evaluated. Using a hierarchical taxonomy of 255 ML techniques and embedding-based semantic mapping, we analyze 4.9 million scientific publications from OpenAlex (1990-2025). We reconstruct the semantic space of ML research and show a core-periphery structure, with physical sciences forming the methodological core and health sciences representing the primary growth area. We identify distinct methodological profiles across domains: predictive techniques concentrate in computer sciences while inferential approaches remain distributed across applied fields, reflecting historically differentiated validation regimes. We observe the displacement of inference-oriented techniques by predictive architectures in domains that have traditionally prioritized interpretability-most notably health sciences and social sciences. This displacement unfolds in two qualitatively distinct waves. The first (2015-2021) was driven by deep learning architectures that reduced predictive error while introducing epistemic opacity. The second (post 2022) is organized around a small number of architectures delivered through external companies, introducing a further layer of opacity over data and processes that researchers cannot access or report. This transformation expands the analytical capacity of science, and also reorganizes the conditions under which scientific knowledge can be produced and evaluated.

Related papers

• From Observation to Insight: Mechanistic World Models and the Quest for Autonomous Discovery [60.11725132433485]
  We argue that scientific discovery is fundamentally a problem of knowledge organisation.<n>We introduce Mechanistic World Models, a new design paradigm that places reusable mechanisms at the centre of representation, computation and learning.
  arXiv  Detail & Related papers  (2026-07-14T08:03:27Z)
• CDFM: Towards a General-Purpose Causal Discovery Foundation Model [62.32138962508216]
  Causal discovery is the process of recovering underlying causal structures from observational data.<n>We formulate the Causal Discovery Foundation Model (CDFM) as a unified, general-purpose framework for zero-shot structural inference.<n>CDFM consistently outperforms traditional algorithms, driving a paradigm shift toward a general-purpose causal discovery foundation model.
  arXiv  Detail & Related papers  (2026-07-13T12:58:28Z)
• The Biosecurity Blind Spot: Systematic Dual-use Detection in Open Science Infrastructure [0.6124773188525718]
  We present the first systematic analysis of dual-use research of concern (DURC) content on open preprint servers.<n>Our analysis reveals that dual-use-adjacent knowledge is routinely present in openly accessible titles and abstracts.<n>We argue that institutional review processes, funding requirements, and preprint platform policies must evolve to incorporate proactive, metadata-level monitoring.
  arXiv  Detail & Related papers  (2026-05-10T16:17:41Z)
• Phase Transitions in Driven Informational Systems: A Two-Field Perspective on Learning Theory and Non-Equilibrium Chemistry [0.0]
  Non-equilibrium statistical physics has identified phase transitions in driven chemical reaction networks underlying prebiotic selection.<n>We propose a perspective in which both classes of phenomena admit a common description as driven informational systems.<n>We outline the geometric structure of this framework, identify falsifiable predictions distinguishing it from single-field alternatives, and show consistency with recent empirical findings.
  arXiv  Detail & Related papers  (2026-05-05T05:33:57Z)
• daVinci-LLM:Towards the Science of Pretraining [58.6458452580545]
  daVinci-LLM combines industrial-scale resources with full research freedom to advance the science of pretraining.<n>We release complete data processing pipelines, full training processes, and systematic exploration results.
  arXiv  Detail & Related papers  (2026-03-28T07:00:49Z)
• From Pre-trained Models to Large Language Models: A Comprehensive Survey of AI-Driven Psychological Computing [45.96605393710063]
  This survey introduces the first systematic taxonomy that organizes AI-driven psychology tasks by computational processing patterns rather than application domains.<n>We examine how computational approaches evolved from task-specific feature engineering to transfer learning and few-shot adaptation.
  arXiv  Detail & Related papers  (2026-03-12T04:03:27Z)
• WildSci: Advancing Scientific Reasoning from In-the-Wild Literature [50.16160754134139]
  We introduce WildSci, a new dataset of domain-specific science questions automatically synthesized from peer-reviewed literature.<n>By framing complex scientific reasoning tasks in a multiple-choice format, we enable scalable training with well-defined reward signals.<n>Experiments on a suite of scientific benchmarks demonstrate the effectiveness of our dataset and approach.
  arXiv  Detail & Related papers  (2026-01-09T06:35:23Z)
• A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers [251.23085679210206]
  Scientific Large Language Models (Sci-LLMs) are transforming how knowledge is represented, integrated, and applied in scientific research.<n>This survey reframes the development of Sci-LLMs as a co-evolution between models and their underlying data substrate.<n>We formulate a unified taxonomy of scientific data and a hierarchical model of scientific knowledge.
  arXiv  Detail & Related papers  (2025-08-28T18:30:52Z)
• Ontology Embedding: A Survey of Methods, Applications and Resources [54.3453925775069]
  Onologies are widely used for representing domain knowledge and meta data.<n> logical reasoning that can directly support are quite limited in learning, approximation and prediction.<n>One straightforward solution is to integrate statistical analysis and machine learning.
  arXiv  Detail & Related papers  (2024-06-16T14:49:19Z)
• Efficient Surrogate Models for Materials Science Simulations: Machine Learning-based Prediction of Microstructure Properties [0.0]
  Several machine learning algorithms have been applied in these scientific fields to enhance and accelerate simulation models or as surrogate models. We develop and investigate the applications of six machine learning techniques based on two different datasets from the domain of materials science.
  arXiv  Detail & Related papers  (2023-09-01T07:29:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.