The Role of Computing Resources in Publishing Foundation Model Research

• URL: http://arxiv.org/abs/2510.13621v1
• Date: Wed, 15 Oct 2025 14:50:45 GMT
• Title: The Role of Computing Resources in Publishing Foundation Model Research
• Authors: Yuexing Hao, Yue Huang, Haoran Zhang, Chenyang Zhao, Zhenwen Liang, Paul Pu Liang, Yue Zhao, Lichao Sun, Saleh Kalantari, Xiangliang Zhang, Marzyeh Ghassemi,
• Abstract summary: We evaluate the relationship between these resources and the scientific advancement of foundation models (FM)<n>We reviewed 6517 FM papers published between 2022 to 2024, and surveyed 229 first-authors to the impact of computing resources on scientific output.<n>We find that increased computing is correlated with national funding allocations and citations, but our findings don't observe the strong correlations with research environment.
• Score: 84.20094600030092
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Cutting-edge research in Artificial Intelligence (AI) requires considerable resources, including Graphics Processing Units (GPUs), data, and human resources. In this paper, we evaluate of the relationship between these resources and the scientific advancement of foundation models (FM). We reviewed 6517 FM papers published between 2022 to 2024, and surveyed 229 first-authors to the impact of computing resources on scientific output. We find that increased computing is correlated with national funding allocations and citations, but our findings don't observe the strong correlations with research environment (academic or industrial), domain, or study methodology. We advise that individuals and institutions focus on creating shared and affordable computing opportunities to lower the entry barrier for under-resourced researchers. These steps can help expand participation in FM research, foster diversity of ideas and contributors, and sustain innovation and progress in AI. The data will be available at: https://mit-calc.csail.mit.edu/

Related papers

• AI4Research: A Survey of Artificial Intelligence for Scientific Research [55.5452803680643]
  We present a comprehensive survey on AI for Research (AI4Research)<n>We first introduce a systematic taxonomy to classify five mainstream tasks in AI4Research.<n>We identify key research gaps and highlight promising future directions.
  arXiv  Detail & Related papers  (2025-07-02T17:19:20Z)
• Real-World Gaps in AI Governance Research [0.0]
  Drawing on 1,178 safety and reliability papers from 9,439 generative AI papers (January 2020 - March 2025), we compare research outputs of leading AI companies and universities.<n>We find that corporate AI research increasingly concentrates on pre-deployment areas -- model alignment and testing & evaluation.<n>Significant research gaps exist in high-risk deployment domains, including healthcare, finance, misinformation, persuasive and addictive features, hallucinations, and copyright.
  arXiv  Detail & Related papers  (2025-04-30T20:44:42Z)
• Application of AI to formal methods - an analysis of current trends [0.9278012928091801]
  We conduct a systematic mapping study to overview the current landscape of research publications that apply AI to formal methods (FM)<n>We searched for relevant publications in four major databases, defined inclusion and exclusion criteria, and applied extensive snowballing to uncover potential additional sources.<n>We find a strong focus on AI in the area of theorem proving while other subfields of FM are less represented.
  arXiv  Detail & Related papers  (2024-11-22T11:43:39Z)
• Why Tabular Foundation Models Should Be a Research Priority [65.75744962286538]
  Tabular data is the dominant modality in many fields, yet it is given hardly any research attention and significantly lags behind in terms of scale and power. We believe the time is now to start developing tabular foundation models, or what we coin a Large Tabular Model (LTM)
  arXiv  Detail & Related papers  (2024-05-02T10:05:16Z)
• The Compute Divide in Machine Learning: A Threat to Academic Contribution and Scrutiny? [1.0985060632689174]
  We show that a compute divide has coincided with a reduced representation of academic-only research teams in compute intensive research topics. To address the challenges arising from this trend, we recommend approaches aimed at thoughtfully expanding academic insights.
  arXiv  Detail & Related papers  (2024-01-04T01:26:11Z)
• On the Opportunities of Green Computing: A Survey [80.21955522431168]
  Artificial Intelligence (AI) has achieved significant advancements in technology and research with the development over several decades. The needs for high computing power brings higher carbon emission and undermines research fairness. To tackle the challenges of computing resources and environmental impact of AI, Green Computing has become a hot research topic.
  arXiv  Detail & Related papers  (2023-11-01T11:16:41Z)
• A Bibliographic Study on Artificial Intelligence Research: Global Panorama and Indian Appearance [2.9895330439073406]
  The study reveals that neural networks and deep learning are the major topics included in top AI research publications. The study also investigates the relative position of Indian researchers in terms of AI research.
  arXiv  Detail & Related papers  (2023-07-04T05:08:36Z)
• Artificial intelligence adoption in the physical sciences, natural sciences, life sciences, social sciences and the arts and humanities: A bibliometric analysis of research publications from 1960-2021 [73.06361680847708]
  In 1960 14% of 333 research fields were related to AI, but this increased to over half of all research fields by 1972, over 80% by 1986 and over 98% in current times. In 1960 14% of 333 research fields were related to AI (many in computer science), but this increased to over half of all research fields by 1972, over 80% by 1986 and over 98% in current times. We conclude that the context of the current surge appears different, and that interdisciplinary AI application is likely to be sustained.
  arXiv  Detail & Related papers  (2023-06-15T14:08:07Z)
• Research Trends and Applications of Data Augmentation Algorithms [77.34726150561087]
  We identify the main areas of application of data augmentation algorithms, the types of algorithms used, significant research trends, their progression over time and research gaps in data augmentation literature. We expect readers to understand the potential of data augmentation, as well as identify future research directions and open questions within data augmentation research.
  arXiv  Detail & Related papers  (2022-07-18T11:38:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.