Can AI Understand Our Universe? Test of Fine-Tuning GPT by Astrophysical Data

• URL: http://arxiv.org/abs/2404.10019v1
• Date: Sun, 14 Apr 2024 20:52:19 GMT
• Title: Can AI Understand Our Universe? Test of Fine-Tuning GPT by Astrophysical Data
• Authors: Yu Wang, Shu-Rui Zhang, Aidin Momtaz, Rahim Moradi, Fatemeh Rastegarnia, Narek Sahakyan, Soroush Shakeri, Liang Li,
• Abstract summary: ChatGPT is the most talked-about concept in recent months, captivating both professionals and the general public alike. In this article, we fine-tune the generative pre-trained transformer (GPT) model by the astronomical data from the observations of galaxies, quasars, stars, gamma-ray bursts (GRBs) and simulations of black holes (BHs) We regard this as a successful test, marking the LLM's proven efficacy in scientific research.
• Score: 6.0108108767559525
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: ChatGPT has been the most talked-about concept in recent months, captivating both professionals and the general public alike, and has sparked discussions about the changes that artificial intelligence (AI) will bring to the world. As physicists and astrophysicists, we are curious about if scientific data can be correctly analyzed by large language models (LLMs) and yield accurate physics. In this article, we fine-tune the generative pre-trained transformer (GPT) model by the astronomical data from the observations of galaxies, quasars, stars, gamma-ray bursts (GRBs), and the simulations of black holes (BHs), the fine-tuned model demonstrates its capability to classify astrophysical phenomena, distinguish between two types of GRBs, deduce the redshift of quasars, and estimate BH parameters. We regard this as a successful test, marking the LLM's proven efficacy in scientific research. With the ever-growing volume of multidisciplinary data and the advancement of AI technology, we look forward to the emergence of a more fundamental and comprehensive understanding of our universe. This article also shares some interesting thoughts on data collection and AI design. Using the approach of understanding the universe - looking outward at data and inward for fundamental building blocks - as a guideline, we propose a method of series expansion for AI, suggesting ways to train and control AI that is smarter than humans.

Related papers

• Using Galaxy Evolution as Source of Physics-Based Ground Truth for Generative Models [0.9701233658865522]
  We build a conditional denoising diffusionaxy probabilistic model (DDPM) and a conditional variational autoencoder (CVAE) This is one of the first studies to probe these generative models using physically motivated metrics. We find that both models produce comparable realistic galaxies based on human evaluation, but our physics-based metrics are better able to discern the strengths and weaknesses of the generative models.
  arXiv  Detail & Related papers  (2024-07-09T21:01:08Z)
• AI for Mathematics: A Cognitive Science Perspective [86.02346372284292]
  Mathematics is one of the most powerful conceptual systems developed and used by the human species. Rapid progress in AI, particularly propelled by advances in large language models (LLMs), has sparked renewed, widespread interest in building such systems.
  arXiv  Detail & Related papers  (2023-10-19T02:00:31Z)
• AI-Generated Images as Data Source: The Dawn of Synthetic Era [61.879821573066216]
  generative AI has unlocked the potential to create synthetic images that closely resemble real-world photographs. This paper explores the innovative concept of harnessing these AI-generated images as new data sources. In contrast to real data, AI-generated data exhibit remarkable advantages, including unmatched abundance and scalability.
  arXiv  Detail & Related papers  (2023-10-03T06:55:19Z)
• X-VoE: Measuring eXplanatory Violation of Expectation in Physical Events [75.94926117990435]
  This study introduces X-VoE, a benchmark dataset to assess AI agents' grasp of intuitive physics. X-VoE establishes a higher bar for the explanatory capacities of intuitive physics models. We present an explanation-based learning system that captures physics dynamics and infers occluded object states.
  arXiv  Detail & Related papers  (2023-08-21T03:28:23Z)
• Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systems [268.585904751315]
  New area of research known as AI for science (AI4Science) Areas aim at understanding the physical world from subatomic (wavefunctions and electron density), atomic (molecules, proteins, materials, and interactions), to macro (fluids, climate, and subsurface) scales. Key common challenge is how to capture physics first principles, especially symmetries, in natural systems by deep learning methods.
  arXiv  Detail & Related papers  (2023-07-17T12:14:14Z)
• The Future of Fundamental Science Led by Generative Closed-Loop Artificial Intelligence [67.70415658080121]
  Recent advances in machine learning and AI are disrupting technological innovation, product development, and society as a whole. AI has contributed less to fundamental science in part because large data sets of high-quality data for scientific practice and model discovery are more difficult to access. Here we explore and investigate aspects of an AI-driven, automated, closed-loop approach to scientific discovery.
  arXiv  Detail & Related papers  (2023-07-09T21:16:56Z)
• Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy [0.0]
  We trace the evolution of connectionism in astronomy through its three waves. We argue for the adoption of GPT-like foundation models fine-tuned for astronomical applications.
  arXiv  Detail & Related papers  (2022-11-07T19:00:00Z)
• Unsupervised Domain Adaptation for Constraining Star Formation Histories [0.0]
  To understand the formation of our universe, we must derive the time evolution of the visible mass content of galaxies. astrophysicists leverage supercomputers and evolve simulated models of galaxies till the current age of the universe. We discuss the ability of unsupervised domain adaptation to derive accurate SFHs for galaxies with simulated data.
  arXiv  Detail & Related papers  (2021-12-28T10:01:28Z)
• Learning from learning machines: a new generation of AI technology to meet the needs of science [59.261050918992325]
  We outline emerging opportunities and challenges to enhance the utility of AI for scientific discovery. The distinct goals of AI for industry versus the goals of AI for science create tension between identifying patterns in data versus discovering patterns in the world from data.
  arXiv  Detail & Related papers  (2021-11-27T00:55:21Z)
• From Kepler to Newton: Explainable AI-based Paradigm for Science Discovery [16.392568986688595]
  We introduce an Explainable AI-based paradigm for science discovery. To demonstrate the AI-based science discovery process, we show how Kepler's laws of planetary motion and the Newton's law of universal gravitation can be rediscovered by (Explainable) AI.
  arXiv  Detail & Related papers  (2021-11-24T00:45:27Z)
• Explainable Artificial Intelligence and Machine Learning: A reality rooted perspective [0.0]
  We provide a discussion what explainable AI can be. We do not present wishful thinking but reality grounded properties in relation to a scientific theory beyond physics.
  arXiv  Detail & Related papers  (2020-01-26T15:09:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.