LabOS: The AI-XR Co-Scientist That Sees and Works With Humans

• URL: http://arxiv.org/abs/2510.14861v1
• Date: Thu, 16 Oct 2025 16:36:22 GMT
• Title: LabOS: The AI-XR Co-Scientist That Sees and Works With Humans
• Authors: Le Cong, Zaixi Zhang, Xiaotong Wang, Yin Di, Ruofan Jin, Michal Gerasimiuk, Yinkai Wang, Ravi K. Dinesh, David Smerkous, Alex Smerkous, Xuekun Wu, Shilong Liu, Peishan Li, Yi Zhu, Simran Serrao, Ning Zhao, Imran A. Mohammad, John B. Sunwoo, Joseph C. Wu, Mengdi Wang,
• Abstract summary: LabOS represents the first AI co-scientist that unites computational reasoning with physical experimentation.<n>By connecting multi-model AI agents, smart glasses, and human-AI collaboration, LabOS allows AI to see what scientists see, understand experimental context, and assist in real-time execution.
• Score: 51.025615465050635
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Modern science advances fastest when thought meets action. LabOS represents the first AI co-scientist that unites computational reasoning with physical experimentation through multimodal perception, self-evolving agents, and Entended-Reality(XR)-enabled human-AI collaboration. By connecting multi-model AI agents, smart glasses, and human-AI collaboration, LabOS allows AI to see what scientists see, understand experimental context, and assist in real-time execution. Across applications--from cancer immunotherapy target discovery to stem-cell engineering -- LabOS shows that AI can move beyond computational design to participation, turning the laboratory into an intelligent, collaborative environment where human and machine discovery evolve together.

Related papers

• AI4X Roadmap: Artificial Intelligence for the advancement of scientific pursuit and its future directions [65.44445343399126]
  We look at AI-enabled science across biology, chemistry, climate science, mathematics, materials science, physics, self-driving laboratories and unconventional computing.<n>Several shared themes emerge: the need for diverse and trustworthy data, transferable electronic-structure and interatomic models, AI systems integrated into end-to-end scientific synthesis.<n>Across domains, we highlight how large foundation models, active learning and self-driving laboratories can close loops between prediction and validation.
  arXiv  Detail & Related papers  (2025-11-26T02:10:28Z)
• Human-AI Co-Embodied Intelligence for Scientific Experimentation and Manufacturing [25.954616033671048]
  We introduce human-AI co-embodied intelligence, a new form of physical AI that unites human users, agentic AI, and wearable hardware.<n>In this paradigm, humans provide precise execution and control, while agentic AI contributes memory, contextual reasoning, adaptive planning, and real-time feedback.<n>We present Agentic-Physical Experimentation (APEX) system, agentic reasoning with physical execution through mixed-reality.
  arXiv  Detail & Related papers  (2025-11-03T21:12:48Z)
• Position: Intelligent Science Laboratory Requires the Integration of Cognitive and Embodied AI [98.19195693735487]
  We propose the paradigm of Intelligent Science Laboratories (ISLs)<n>ISLs are a multi-layered, closed-loop framework that deeply integrates cognitive and embodied intelligence.<n>We argue that such systems are essential for overcoming the current limitations of scientific discovery.
  arXiv  Detail & Related papers  (2025-06-24T13:31:44Z)
• Accelerating drug discovery with Artificial: a whole-lab orchestration and scheduling system for self-driving labs [0.0]
  Self-driving labs are transforming drug discovery by enabling automated, AI-guided experimentation.<n>But they face challenges in orchestrating complex, integrating diverse instruments and AI models, and managing data efficiently.<n>Artificial addresses these issues with a comprehensive orchestration and scheduling system.<n>It unifies lab operations, automates, and integrates AI-driven decision-making.
  arXiv  Detail & Related papers  (2025-04-01T17:22:50Z)
• Scaling Laws in Scientific Discovery with AI and Robot Scientists [72.3420699173245]
  An autonomous generalist scientist (AGS) concept combines agentic AI and embodied robotics to automate the entire research lifecycle.<n>AGS aims to significantly reduce the time and resources needed for scientific discovery.<n>As these autonomous systems become increasingly integrated into the research process, we hypothesize that scientific discovery might adhere to new scaling laws.
  arXiv  Detail & Related papers  (2025-03-28T14:00:27Z)
• Human-AI Teaming Using Large Language Models: Boosting Brain-Computer Interfacing (BCI) and Brain Research [1.7265013728931]
  We introduce the collaborative concept for human-AI teaming based on a set of Janusian design principles.<n>ChatBCI is a Python-based toolbox for enabling human-AI collaboration.<n>Our approach can be straightforwardly extended to broad neurotechnological and neuroscientific topics.
  arXiv  Detail & Related papers  (2024-12-30T20:26:03Z)
• Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System [62.832818186789545]
  Virtual Scientists (VirSci) is a multi-agent system designed to mimic the teamwork inherent in scientific research.<n>VirSci organizes a team of agents to collaboratively generate, evaluate, and refine research ideas.<n>We show that this multi-agent approach outperforms the state-of-the-art method in producing novel scientific ideas.
  arXiv  Detail & Related papers  (2024-10-12T07:16:22Z)
• Empowering Biomedical Discovery with AI Agents [15.125735219811268]
  We envision "AI scientists" as systems capable of skeptical learning and reasoning. Biomedical AI agents combine human creativity and expertise with AI's ability to analyze large datasets. AI agents can impact areas ranging from virtual cell simulation, programmable control of phenotypes, and the design of cellular circuits to developing new therapies.
  arXiv  Detail & Related papers  (2024-04-03T16:08:01Z)
• BO-Muse: A human expert and AI teaming framework for accelerated experimental design [58.61002520273518]
  Our algorithm lets the human expert take the lead in the experimental process. We show that our algorithm converges sub-linearly, at a rate faster than the AI or human alone.
  arXiv  Detail & Related papers  (2023-03-03T02:56:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.