Giving Simulated Cells a Voice: Evolving Prompt-to-Intervention Models for Cellular Control

• URL: http://arxiv.org/abs/2505.02766v1
• Date: Mon, 05 May 2025 16:21:46 GMT
• Title: Giving Simulated Cells a Voice: Evolving Prompt-to-Intervention Models for Cellular Control
• Authors: Nam H. Le, Patrick Erikson, Yanbo Zhang, Michael Levin, Josh Bongard,
• Abstract summary: Large language models (LLMs) have enabled natural language as an interface for interpretable control in AI systems.<n>We present a functional pipeline that translates natural language prompts into spatial vector fields capable of directing simulated cellular collectives.
• Score: 1.7056803236939193
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Guiding biological systems toward desired states, such as morphogenetic outcomes, remains a fundamental challenge with far-reaching implications for medicine and synthetic biology. While large language models (LLMs) have enabled natural language as an interface for interpretable control in AI systems, their use as mediators for steering biological or cellular dynamics remains largely unexplored. In this work, we present a functional pipeline that translates natural language prompts into spatial vector fields capable of directing simulated cellular collectives. Our approach combines a large language model with an evolvable neural controller (Prompt-to-Intervention, or P2I), optimized via evolutionary strategies to generate behaviors such as clustering or scattering in a simulated 2D environment. We demonstrate that even with constrained vocabulary and simplified cell models, evolved P2I networks can successfully align cellular dynamics with user-defined goals expressed in plain language. This work offers a complete loop from language input to simulated bioelectric-like intervention to behavioral output, providing a foundation for future systems capable of natural language-driven cellular control.

Related papers

• Neural cellular automata: applications to biology and beyond classical AI [1.9116784879310027]
  Neural Cellular Automata (NCA) represent a powerful framework for modeling biological self-organization.<n>NCA can simulate processes across molecular, cellular, tissue, and system-level scales.<n>Their governing self-regulatory behavior is constraint to fully localized interactions, yet their collective behavior scales into coordinated system-level outcomes.
  arXiv  Detail & Related papers  (2025-09-14T06:55:29Z)
• ZapGPT: Free-form Language Prompting for Simulated Cellular Control [3.599327240436075]
  We show that simple agents' collective behavior can be guided by free-form language prompts.<n>By treating natural language as a control layer, the system suggests a future in which spoken or written prompts could direct systems to desired behaviors.
  arXiv  Detail & Related papers  (2025-09-12T19:38:46Z)
• Plantbot: Integrating Plant and Robot through LLM Modular Agent Networks [0.995321385692873]
  We introduce Plantbot, a hybrid lifeform that connects a living plant with a mobile robot through a network of large language model (LLM) modules.<n>Each module operates asynchronously and communicates via natural language, enabling seamless interaction across biological and artificial domains.
  arXiv  Detail & Related papers  (2025-09-01T14:12:28Z)
• BioMARS: A Multi-Agent Robotic System for Autonomous Biological Experiments [8.317138109309967]
  Large language models (LLMs) and vision-language models (VLMs) have the potential to transform biological research by enabling autonomous experimentation.<n>Here we introduce BioMARS, an intelligent platform that integrates LLMs, VLMs, and modular robotics to autonomously design, plan, and execute biological experiments.<n>A web interface enables real-time human-AI collaboration, while a modular backend allows scalable integration with laboratory hardware.
  arXiv  Detail & Related papers  (2025-07-02T08:47:02Z)
• LANGTRAJ: Diffusion Model and Dataset for Language-Conditioned Trajectory Simulation [94.84458417662404]
  LangTraj is a language-conditioned scene-diffusion model that simulates the joint behavior of all agents in traffic scenarios.<n>By conditioning on natural language inputs, LangTraj provides flexible and intuitive control over interactive behaviors.<n>LangTraj demonstrates strong performance in realism, language controllability, and language-conditioned safety-critical simulation.
  arXiv  Detail & Related papers  (2025-04-15T17:14:06Z)
• A Multi-Modal AI Copilot for Single-Cell Analysis with Instruction Following [32.67347401145835]
  Large language models excel at interpreting complex natural language instructions, enabling them to perform a wide range of tasks.<n>We present InstructCell, a multi-modal AI copilot that leverages natural language as a medium for more direct and flexible single-cell analysis.<n>InstructCell empowers researchers to accomplish critical tasks-such as cell type annotation, conditional pseudo-cell generation, and drug sensitivity prediction-using straightforward natural language commands.
  arXiv  Detail & Related papers  (2025-01-14T15:12:19Z)
• Language Generation from Brain Recordings [68.97414452707103]
  We propose a generative language BCI that utilizes the capacity of a large language model and a semantic brain decoder. The proposed model can generate coherent language sequences aligned with the semantic content of visual or auditory language stimuli. Our findings demonstrate the potential and feasibility of employing BCIs in direct language generation.
  arXiv  Detail & Related papers  (2023-11-16T13:37:21Z)
• BatGPT: A Bidirectional Autoregessive Talker from Generative Pre-trained Transformer [77.28871523946418]
  BatGPT is a large-scale language model designed and trained jointly by Wuhan University and Shanghai Jiao Tong University. It is capable of generating highly natural and fluent text in response to various types of input, including text prompts, images, and audio.
  arXiv  Detail & Related papers  (2023-07-01T15:10:01Z)
• Real-time Evolution of Multicellularity with Artificial Gene Regulation [0.0]
  This paper presents a real-time simulation involving ''protozoan-like'' cells that evolve by natural selection in a physical 2D ecosystem.
  arXiv  Detail & Related papers  (2023-05-20T17:39:07Z)
• Universal Morphology Control via Contextual Modulation [52.742056836818136]
  Learning a universal policy across different robot morphologies can significantly improve learning efficiency and generalization in continuous control. Existing methods utilize graph neural networks or transformers to handle heterogeneous state and action spaces across different morphologies. We propose a hierarchical architecture to better model this dependency via contextual modulation.
  arXiv  Detail & Related papers  (2023-02-22T00:04:12Z)
• GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformers [2.456957408490494]
  GenTUS consists of an encoder-decoder structure, which means it can optimise both the user policy and natural language generation jointly. GenTUS generates both semantic actions and natural language utterances, preserving interpretability and enhancing language variation. Our results show that GenTUS generates more natural language and is able to transfer to an unseen ontology in a zero-shot fashion.
  arXiv  Detail & Related papers  (2022-08-23T09:01:17Z)
• GenNI: Human-AI Collaboration for Data-Backed Text Generation [102.08127062293111]
  Table2Text systems generate textual output based on structured data utilizing machine learning. GenNI (Generation Negotiation Interface) is an interactive visual system for high-level human-AI collaboration in producing descriptive text.
  arXiv  Detail & Related papers  (2021-10-19T18:07:07Z)
• Towards self-organized control: Using neural cellular automata to robustly control a cart-pole agent [62.997667081978825]
  We use neural cellular automata to control a cart-pole agent. We trained the model using deep-Q learning, where the states of the output cells were used as the Q-value estimates to be optimized.
  arXiv  Detail & Related papers  (2021-06-29T10:49:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.