A Comprehensive Review of Large Language Models for Nanophotonics: From Surrogate Modeling to Autonomous Design

• URL: http://arxiv.org/abs/2608.18279v1
• Date: Tue, 18 Aug 2026 19:57:16 GMT
• Title: A Comprehensive Review of Large Language Models for Nanophotonics: From Surrogate Modeling to Autonomous Design
• Abstract summary: This review surveys how Large Language Models are adding semantic interfaces, code generation, and tool orchestration to numerical nanophotonic design.<n>We first outline the development from classical neural networks to transformer-based models and their applications in nanophotonic design.<n>We then review the emergence of LLM-related methods in nanophotonics and organize them into two operational modes: surrogate models that treat structure-spectrum mapping as a language task, and agentic systems that have been demonstrated to generate code, orchestrate selected simulation steps, and support closed-loop optimization.
• Score: 14.603456638289336
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Metasurfaces have revolutionized the development of photonic devices by enabling unprecedented precision in light manipulation. However, their design processes are often constrained by computationally expensive simulations and complex high-dimensional design spaces. Although deep learning has accelerated the design process by serving as a surrogate model, it remains constrained by task-specific architectures and lacks universal reasoning capabilities. This review surveys how Large Language Models (LLMs) are adding semantic interfaces, code generation, and tool orchestration to established numerical nanophotonic workflows. We first outline the development from classical neural networks to transformer-based models and their applications in nanophotonic design. We then review the emergence of LLM-related methods in nanophotonics and organize them into two operational modes: surrogate models that treat structure-spectrum mapping as a language task, and agentic systems that have been demonstrated to generate code, orchestrate selected simulation steps, and support closed-loop optimization. Furthermore, to identify future cross-disciplinary opportunities, we briefly explore applications of LLMs in research fields such as materials science and wireless communications. This review concludes by looking ahead to the next generation of multimodal foundation models with physical perception capabilities. In this vision, artificial intelligence is evolving from passive tools into active collaborators, participating in autonomous scientific discovery.

Related papers

• Guava: An Effective and Universal Harness for Embodied Manipulation [74.34187069605844]
  We develop an end-to-end training pipeline that distills embodied manipulation capabilities into a 4B open-source model.<n>Results suggest that a well-designed harness can serve as a scalable, model-agnostic interface for embodied manipulation.
  arXiv  Detail & Related papers  (2026-06-16T18:09:26Z)
• Towards Agentic Intelligence for Materials Science [73.4576385477731]
  This survey advances a unique pipeline-centric view that spans from corpus curation and pretraining to goal-conditioned agents interfacing with simulation and experimental platforms.<n>To bridge communities and establish a shared frame of reference, we first present an integrated lens that aligns terminology, evaluation, and workflow stages across AI and materials science.
  arXiv  Detail & Related papers  (2026-01-29T23:48:43Z)
• Automating modeling in mechanics: LLMs as designers of physics-constrained neural networks for constitutive modeling of materials [0.0]
  Large language model (LLM)-based agentic frameworks increasingly adopt the paradigm of dynamically generating task-specific agents.<n>We suggest that not only agents but also specialized software modules for scientific and engineering tasks can be generated on demand.
  arXiv  Detail & Related papers  (2025-12-01T14:42:22Z)
• Data driven approaches in nanophotonics: A review of AI-enabled metadevices [1.650377755821876]
  Data-driven approaches have revolutionized the design and optimization of photonic metadevices.<n>This review takes a model-centric perspective that synthesizes emerging design strategies.
  arXiv  Detail & Related papers  (2025-09-30T21:03:46Z)
• Chat to Chip: Large Language Model Based Design of Arbitrarily Shaped Metasurfaces [1.7706010980924418]
  We show that an LLM can learn the physical relationships needed for spectral prediction and inverse design.<n>This "chat-to-chip" workflow represents a step toward more user-friendly data-driven nanophotonics.
  arXiv  Detail & Related papers  (2025-09-29T02:24:57Z)
• Speed Always Wins: A Survey on Efficient Architectures for Large Language Models [51.817121227562964]
  Large Language Models (LLMs) have delivered impressive results in language understanding, generation, reasoning, and pushes the ability boundary of multimodal models.<n> Transformer models, as the foundation of modern LLMs, offer a strong baseline with excellent scaling properties.<n>The traditional transformer architecture requires substantial computations and poses significant obstacles for large-scale training and practical deployment.
  arXiv  Detail & Related papers  (2025-08-13T14:13:46Z)
• Machine-Learning-Assisted Photonic Device Development: A Multiscale Approach from Theory to Characterization [80.82828320306464]
  Photonic device development (PDD) has achieved remarkable success in designing and implementing new devices for controlling light across various wavelengths, scales, and applications.<n>PDD is an iterative, five-step process that consists of: i.e. deriving device behavior from design parameters, ii. simulating device performance, iv. fabricating the optimal device, and v. measuring device performance.<n>PDD suffers from large optimization landscapes, uncertainties in structural or optical characterization, and difficulties in implementing robust fabrication processes.<n>In this review, we present a comprehensive perspective on these methods to enable machine-learning-assisted PDD
  arXiv  Detail & Related papers  (2025-06-24T23:32:54Z)
• Continual Learning for Generative AI: From LLMs to MLLMs and Beyond [56.29231194002407]
  We present a comprehensive survey of continual learning methods for mainstream generative AI models.<n>We categorize these approaches into three paradigms: architecture-based, regularization-based, and replay-based.<n>We analyze continual learning setups for different generative models, including training objectives, benchmarks, and core backbones.
  arXiv  Detail & Related papers  (2025-06-16T02:27:25Z)
• An Agentic Framework for Autonomous Metamaterial Modeling and Inverse Design [2.66269503676104]
  We develop and demonstrate a framework specifically for the inverse design of photonic metamaterials.<n>The framework's effectiveness is demonstrated in its ability to automate, reason, plan, and adapt.<n> Notably, the Agentic Framework possesses internal reflection and decision flexibility, permitting highly varied and potentially novel outputs.
  arXiv  Detail & Related papers  (2025-06-07T22:10:05Z)
• Toward Knowledge-Guided AI for Inverse Design in Manufacturing: A Perspective on Domain, Physics, and Human-AI Synergy [0.8399688944263844]
  AI is reshaping inverse design in manufacturing, enabling high-performance discovery in materials, products, and processes.<n>However, purely data-driven approaches often struggle in realistic manufacturing settings characterized by sparse data, high-dimensional design spaces, and complex constraints.<n>This perspective proposes an integrated framework built on three complementary pillars: domain knowledge to establish physically meaningful objectives and constraints while removing variables with limited relevance, physics-informed machine learning to enhance generalization under limited or biased data, and large language model-based interfaces to support intuitive, human-centered interaction.
  arXiv  Detail & Related papers  (2025-05-29T08:15:27Z)
• A multi-agentic framework for real-time, autonomous freeform metasurface design [1.6712896227173812]
  We introduce MetaChat, a multi-agentic design framework that can translate semantically described photonic design goals into high-performance, freeform device layouts.<n>Design acceleration is facilitated by Feature-wise Linear Modulation-conditioned Maxwell surrogate solvers.<n>These concepts present a scientific computing blueprint for utilizing specialist design agents, surrogate solvers, and human interactions to drive multi-physics innovation and discovery.
  arXiv  Detail & Related papers  (2025-03-26T12:10:45Z)
• A Survey of Model Architectures in Information Retrieval [59.61734783818073]
  The period from 2019 to the present has represented one of the biggest paradigm shifts in information retrieval (IR) and natural language processing (NLP)<n>We trace the development from traditional term-based methods to modern neural approaches, particularly highlighting the impact of transformer-based models and subsequent large language models (LLMs)<n>We conclude with a forward-looking discussion of emerging challenges and future directions.
  arXiv  Detail & Related papers  (2025-02-20T18:42:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.