Context operations to architecture modelling output from large language models and evaluation criteria for their use in systems engineering design

• URL: http://arxiv.org/abs/2609.10132v1
• Date: Wed, 09 Sep 2026 13:09:01 GMT
• Title: Context operations to architecture modelling output from large language models and evaluation criteria for their use in systems engineering design
• Abstract summary: This contribution introduces a framework of formal operations for assembling context in LLM-based engineering design.<n>This framework involves the assembly of modular context units, including policy prompts, reference units with persistence, and user questions with prompt vectoring.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The development of generative artificial intelligence resources enables opportunities of speeding up systems and engineering design work. This contribution introduces a framework of formal operations for assembling context in LLM-based engineering design. This framework involves the assembly of modular context units, including policy prompts, reference units with persistence, and user questions with prompt vectoring. This approach enables the systematic structuring of interactions with generative models. A formal method for evaluating modelling-as-code LLM outputs is also presented, which enables the evaluation of compliance to intent from LLM answers and thereby asses the support from LLMs for systems architecture modelling.

Related papers

• OpenCompass: A Universal Evaluation Platform for Large Language Models [62.59671563145442]
  General-purpose large language models (LLMs) have become a critical link in advancing technological development.<n>Mainstream benchmark datasets face challenges such as the diversity of task types, inconsistent evaluation criteria, and fragmentation of data and processing.<n>This paper proposes and open-source Open LLMs, a one-stop, scalable, and high-concurrency general-purpose evaluation platform.
  arXiv  Detail & Related papers  (2026-05-19T02:50:11Z)
• Large Language Models to Enhance Business Process Modeling: Past, Present, and Future Trends [0.0]
  This article presents a literature review of AI-driven methods for transforming natural language into BPMN process models.<n>The analysis reveals a shift from rule-based and traditional NLP pipelines toward LLM-based architectures.<n>The literature also exposes persistent challenges related to semantic correctness, evaluation fragmentation, and limited validation in real-world organizational contexts.
  arXiv  Detail & Related papers  (2026-04-15T16:15:03Z)
• Monadic Context Engineering [59.95390010097654]
  This paper introduces Monadic Context Engineering (MCE) to provide a formal foundation for agent design.<n>We demonstrate how Monads enable robust composition, how Applicatives provide a principled structure for parallel execution, and crucially, how Monad Transformers allow for the systematic composition of these capabilities.<n>This layered approach enables developers to construct complex, resilient, and efficient AI agents from simple, independently verifiable components.
  arXiv  Detail & Related papers  (2025-12-27T01:52:06Z)
• Speed Always Wins: A Survey on Efficient Architectures for Large Language Models [51.817121227562964]
  Large Language Models (LLMs) have delivered impressive results in language understanding, generation, reasoning, and pushes the ability boundary of multimodal models.<n> Transformer models, as the foundation of modern LLMs, offer a strong baseline with excellent scaling properties.<n>The traditional transformer architecture requires substantial computations and poses significant obstacles for large-scale training and practical deployment.
  arXiv  Detail & Related papers  (2025-08-13T14:13:46Z)
• Discrete Tokenization for Multimodal LLMs: A Comprehensive Survey [69.45421620616486]
  This work presents the first structured taxonomy and analysis of discrete tokenization methods designed for large language models (LLMs)<n>We categorize 8 representative VQ variants that span classical and modern paradigms and analyze their algorithmic principles, training dynamics, and integration challenges with LLM pipelines.<n>We identify key challenges including codebook collapse, unstable gradient estimation, and modality-specific encoding constraints.
  arXiv  Detail & Related papers  (2025-07-21T10:52:14Z)
• RE-oriented Model Development with LLM Support and Deduction-based Verification [0.0]
  We propose a comprehensive framework that focuses on specific Unified Modelling Language (UML) diagrams for preliminary system development.<n>This framework offers visualisations at various modelling stages and seamlessly integrates large language models and logical reasoning engines.<n>Ultimately, the framework facilitates the automatic generation of program skeletons, streamlining the transition from design to implementation.
  arXiv  Detail & Related papers  (2025-06-10T09:13:58Z)
• Configurable Foundation Models: Building LLMs from a Modular Perspective [115.63847606634268]
  A growing tendency to decompose LLMs into numerous functional modules allows for inference with part of modules and dynamic assembly of modules to tackle complex tasks. We coin the term brick to represent each functional module, designating the modularized structure as customizable foundation models. We present four brick-oriented operations: retrieval and routing, merging, updating, and growing. We find that the FFN layers follow modular patterns with functional specialization of neurons and functional neuron partitions.
  arXiv  Detail & Related papers  (2024-09-04T17:01:02Z)
• Towards Synthetic Trace Generation of Modeling Operations using In-Context Learning Approach [1.8874331450711404]
  We propose a conceptual framework that combines modeling event logs, intelligent modeling assistants, and the generation of modeling operations. In particular, the architecture comprises modeling components that help the designer specify the system, record its operation within a graphical modeling environment, and automatically recommend relevant operations.
  arXiv  Detail & Related papers  (2024-08-26T13:26:44Z)
• A process algebraic framework for multi-agent dynamic epistemic systems [55.2480439325792]
  We propose a unifying framework for modeling and analyzing multi-agent, knowledge-based, dynamic systems. On the modeling side, we propose a process algebraic, agent-oriented specification language that makes such a framework easy to use for practical purposes.
  arXiv  Detail & Related papers  (2024-07-24T08:35:50Z)
• Process Modeling With Large Language Models [42.0652924091318]
  This paper explores the integration of Large Language Models (LLMs) into process modeling. We propose a framework that leverages LLMs for the automated generation and iterative refinement of process models. Preliminary results demonstrate the framework's ability to streamline process modeling tasks.
  arXiv  Detail & Related papers  (2024-03-12T11:27:47Z)
• MLTEing Models: Negotiating, Evaluating, and Documenting Model and System Qualities [1.1352560842946413]
  MLTE is a framework and implementation to evaluate machine learning models and systems. It compiles state-of-the-art evaluation techniques into an organizational process. MLTE tooling supports this process by providing a domain-specific language that teams can use to express model requirements.
  arXiv  Detail & Related papers  (2023-03-03T15:10:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.