Large Language Models in Software Documentation and Modeling: A Literature Review and Findings

• URL: http://arxiv.org/abs/2602.04938v1
• Date: Wed, 04 Feb 2026 16:21:50 GMT
• Title: Large Language Models in Software Documentation and Modeling: A Literature Review and Findings
• Authors: Lukas Radosky, Ivan Polasek,
• Abstract summary: We conduct a literature review on the usage of large language models for software engineering tasks related to documentation and modeling.<n>We analyze articles from four major venues in the area, organize them per tasks they solve, and provide an overview of used prompt techniques, metrics, approaches to human-based evaluation, and major datasets.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generative artificial intelligence attracts significant attention, especially with the introduction of large language models. Its capabilities are being exploited to solve various software engineering tasks. Thanks to their ability to understand natural language and generate natural language responses, large language models are great for processing various software documentation artifacts. At the same time, large language models excel at understanding structured languages, having the potential for working with software programs and models. We conduct a literature review on the usage of large language models for software engineering tasks related to documentation and modeling. We analyze articles from four major venues in the area, organize them per tasks they solve, and provide an overview of used prompt techniques, metrics, approaches to human-based evaluation, and major datasets.

Related papers

• Lost in the Pipeline: How Well Do Large Language Models Handle Data Preparation? [0.7291396653006809]
  This paper investigates whether large language models can effectively support users in selecting and automating data preparation tasks.<n>We prompted these models with poor-quality datasets and measured their ability to perform tasks such as data profiling and cleaning.<n>To evaluate the capabilities of large language models, we developed a custom-designed quality model that has been validated through a user study.
  arXiv  Detail & Related papers  (2025-11-17T19:06:22Z)
• Bootstrapping Cognitive Agents with a Large Language Model [0.9971537447334835]
  Large language models contain noisy general knowledge of the world, yet are hard to train or fine-tune. In this work, we combine the best of both worlds: bootstrapping a cognitive-based model with the noisy knowledge encoded in large language models.
  arXiv  Detail & Related papers  (2024-02-25T01:40:30Z)
• Can Large Language Models Write Parallel Code? [0.5317767988097261]
  Large language models are increasingly becoming a popular tool for software development. In this paper, we study the capabilities of state-of-the-art language models to generate parallel code.
  arXiv  Detail & Related papers  (2024-01-23T08:25:12Z)
• Advancing bioinformatics with large language models: components, applications and perspectives [12.728981464533918]
  Large language models (LLMs) are a class of artificial intelligence models based on deep learning.<n>We will provide a comprehensive overview of the essential components of large language models (LLMs) in bioinformatics.<n>Key aspects covered include tokenization methods for diverse data types, the architecture of transformer models, and the core attention mechanism.
  arXiv  Detail & Related papers  (2024-01-08T17:26:59Z)
• Formal Aspects of Language Modeling [74.16212987886013]
  Large language models have become one of the most commonly deployed NLP inventions. These notes are the accompaniment to the theoretical portion of the ETH Z"urich course on large language models.
  arXiv  Detail & Related papers  (2023-11-07T20:21:42Z)
• L2CEval: Evaluating Language-to-Code Generation Capabilities of Large Language Models [102.00201523306986]
  We present L2CEval, a systematic evaluation of the language-to-code generation capabilities of large language models (LLMs) We analyze the factors that potentially affect their performance, such as model size, pretraining data, instruction tuning, and different prompting methods. In addition to assessing model performance, we measure confidence calibration for the models and conduct human evaluations of the output programs.
  arXiv  Detail & Related papers  (2023-09-29T17:57:00Z)
• Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning [52.22611035186903]
  We show that scaling diffusion language models can effectively make them strong language learners.<n>We build competent diffusion language models at scale by first acquiring knowledge from massive data.<n>Experiments show that scaling diffusion language models consistently improves performance across downstream language tasks.
  arXiv  Detail & Related papers  (2023-08-23T16:01:12Z)
• When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities [60.5609416496429]
  The capability of large language models has been dramatically improved. Such a major leap-forward in general AI capacity will change the pattern of how personalization is conducted. By leveraging large language models as general-purpose interface, personalization systems may compile user requests into plans.
  arXiv  Detail & Related papers  (2023-07-31T02:48:56Z)
• Opportunities for Large Language Models and Discourse in Engineering Design [0.0]
  We argue that discourse should be regarded as the core of engineering design processes, and therefore should be represented in a digital artifact. We describe how simulations, experiments, topology optimizations, and other process steps can be integrated into a machine-actionable, discourse-centric design process.
  arXiv  Detail & Related papers  (2023-06-15T14:46:44Z)
• Lost in Translation: Large Language Models in Non-English Content Analysis [0.0]
  Large language models have become the dominant approach for building AI systems to analyze and generate language online. Recently, researchers and technology companies have attempted to extend the capabilities of large language models into languages other than English.
  arXiv  Detail & Related papers  (2023-06-12T19:10:47Z)
• Solving Quantitative Reasoning Problems with Language Models [53.53969870599973]
  We introduce Minerva, a large language model pretrained on general natural language data and further trained on technical content. The model achieves state-of-the-art performance on technical benchmarks without the use of external tools. We also evaluate our model on over two hundred undergraduate-level problems in physics, biology, chemistry, economics, and other sciences.
  arXiv  Detail & Related papers  (2022-06-29T18:54:49Z)
• Bridging Linguistic Typology and Multilingual Machine Translation with Multi-View Language Representations [83.27475281544868]
  We use singular vector canonical correlation analysis to study what kind of information is induced from each source. We observe that our representations embed typology and strengthen correlations with language relationships. We then take advantage of our multi-view language vector space for multilingual machine translation, where we achieve competitive overall translation accuracy.
  arXiv  Detail & Related papers  (2020-04-30T16:25:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.