Full-Stack Domain Enhancement for Combustion LLMs: Construction and Optimization

• URL: http://arxiv.org/abs/2603.19268v1
• Date: Fri, 27 Feb 2026 08:27:46 GMT
• Title: Full-Stack Domain Enhancement for Combustion LLMs: Construction and Optimization
• Abstract summary: General-purpose large language models (LLMs) often generate severe hallucinations due to insufficient domain knowledge and the inability to adhere to physical conservation laws.<n>We propose the first full-stack domain-enhanced LLM workflow tailored for the field of combustion science.<n>We also release FlameBench, a standardized evaluation benchmark specifically designed for complex reasoning tasks in combustion science.
• Score: 9.118491408766753
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large language models (LLMs) in the direction of task adaptation and capability enhancement for professional fields demonstrate significant application potential. Nevertheless, for complex physical systems such as combustion science, general-purpose LLMs often generate severe hallucinations due to insufficient domain knowledge and the inability to adhere to physical conservation laws. To address this issue, we propose the first full-stack domain-enhanced LLM workflow tailored for the field of combustion science, which integrates automated domain corpus construction, incremental pre-training, instruction fine-tuning, and verifiable reward-based reinforcement learning. This workflow ensures that the model truly internalizes physical laws rather than merely learning textual statistical patterns. We also release FlameBench, a standardized evaluation benchmark specifically designed for complex reasoning tasks in combustion science. Experimental results demonstrate that the model developed in this work significantly outperforms state-of-the-art general-purpose closed-source models and traditional retrieval-augmented generation methods on combustion science reasoning tasks. This work lays a solid technical and resource foundation for the subsequent development of domain-specific scientific research agents with reliable scientific reasoning capabilities.

Related papers

• From Knowledge to Action: Outcomes of the 2025 Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistry [109.17159174400912]
  Large language models (LLMs) are rapidly changing how researchers in materials science and chemistry discover, organize, and act on scientific knowledge.<n>This paper analyzes a broad set of community-developed LLM applications in an effort to identify emerging patterns in how these systems can be used across the scientific research lifecycle.
  arXiv  Detail & Related papers  (2026-05-04T22:48:45Z)
• Perspective: Towards sustainable exploration of chemical spaces with machine learning [49.29528647472741]
  We argue that sustainable progress will rely on open data and models, reusable datasets, and domain-specific AI systems.<n>We highlight emerging strategies to enhance efficiency, including general-purpose machine learning (ML) models, multi-fidelity approaches, model distillation, and active learning.
  arXiv  Detail & Related papers  (2026-03-31T13:29:20Z)
• Grounding LLMs in Scientific Discovery via Embodied Actions [84.11877211907647]
  Large Language Models (LLMs) have shown significant potential in scientific discovery but struggle to bridge the gap between theoretical reasoning and physical simulation.<n>We propose EmbodiedAct, a framework that transforms established scientific software into active embodied agents by groundings in embodied actions with a tight perception-execution loop.
  arXiv  Detail & Related papers  (2026-02-24T07:37:18Z)
• Towards LLM-enabled autonomous combustion research: A literature-aware agent for self-corrective modeling workflows [9.40063486755374]
  FlamePilot is designed to empower combustion modeling research through automated and self-corrective CFD.<n>System is capable of learning from scientific articles, extracting key information to guide the simulation from initial setup to optimized results.<n>Case study shows FlamePilot autonomously translated a research paper into a configured simulation, conducted the simulation, post-processed the results, proposed evidence-based refinements, and managed a multi-step parameter study to convergence.
  arXiv  Detail & Related papers  (2026-01-04T04:00:28Z)
• An Agentic Framework for Autonomous Materials Computation [70.24472585135929]
  Large Language Models (LLMs) have emerged as powerful tools for accelerating scientific discovery.<n>Recent advances integrate LLMs into agentic frameworks, enabling retrieval, reasoning, and tool use for complex scientific experiments.<n>Here, we present a domain-specialized agent designed for reliable automation of first-principles materials computations.
  arXiv  Detail & Related papers  (2025-12-22T15:03:57Z)
• Helios: A Foundational Language Model for Smart Energy Knowledge Reasoning and Application [7.294864378911716]
  Helios is a large language model tailored to the smart energy domain.<n>Enersys is a multi-agent collaborative framework for end-to-end dataset construction.<n>We release EnerBench, a benchmark for evaluating LLMs in smart energy scenarios.
  arXiv  Detail & Related papers  (2025-12-22T11:43:35Z)
• General-Reasoner: Advancing LLM Reasoning Across All Domains [64.70599911897595]
  Reinforcement learning (RL) has recently demonstrated strong potential in enhancing the reasoning capabilities of large language models (LLMs)<n>We propose General-Reasoner, a novel training paradigm designed to enhance LLM reasoning capabilities across diverse domains.<n>We train a series of models and evaluate them on a wide range of datasets covering wide domains like physics, chemistry, finance, electronics etc.
  arXiv  Detail & Related papers  (2025-05-20T17:41:33Z)
• Evaluating Large Language Models for Real-World Engineering Tasks [75.97299249823972]
  This paper introduces a curated database comprising over 100 questions derived from authentic, production-oriented engineering scenarios.<n>Using this dataset, we evaluate four state-of-the-art Large Language Models (LLMs)<n>Our results show that LLMs demonstrate strengths in basic temporal and structural reasoning but struggle significantly with abstract reasoning, formal modeling, and context-sensitive engineering logic.
  arXiv  Detail & Related papers  (2025-05-12T14:05:23Z)
• OmniScience: A Domain-Specialized LLM for Scientific Reasoning and Discovery [12.306721865990053]
  We introduce OmniScience, a specialized large reasoning model for general science.<n>We develop a battery agent that efficiently ranks molecules as potential electrolyte solvents or additives.<n>We demonstrate via ablation experiments that domain adaptive pretraining and reasoning-based knowledge distillation are critical to attain our performance levels.
  arXiv  Detail & Related papers  (2025-03-22T01:18:59Z)
• Exploring the Benefits of Domain-Pretraining of Generative Large Language Models for Chemistry [5.4665365335928024]
  We investigate the trade-offs of leveraging off-the-shelf versus more targeted foundation models for scientific domains. In this work, we examine the benefits of in-domain pre-training for a given scientific domain, chemistry, and compare these to open-source, off-the-shelf models with zero-shot and few-shot prompting. Our results show that not only do in-domain base models perform reasonably well on in-domain tasks in a zero-shot setting but that further adaptation using instruction fine-tuning yields impressive performance on chemistry-specific tasks.
  arXiv  Detail & Related papers  (2024-11-05T22:45:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.