Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectives

• URL: http://arxiv.org/abs/2503.13793v1
• Date: Tue, 18 Mar 2025 00:49:43 GMT
• Title: Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectives
• Authors: Dipin Khati, Yijin Liu, David N. Palacio, Yixuan Zhang, Denys Poshyvanyk,
• Abstract summary: Applications of Large Language Models (LLMs) are rapidly growing in industry and academia for various software engineering (SE) tasks.<n>As these models become more integral to critical processes, ensuring their reliability and trustworthiness becomes essential.<n>The landscape of trust-related concepts in LLMs in SE is relatively unclear, with concepts such as trust, distrust, and trustworthiness lacking clear conceptualizations.
• Score: 25.27634711529676
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Applications of Large Language Models (LLMs) are rapidly growing in industry and academia for various software engineering (SE) tasks. As these models become more integral to critical processes, ensuring their reliability and trustworthiness becomes essential. Consequently, the concept of trust in these systems is becoming increasingly critical. Well-calibrated trust is important, as excessive trust can lead to security vulnerabilities, and risks, while insufficient trust can hinder innovation. However, the landscape of trust-related concepts in LLMs in SE is relatively unclear, with concepts such as trust, distrust, and trustworthiness lacking clear conceptualizations in the SE community. To bring clarity to the current research status and identify opportunities for future work, we conducted a comprehensive review of $88$ papers: a systematic literature review of $18$ papers focused on LLMs in SE, complemented by an analysis of 70 papers from broader trust literature. Additionally, we conducted a survey study with 25 domain experts to gain insights into practitioners' understanding of trust and identify gaps between existing literature and developers' perceptions. The result of our analysis serves as a roadmap that covers trust-related concepts in LLMs in SE and highlights areas for future exploration.

Related papers

• Risk Assessment Framework for Code LLMs via Leveraging Internal States [4.216536684967512]
  We propose PtTrust, a two-stage risk assessment framework for code LLM based on internal state pre-training. PtTrust first performs unsupervised pre-training on large-scale unlabeled source code to learn general representations of LLM states. We demonstrate the effectiveness of PtTrust through fine-grained, code line-level risk assessment.
  arXiv  Detail & Related papers  (2025-04-20T14:44:18Z)
• A Survey on Trustworthy LLM Agents: Threats and Countermeasures [67.23228612512848]
  Large Language Models (LLMs) and Multi-agent Systems (MAS) have significantly expanded the capabilities of LLM ecosystems. We propose the TrustAgent framework, a comprehensive study on the trustworthiness of agents.
  arXiv  Detail & Related papers  (2025-03-12T08:42:05Z)
• Mapping Trustworthiness in Large Language Models: A Bibliometric Analysis Bridging Theory to Practice [11.837705812832835]
  Large Language Models (LLMs) have raised concerns regarding their trustworthiness, spanning issues of reliability, transparency, fairness, and ethical alignment. This study bridges the gap between theoretical discussions and implementation by conducting a bibliometric mapping analysis of 2,006 publications from 2019 to 2025.
  arXiv  Detail & Related papers  (2025-02-27T14:02:33Z)
• Trust & Safety of LLMs and LLMs in Trust & Safety [0.0]
  This systematic review investigates the current research landscape on trust and safety in Large Language Models. We delve into the complexities of utilizing LLMs in domains where maintaining trust and safety is paramount. This review provides insights on best practices for using LLMs in Trust and Safety, and explores emerging risks such as prompt injection and jailbreak attacks.
  arXiv  Detail & Related papers  (2024-12-03T03:10:12Z)
• MultiTrust: A Comprehensive Benchmark Towards Trustworthy Multimodal Large Language Models [51.19622266249408]
  MultiTrust is the first comprehensive and unified benchmark on the trustworthiness of MLLMs. Our benchmark employs a rigorous evaluation strategy that addresses both multimodal risks and cross-modal impacts. Extensive experiments with 21 modern MLLMs reveal some previously unexplored trustworthiness issues and risks.
  arXiv  Detail & Related papers  (2024-06-11T08:38:13Z)
• TrustScore: Reference-Free Evaluation of LLM Response Trustworthiness [58.721012475577716]
  Large Language Models (LLMs) have demonstrated impressive capabilities across various domains, prompting a surge in their practical applications. This paper introduces TrustScore, a framework based on the concept of Behavioral Consistency, which evaluates whether an LLMs response aligns with its intrinsic knowledge.
  arXiv  Detail & Related papers  (2024-02-19T21:12:14Z)
• TrustLLM: Trustworthiness in Large Language Models [446.5640421311468]
  This paper introduces TrustLLM, a comprehensive study of trustworthiness in large language models (LLMs) We first propose a set of principles for trustworthy LLMs that span eight different dimensions. Based on these principles, we establish a benchmark across six dimensions including truthfulness, safety, fairness, robustness, privacy, and machine ethics.
  arXiv  Detail & Related papers  (2024-01-10T22:07:21Z)
• Insights into Fairness through Trust: Multi-scale Trust Quantification for Financial Deep Learning [94.65749466106664]
  A fundamental aspect of fairness that has not been explored in financial deep learning is the concept of trust. We conduct multi-scale trust quantification on a deep neural network for the purpose of credit card default prediction.
  arXiv  Detail & Related papers  (2020-11-03T19:05:07Z)
• Where Does Trust Break Down? A Quantitative Trust Analysis of Deep Neural Networks via Trust Matrix and Conditional Trust Densities [94.65749466106664]
  We introduce the concept of trust matrix, a novel trust quantification strategy. A trust matrix defines the expected question-answer trust for a given actor-oracle answer scenario. We further extend the concept of trust densities with the notion of conditional trust densities.
  arXiv  Detail & Related papers  (2020-09-30T14:33:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.