Trustworthy Machine Learning under Distribution Shifts

• URL: http://arxiv.org/abs/2512.23524v1
• Date: Mon, 29 Dec 2025 15:02:59 GMT
• Title: Trustworthy Machine Learning under Distribution Shifts
• Abstract summary: Motivated by these challenges, my research focuses on textitTrustworthy Machine Learning under Distribution Shifts<n>We study the three common distribution shifts into: (1) Perturbation Shift, (2) Domain Shift, and (3) Modality Shift.<n>Based on these dimensions, we propose effective solutions and fundamental insights, aiming to enhance the critical ML problems, such as efficiency, adaptability, and safety.
• Score: 8.366824976517272
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Machine Learning (ML) has been a foundational topic in artificial intelligence (AI), providing both theoretical groundwork and practical tools for its exciting advancements. From ResNet for visual recognition to Transformer for vision-language alignment, the AI models have achieved superior capability to humans. Furthermore, the scaling law has enabled AI to initially develop general intelligence, as demonstrated by Large Language Models (LLMs). To this stage, AI has had an enormous influence on society and yet still keeps shaping the future for humanity. However, distribution shift remains a persistent ``Achilles' heel'', fundamentally limiting the reliability and general usefulness of ML systems. Moreover, generalization under distribution shift would also cause trust issues for AIs. Motivated by these challenges, my research focuses on \textit{Trustworthy Machine Learning under Distribution Shifts}, with the goal of expanding AI's robustness, versatility, as well as its responsibility and reliability. We carefully study the three common distribution shifts into: (1) Perturbation Shift, (2) Domain Shift, and (3) Modality Shift. For all scenarios, we also rigorously investigate trustworthiness via three aspects: (1) Robustness, (2) Explainability, and (3) Adaptability. Based on these dimensions, we propose effective solutions and fundamental insights, meanwhile aiming to enhance the critical ML problems, such as efficiency, adaptability, and safety.

Related papers

• Trustworthy AI Suffers from Invariance Conflicts and Causality is The Solution [80.98492754957466]
  Core trustworthy AI objectives, such as fairness, robustness, privacy, and explainability, are hard to achieve simultaneously.<n>This paper argues that causality is necessary to understand and balance trade-offs in performance and multiple objectives of trustworthy AI.
  arXiv  Detail & Related papers  (2026-05-04T14:26:28Z)
• Understanding Critical Thinking in Generative Artificial Intelligence Use: Development, Validation, and Correlates of the Critical Thinking in AI Use Scale [1.0946458347622612]
  This research conceptualises critical thinking in AI use as a dispositional tendency to verify the source and content of AI-generated information.<n>We developed and validated the 13-item critical thinking in AI use scale and mapped its nomological network.<n>Studies 3 and 4 revealed that critical thinking in AI use was positively associated with openness, extraversion, positive trait affect, and frequency of AI use.
  arXiv  Detail & Related papers  (2025-12-13T17:56:12Z)
• The Missing Reward: Active Inference in the Era of Experience [1.9761774213809036]
  Active Inference (AIF) provides a crucial foundation for developing autonomous AI agents.<n>AIF can replace external reward signals with an intrinsic drive to minimize free energy.<n>This synthesis offers a compelling path toward AI systems that can develop autonomously while adhering to both computational and physical constraints.
  arXiv  Detail & Related papers  (2025-08-07T17:57:12Z)
• Beyond Statistical Learning: Exact Learning Is Essential for General Intelligence [59.07578850674114]
  Sound deductive reasoning is an indisputably desirable aspect of general intelligence.<n>It is well-documented that even the most advanced frontier systems regularly and consistently falter on easily-solvable reasoning tasks.<n>We argue that their unsound behavior is a consequence of the statistical learning approach powering their development.
  arXiv  Detail & Related papers  (2025-06-30T14:37:50Z)
• Position Paper: Bounded Alignment: What (Not) To Expect From AGI Agents [0.0]
  The goal of this position paper is to argue that the currently dominant vision of AGI in the AI and machine learning (AI/ML) community needs to evolve.<n>This change in perspective will lead to a more realistic view of the technology, and allow for better policy decisions.
  arXiv  Detail & Related papers  (2025-05-17T06:17:57Z)
• Epistemic Artificial Intelligence is Essential for Machine Learning Models to Truly 'Know When They Do Not Know' [10.098470725619384]
  Despite AI's impressive achievements, there remains a significant gap in the ability of AI systems to handle uncertainty.<n>Traditional machine learning approaches struggle to address this issue, due to an overemphasis on data fitting.<n>This position paper posits a paradigm shift towards epistemic artificial intelligence, emphasizing the need for models to learn from what they know.
  arXiv  Detail & Related papers  (2025-05-08T05:10:38Z)
• A Multi-Layered Research Framework for Human-Centered AI: Defining the Path to Explainability and Trust [2.4578723416255754]
  Human-Centered AI (HCAI) emphasizes alignment with human values, while Explainable AI (XAI) enhances transparency by making AI decisions more understandable.<n>This paper presents a novel three-layered framework that bridges HCAI and XAI to establish a structured explainability paradigm.<n>Our findings advance Human-Centered Explainable AI (HCXAI), fostering AI systems that are transparent, adaptable, and ethically aligned.
  arXiv  Detail & Related papers  (2025-04-14T01:29:30Z)
• An Overview of Large Language Models for Statisticians [109.38601458831545]
  Large Language Models (LLMs) have emerged as transformative tools in artificial intelligence (AI)<n>This paper explores potential areas where statisticians can make important contributions to the development of LLMs.<n>We focus on issues such as uncertainty quantification, interpretability, fairness, privacy, watermarking and model adaptation.
  arXiv  Detail & Related papers  (2025-02-25T03:40:36Z)
• Hype, Sustainability, and the Price of the Bigger-is-Better Paradigm in AI [67.58673784790375]
  We argue that the 'bigger is better' AI paradigm is not only fragile scientifically, but comes with undesirable consequences.<n>First, it is not sustainable, as, despite efficiency improvements, its compute demands increase faster than model performance.<n>Second, it implies focusing on certain problems at the expense of others, leaving aside important applications, e.g. health, education, or the climate.
  arXiv  Detail & Related papers  (2024-09-21T14:43:54Z)
• AI and Social Theory [0.0]
  We sketch a programme for AI driven social theory, starting by defining what we mean by artificial intelligence (AI) We then lay out our model for how AI based models can draw on the growing availability of digital data to help test the validity of different social theories based on their predictive power.
  arXiv  Detail & Related papers  (2024-07-07T12:26:16Z)
• Enabling High-Level Machine Reasoning with Cognitive Neuro-Symbolic Systems [67.01132165581667]
  We propose to enable high-level reasoning in AI systems by integrating cognitive architectures with external neuro-symbolic components. We illustrate a hybrid framework centered on ACT-R and we discuss the role of generative models in recent and future applications.
  arXiv  Detail & Related papers  (2023-11-13T21:20:17Z)
• Human-Timescale Adaptation in an Open-Ended Task Space [56.55530165036327]
  We show that training an RL agent at scale leads to a general in-context learning algorithm that can adapt to open-ended novel embodied 3D problems as quickly as humans. Our results lay the foundation for increasingly general and adaptive RL agents that perform well across ever-larger open-ended domains.
  arXiv  Detail & Related papers  (2023-01-18T15:39:21Z)
• Explainable, Interpretable & Trustworthy AI for Intelligent Digital Twin: Case Study on Remaining Useful Life [0.5115559623386964]
  It is critical to have confidence in AI's trustworthiness in energy and engineering systems. The use of explainable AI (XAI) and interpretable machine learning (IML) is crucial for the accurate prediction of prognostics.
  arXiv  Detail & Related papers  (2023-01-17T03:17:07Z)
• AI Maintenance: A Robustness Perspective [91.28724422822003]
  We introduce highlighted robustness challenges in the AI lifecycle and motivate AI maintenance by making analogies to car maintenance. We propose an AI model inspection framework to detect and mitigate robustness risks. Our proposal for AI maintenance facilitates robustness assessment, status tracking, risk scanning, model hardening, and regulation throughout the AI lifecycle.
  arXiv  Detail & Related papers  (2023-01-08T15:02:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.