A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunities

• URL: http://arxiv.org/abs/2210.08906v2
• Date: Wed, 19 Oct 2022 07:37:47 GMT
• Title: A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunities
• Authors: Andrea Tocchetti, Lorenzo Corti, Agathe Balayn, Mireia Yurrita, Philip Lippmann, Marco Brambilla, and Jie Yang
• Abstract summary: Robustness of Artificial Intelligence (AI) systems remains elusive and constitutes a key issue that impedes large-scale adoption. We introduce three concepts to organize and describe the literature both from a fundamental and applied point of view. We highlight the central role of humans in evaluating and enhancing AI robustness, considering the necessary knowledge humans can provide.
• Score: 8.17368686298331
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Despite the impressive performance of Artificial Intelligence (AI) systems, their robustness remains elusive and constitutes a key issue that impedes large-scale adoption. Robustness has been studied in many domains of AI, yet with different interpretations across domains and contexts. In this work, we systematically survey the recent progress to provide a reconciled terminology of concepts around AI robustness. We introduce three taxonomies to organize and describe the literature both from a fundamental and applied point of view: 1) robustness by methods and approaches in different phases of the machine learning pipeline; 2) robustness for specific model architectures, tasks, and systems; and in addition, 3) robustness assessment methodologies and insights, particularly the trade-offs with other trustworthiness properties. Finally, we identify and discuss research gaps and opportunities and give an outlook on the field. We highlight the central role of humans in evaluating and enhancing AI robustness, considering the necessary knowledge humans can provide, and discuss the need for better understanding practices and developing supportive tools in the future.

Related papers

• A Multi-Layered Research Framework for Human-Centered AI: Defining the Path to Explainability and Trust [2.4578723416255754]
  Human-Centered AI (HCAI) emphasizes alignment with human values, while Explainable AI (XAI) enhances transparency by making AI decisions more understandable. This paper presents a novel three-layered framework that bridges HCAI and XAI to establish a structured explainability paradigm. Our findings advance Human-Centered Explainable AI (HCXAI), fostering AI systems that are transparent, adaptable, and ethically aligned.
  arXiv  Detail & Related papers  (2025-04-14T01:29:30Z)
• A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems [93.8285345915925]
  Reasoning is a fundamental cognitive process that enables logical inference, problem-solving, and decision-making. With the rapid advancement of large language models (LLMs), reasoning has emerged as a key capability that distinguishes advanced AI systems. We categorize existing methods along two dimensions: (1) Regimes, which define the stage at which reasoning is achieved; and (2) Architectures, which determine the components involved in the reasoning process.
  arXiv  Detail & Related papers  (2025-04-12T01:27:49Z)
• Assessing employment and labour issues implicated by using AI [0.0]
  The chapter critiques the dominant reductionist approach in AI and work studies. It advocates for a systemic perspective that emphasizes the interdependence of tasks, roles, and workplace contexts.
  arXiv  Detail & Related papers  (2025-04-08T10:14:19Z)
• A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions [51.96890647837277]
  Large Language Models (LLMs) have propelled conversational AI from traditional dialogue systems into sophisticated agents capable of autonomous actions, contextual awareness, and multi-turn interactions with users. This survey paper presents a desideratum for next-generation Conversational Agents - what has been achieved, what challenges persist, and what must be done for more scalable systems that approach human-level intelligence.
  arXiv  Detail & Related papers  (2025-04-07T21:01:25Z)
• Why Reasoning Matters? A Survey of Advancements in Multimodal Reasoning (v1) [66.51642638034822]
  Reasoning is central to human intelligence, enabling structured problem-solving across diverse tasks. Recent advances in large language models (LLMs) have greatly enhanced their reasoning abilities in arithmetic, commonsense, and symbolic domains. This paper offers a concise yet insightful overview of reasoning techniques in both textual and multimodal LLMs.
  arXiv  Detail & Related papers  (2025-04-04T04:04:56Z)
• Open Problems in Mechanistic Interpretability [61.44773053835185]
  Mechanistic interpretability aims to understand the computational mechanisms underlying neural networks' capabilities. Despite recent progress toward these goals, there are many open problems in the field that require solutions.
  arXiv  Detail & Related papers  (2025-01-27T20:57:18Z)
• Establishing and Evaluating Trustworthy AI: Overview and Research Challenges [4.806063079434686]
  Some AI systems have yielded unexpected or undesirable outcomes or have been used in questionable manners. This paper synthesizes existing conceptualizations of trustworthy AI along six requirements. It aims to serve as a reference for a broad audience and as a basis for future research directions.
  arXiv  Detail & Related papers  (2024-11-15T06:05:52Z)
• Socio-Economic Consequences of Generative AI: A Review of Methodological Approaches [0.0]
  We identify the primary methodologies that may be used to help predict the economic and social impacts of generative AI adoption. Through a comprehensive literature review, we uncover a range of methodologies poised to assess the multifaceted impacts of this technological revolution.
  arXiv  Detail & Related papers  (2024-11-14T09:40:25Z)
• AI-Driven Human-Autonomy Teaming in Tactical Operations: Proposed Framework, Challenges, and Future Directions [10.16399860867284]
  Artificial Intelligence (AI) techniques are transforming tactical operations by augmenting human decision-making capabilities. This paper explores AI-driven Human-Autonomy Teaming (HAT) as a transformative approach. We propose a comprehensive framework that addresses the key components of AI-driven HAT.
  arXiv  Detail & Related papers  (2024-10-28T15:05:16Z)
• Towards Bidirectional Human-AI Alignment: A Systematic Review for Clarifications, Framework, and Future Directions [101.67121669727354]
  Recent advancements in AI have highlighted the importance of guiding AI systems towards the intended goals, ethical principles, and values of individuals and groups, a concept broadly recognized as alignment. The lack of clarified definitions and scopes of human-AI alignment poses a significant obstacle, hampering collaborative efforts across research domains to achieve this alignment. We introduce a systematic review of over 400 papers published between 2019 and January 2024, spanning multiple domains such as Human-Computer Interaction (HCI), Natural Language Processing (NLP), Machine Learning (ML)
  arXiv  Detail & Related papers  (2024-06-13T16:03:25Z)
• Position Paper: Agent AI Towards a Holistic Intelligence [53.35971598180146]
  We emphasize developing Agent AI -- an embodied system that integrates large foundation models into agent actions. In this paper, we propose a novel large action model to achieve embodied intelligent behavior, the Agent Foundation Model.
  arXiv  Detail & Related papers  (2024-02-28T16:09:56Z)
• Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairness [53.91018508439669]
  The study explores the complexities of integrating Artificial Intelligence into Autonomous Vehicles (AVs) It examines the challenges introduced by AI components and the impact on testing procedures. The paper identifies significant challenges and suggests future directions for research and development of AI in AV technology.
  arXiv  Detail & Related papers  (2024-02-21T08:29:42Z)
• Predictable Artificial Intelligence [77.1127726638209]
  This paper introduces the ideas and challenges of Predictable AI. It explores the ways in which we can anticipate key validity indicators of present and future AI ecosystems. We argue that achieving predictability is crucial for fostering trust, liability, control, alignment and safety of AI ecosystems.
  arXiv  Detail & Related papers  (2023-10-09T21:36:21Z)
• Understanding the Application of Utility Theory in Robotics and Artificial Intelligence: A Survey [5.168741399695988]
  The utility is a unifying concept in economics, game theory, and operations research, even in the Robotics and AI field. This paper introduces a utility-orient needs paradigm to describe and evaluate inter and outer relationships among agents' interactions.
  arXiv  Detail & Related papers  (2023-06-15T18:55:48Z)
• Explainable Deep Reinforcement Learning: State of the Art and Challenges [1.005130974691351]
  Interpretability, explainability and transparency are key issues to introducing Artificial Intelligence methods in many critical domains. This article provides a review of state of the art methods for explainable deep reinforcement learning methods.
  arXiv  Detail & Related papers  (2023-01-24T11:41:25Z)
• Active Inference in Robotics and Artificial Agents: Survey and Challenges [51.29077770446286]
  We review the state-of-the-art theory and implementations of active inference for state-estimation, control, planning and learning. We showcase relevant experiments that illustrate its potential in terms of adaptation, generalization and robustness.
  arXiv  Detail & Related papers  (2021-12-03T12:10:26Z)
• Neuro-symbolic Architectures for Context Understanding [59.899606495602406]
  We propose the use of hybrid AI methodology as a framework for combining the strengths of data-driven and knowledge-driven approaches. Specifically, we inherit the concept of neuro-symbolism as a way of using knowledge-bases to guide the learning progress of deep neural networks.
  arXiv  Detail & Related papers  (2020-03-09T15:04:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.