Navigating Shortcuts, Spurious Correlations, and Confounders: From Origins via Detection to Mitigation

• URL: http://arxiv.org/abs/2412.05152v1
• Date: Fri, 06 Dec 2024 16:10:13 GMT
• Title: Navigating Shortcuts, Spurious Correlations, and Confounders: From Origins via Detection to Mitigation
• Authors: David Steinmann, Felix Divo, Maurice Kraus, Antonia Wüst, Lukas Struppek, Felix Friedrich, Kristian Kersting,
• Abstract summary: Clever Hans behavior, spurious correlations, or confounders, present a significant challenge in machine learning and AI. Research in this area remains fragmented across various terminologies, hindering the progress of the field as a whole. We introduce a unifying taxonomy by providing a formal definition of shortcuts and bridging the diverse terms used in the literature.
• Score: 21.21130450731374
• License:
• Abstract: Shortcuts, also described as Clever Hans behavior, spurious correlations, or confounders, present a significant challenge in machine learning and AI, critically affecting model generalization and robustness. Research in this area, however, remains fragmented across various terminologies, hindering the progress of the field as a whole. Consequently, we introduce a unifying taxonomy of shortcut learning by providing a formal definition of shortcuts and bridging the diverse terms used in the literature. In doing so, we further establish important connections between shortcuts and related fields, including bias, causality, and security, where parallels exist but are rarely discussed. Our taxonomy organizes existing approaches for shortcut detection and mitigation, providing a comprehensive overview of the current state of the field and revealing underexplored areas and open challenges. Moreover, we compile and classify datasets tailored to study shortcut learning. Altogether, this work provides a holistic perspective to deepen understanding and drive the development of more effective strategies for addressing shortcuts in machine learning.

Related papers

• Shortcut Learning in In-Context Learning: A Survey [16.324397674149626]
  Shortcut learning refers to the phenomenon where models employ simple, non-robust decision rules in practical tasks. This paper provides a novel perspective to review relevant research on shortcut learning in In-Context Learning (ICL)
  arXiv  Detail & Related papers  (2024-11-04T12:13:04Z)
• Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomy [6.346947904159397]
  Unsupervised object discovery is commonly interpreted as the task of localizing and/or categorizing objects in visual data without the need for labeled examples. This survey conducts an in-depth exploration of the existing approaches and systematically categorizes this compendium based on the tasks addressed and the families of techniques employed. We present an overview of common datasets and metrics, highlighting the challenges of comparing methods due to varying evaluation protocols.
  arXiv  Detail & Related papers  (2024-10-30T21:22:48Z)
• Navigating the Shortcut Maze: A Comprehensive Analysis of Shortcut Learning in Text Classification by Language Models [20.70050968223901]
  This study addresses the overlooked impact of subtler, more complex shortcuts that compromise model reliability beyond oversimplified shortcuts. We introduce a comprehensive benchmark that categorizes shortcuts into occurrence, style, and concept. Our research systematically investigates models' resilience and susceptibilities to sophisticated shortcuts.
  arXiv  Detail & Related papers  (2024-09-26T01:17:42Z)
• The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trends [64.99423243200296]
  Conversation Analysis (CA) strives to uncover and analyze critical information from conversation data. In this paper, we perform a thorough review and systematize CA task to summarize the existing related work. We derive four key steps of CA from conversation scene reconstruction, to in-depth attribution analysis, and then to performing targeted training, finally generating conversations.
  arXiv  Detail & Related papers  (2024-09-21T16:52:43Z)
• Coding for Intelligence from the Perspective of Category [66.14012258680992]
  Coding targets compressing and reconstructing data, and intelligence. Recent trends demonstrate the potential homogeneity of these two fields. We propose a novel problem of Coding for Intelligence from the category theory view.
  arXiv  Detail & Related papers  (2024-07-01T07:05:44Z)
• Investigating Multi-Hop Factual Shortcuts in Knowledge Editing of Large Language Models [18.005770232698566]
  We first explore the existence of factual shortcuts through Knowledge Neurons. We analyze the risks posed by factual shortcuts from the perspective of multi-hop knowledge editing.
  arXiv  Detail & Related papers  (2024-02-19T07:34:10Z)
• Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detection [57.13665112065285]
  Human-Object Interaction (HOI) detection is a challenging computer vision task. We present a framework that enhances HOI detection by incorporating structured text knowledge.
  arXiv  Detail & Related papers  (2023-07-25T14:20:52Z)
• A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning [58.107474025048866]
  Forgetting refers to the loss or deterioration of previously acquired knowledge. Forgetting is a prevalent phenomenon observed in various other research domains within deep learning.
  arXiv  Detail & Related papers  (2023-07-16T16:27:58Z)
• Knowledge-Enhanced Hierarchical Information Correlation Learning for Multi-Modal Rumor Detection [82.94413676131545]
  We propose a novel knowledge-enhanced hierarchical information correlation learning approach (KhiCL) for multi-modal rumor detection. KhiCL exploits cross-modal joint dictionary to transfer the heterogeneous unimodality features into the common feature space. It extracts visual and textual entities from images and text, and designs a knowledge relevance reasoning strategy.
  arXiv  Detail & Related papers  (2023-06-28T06:08:20Z)
• Parsing Objects at a Finer Granularity: A Survey [54.72819146263311]
  Fine-grained visual parsing is important in many real-world applications, e.g., agriculture, remote sensing, and space technologies. Predominant research efforts tackle these fine-grained sub-tasks following different paradigms. We conduct an in-depth study of the advanced work from a new perspective of learning the part relationship.
  arXiv  Detail & Related papers  (2022-12-28T04:20:10Z)
• A Survey on Measuring and Mitigating Reasoning Shortcuts in Machine Reading Comprehension [34.400234717524306]
  We focus on the field of machine reading comprehension (MRC), an important task for showcasing high-level language understanding. We highlight two concerns for shortcut mitigation in MRC: (1) the lack of public challenge sets, a necessary component for effective and reusable evaluation, and (2) the lack of certain mitigation techniques that are prominent in other areas.
  arXiv  Detail & Related papers  (2022-09-05T08:19:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.