Towards Interpretability in Audio and Visual Affective Machine Learning: A Review

• URL: http://arxiv.org/abs/2306.08933v1
• Date: Thu, 15 Jun 2023 08:16:01 GMT
• Title: Towards Interpretability in Audio and Visual Affective Machine Learning: A Review
• Authors: David S. Johnson, Olya Hakobyan, and Hanna Drimalla
• Abstract summary: We perform a structured literature review to examine the use of interpretability in the context of affective machine learning. Our findings show an emergence of the use of interpretability methods in the last five years. Their use is currently limited regarding the range of methods used, the depth of evaluations, and the consideration of use-cases.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Machine learning is frequently used in affective computing, but presents challenges due the opacity of state-of-the-art machine learning methods. Because of the impact affective machine learning systems may have on an individual's life, it is important that models be made transparent to detect and mitigate biased decision making. In this regard, affective machine learning could benefit from the recent advancements in explainable artificial intelligence (XAI) research. We perform a structured literature review to examine the use of interpretability in the context of affective machine learning. We focus on studies using audio, visual, or audiovisual data for model training and identified 29 research articles. Our findings show an emergence of the use of interpretability methods in the last five years. However, their use is currently limited regarding the range of methods used, the depth of evaluations, and the consideration of use-cases. We outline the main gaps in the research and provide recommendations for researchers that aim to implement interpretable methods for affective machine learning.

Related papers

• Differential contributions of machine learning and statistical analysis to language and cognitive sciences [27.152245569974678]
  This study employs the Buckeye Speech Corpus to illustrate how machine learning and statistical analysis are applied in data-driven research. We demonstrate the theoretical differences, implementation steps, and unique objectives of each approach. The study highlights how semantic relevance, a novel metric measuring contextual influence on target words, contributes to understanding word duration in speech.
  arXiv  Detail & Related papers  (2024-04-22T10:06:21Z)
• Self-Explainable Affordance Learning with Embodied Caption [63.88435741872204]
  We introduce Self-Explainable Affordance learning (SEA) with embodied caption. SEA enables robots to articulate their intentions and bridge the gap between explainable vision-language caption and visual affordance learning. We propose a novel model to effectively combine affordance grounding with self-explanation in a simple but efficient manner.
  arXiv  Detail & Related papers  (2024-04-08T15:22:38Z)
• Application-Driven Innovation in Machine Learning [56.85396167616353]
  We describe the paradigm of application-driven research in machine learning. We show how this approach can productively synergize with methods-driven work. Despite these benefits, we find that reviewing, hiring, and teaching practices in machine learning often hold back application-driven innovation.
  arXiv  Detail & Related papers  (2024-03-26T04:59:27Z)
• Explainability in Machine Learning: a Pedagogical Perspective [9.393988089692947]
  We provide a pedagogical perspective on how to structure the learning process to better impart knowledge to students and researchers in machine learning. We discuss the advantages and disadvantages of various opaque and transparent machine learning models. We will also discuss ways to structure potential assignments to best help students learn to use explainability as a tool alongside any given machine learning application.
  arXiv  Detail & Related papers  (2022-02-21T16:15:57Z)
• An Interactive Visualization Tool for Understanding Active Learning [12.345164513513671]
  We present an interactive visualization tool to elucidate the training process of active learning. The tool enables one to select a sample of interesting data points, view how their prediction values change at different querying stages, and thus better understand when and how active learning works.
  arXiv  Detail & Related papers  (2021-11-09T03:33:26Z)
• Human-Robot Collaboration and Machine Learning: A Systematic Review of Recent Research [69.48907856390834]
  Human-robot collaboration (HRC) is the approach that explores the interaction between a human and a robot. This paper proposes a thorough literature review of the use of machine learning techniques in the context of HRC.
  arXiv  Detail & Related papers  (2021-10-14T15:14:33Z)
• Ten Quick Tips for Deep Learning in Biology [116.78436313026478]
  Machine learning is concerned with the development and applications of algorithms that can recognize patterns in data and use them for predictive modeling. Deep learning has become its own subfield of machine learning. In the context of biological research, deep learning has been increasingly used to derive novel insights from high-dimensional biological data.
  arXiv  Detail & Related papers  (2021-05-29T21:02:44Z)
• Individual Explanations in Machine Learning Models: A Survey for Practitioners [69.02688684221265]
  The use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Many governments, institutions, and companies are reluctant to their adoption as their output is often difficult to explain in human-interpretable ways. Recently, the academic literature has proposed a substantial amount of methods for providing interpretable explanations to machine learning models.
  arXiv  Detail & Related papers  (2021-04-09T01:46:34Z)
• Knowledge as Invariance -- History and Perspectives of Knowledge-augmented Machine Learning [69.99522650448213]
  Research in machine learning is at a turning point. Research interests are shifting away from increasing the performance of highly parameterized models to exceedingly specific tasks. This white paper provides an introduction and discussion of this emerging field in machine learning research.
  arXiv  Detail & Related papers  (2020-12-21T15:07:19Z)
• Ethical behavior in humans and machines -- Evaluating training data quality for beneficial machine learning [0.0]
  This study describes new dimensions of data quality for supervised machine learning applications. The specific objective of this study is to describe how training data can be selected according to ethical assessments of the behavior it originates from.
  arXiv  Detail & Related papers  (2020-08-26T09:48:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.