Towards Interpretability in Audio and Visual Affective Machine Learning: A Review

• URL: http://arxiv.org/abs/2306.08933v1
• Date: Thu, 15 Jun 2023 08:16:01 GMT
• Title: Towards Interpretability in Audio and Visual Affective Machine Learning: A Review
• Authors: David S. Johnson, Olya Hakobyan, and Hanna Drimalla
• Abstract summary: We perform a structured literature review to examine the use of interpretability in the context of affective machine learning. Our findings show an emergence of the use of interpretability methods in the last five years. Their use is currently limited regarding the range of methods used, the depth of evaluations, and the consideration of use-cases.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Machine learning is frequently used in affective computing, but presents challenges due the opacity of state-of-the-art machine learning methods. Because of the impact affective machine learning systems may have on an individual's life, it is important that models be made transparent to detect and mitigate biased decision making. In this regard, affective machine learning could benefit from the recent advancements in explainable artificial intelligence (XAI) research. We perform a structured literature review to examine the use of interpretability in the context of affective machine learning. We focus on studies using audio, visual, or audiovisual data for model training and identified 29 research articles. Our findings show an emergence of the use of interpretability methods in the last five years. However, their use is currently limited regarding the range of methods used, the depth of evaluations, and the consideration of use-cases. We outline the main gaps in the research and provide recommendations for researchers that aim to implement interpretable methods for affective machine learning.

Related papers

• Machine Learning-Driven Student Performance Prediction for Enhancing Tiered Instruction [11.564820268803619]
  Student performance prediction is one of the most important subjects in educational data mining. Despite extensive prediction experiments, machine learning methods have not been effectively integrated into practical teaching strategies. This study integrates the results of machine learning-based student performance prediction with tiered instruction, aiming to enhance student outcomes in target course.
  arXiv  Detail & Related papers  (2025-02-05T13:13:25Z)
• A Comparative Study of Machine Unlearning Techniques for Image and Text Classification Models [0.0]
  Machine Unlearning has emerged as a critical area in artificial intelligence, addressing the need to selectively remove learned data from machine learning models. This paper provides a comprehensive comparative analysis of six state-of-theart unlearning techniques applied to image and text classification tasks.
  arXiv  Detail & Related papers  (2024-12-27T10:58:55Z)
• Learner Attentiveness and Engagement Analysis in Online Education Using Computer Vision [3.449808359602251]
  This research presents a computer vision-based approach to analyze and quantify learners' attentiveness, engagement, and other affective states within online learning scenarios. A machine learning-based algorithm is developed on top of the classification model that outputs a comprehensive attentiveness index of the learners. An end-to-end pipeline is proposed through which learners' live video feed is processed, providing detailed attentiveness analytics of the learners to the instructors.
  arXiv  Detail & Related papers  (2024-11-30T10:54:08Z)
• Differential contributions of machine learning and statistical analysis to language and cognitive sciences [27.152245569974678]
  This study employs the Buckeye Speech Corpus to illustrate how machine learning and statistical analysis are applied in data-driven research. We demonstrate the theoretical differences, implementation steps, and unique objectives of each approach. The study highlights how semantic relevance, a novel metric measuring contextual influence on target words, contributes to understanding word duration in speech.
  arXiv  Detail & Related papers  (2024-04-22T10:06:21Z)
• Self-Explainable Affordance Learning with Embodied Caption [63.88435741872204]
  We introduce Self-Explainable Affordance learning (SEA) with embodied caption. SEA enables robots to articulate their intentions and bridge the gap between explainable vision-language caption and visual affordance learning. We propose a novel model to effectively combine affordance grounding with self-explanation in a simple but efficient manner.
  arXiv  Detail & Related papers  (2024-04-08T15:22:38Z)
• Application-Driven Innovation in Machine Learning [56.85396167616353]
  We describe the paradigm of application-driven research in machine learning. We show how this approach can productively synergize with methods-driven work. Despite these benefits, we find that reviewing, hiring, and teaching practices in machine learning often hold back application-driven innovation.
  arXiv  Detail & Related papers  (2024-03-26T04:59:27Z)
• An Interactive Visualization Tool for Understanding Active Learning [12.345164513513671]
  We present an interactive visualization tool to elucidate the training process of active learning. The tool enables one to select a sample of interesting data points, view how their prediction values change at different querying stages, and thus better understand when and how active learning works.
  arXiv  Detail & Related papers  (2021-11-09T03:33:26Z)
• Human-Robot Collaboration and Machine Learning: A Systematic Review of Recent Research [69.48907856390834]
  Human-robot collaboration (HRC) is the approach that explores the interaction between a human and a robot. This paper proposes a thorough literature review of the use of machine learning techniques in the context of HRC.
  arXiv  Detail & Related papers  (2021-10-14T15:14:33Z)
• Ten Quick Tips for Deep Learning in Biology [116.78436313026478]
  Machine learning is concerned with the development and applications of algorithms that can recognize patterns in data and use them for predictive modeling. Deep learning has become its own subfield of machine learning. In the context of biological research, deep learning has been increasingly used to derive novel insights from high-dimensional biological data.
  arXiv  Detail & Related papers  (2021-05-29T21:02:44Z)
• Individual Explanations in Machine Learning Models: A Survey for Practitioners [69.02688684221265]
  The use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Many governments, institutions, and companies are reluctant to their adoption as their output is often difficult to explain in human-interpretable ways. Recently, the academic literature has proposed a substantial amount of methods for providing interpretable explanations to machine learning models.
  arXiv  Detail & Related papers  (2021-04-09T01:46:34Z)
• Knowledge as Invariance -- History and Perspectives of Knowledge-augmented Machine Learning [69.99522650448213]
  Research in machine learning is at a turning point. Research interests are shifting away from increasing the performance of highly parameterized models to exceedingly specific tasks. This white paper provides an introduction and discussion of this emerging field in machine learning research.
  arXiv  Detail & Related papers  (2020-12-21T15:07:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.