On the Intersection of Signal Processing and Machine Learning: A Use Case-Driven Analysis Approach

• URL: http://arxiv.org/abs/2403.17181v1
• Date: Mon, 25 Mar 2024 20:47:10 GMT
• Title: On the Intersection of Signal Processing and Machine Learning: A Use Case-Driven Analysis Approach
• Authors: Sulaiman Aburakhia, Abdallah Shami, George K. Karagiannidis,
• Abstract summary: This work offers an application-independent review and introduces a novel classification taxonomy for feature extraction techniques. It aims at linking theoretical concepts with practical applications, and demonstrates this through two specific use cases. In addition to theoretical contributions, this work promotes a collaborative research culture by providing a public repository of relevant Python and Python-based signal processing codes.
• Score: 28.59539400247894
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advancements in sensing, measurement, and computing technologies have significantly expanded the potential for signal-based applications, leveraging the synergy between signal processing and Machine Learning (ML) to improve both performance and reliability. This fusion represents a critical point in the evolution of signal-based systems, highlighting the need to bridge the existing knowledge gap between these two interdisciplinary fields. Despite many attempts in the existing literature to bridge this gap, most are limited to specific applications and focus mainly on feature extraction, often assuming extensive prior knowledge in signal processing. This assumption creates a significant obstacle for a wide range of readers. To address these challenges, this paper takes an integrated article approach. It begins with a detailed tutorial on the fundamentals of signal processing, providing the reader with the necessary background knowledge. Following this, it explores the key stages of a standard signal processing-based ML pipeline, offering an in-depth review of feature extraction techniques, their inherent challenges, and solutions. Differing from existing literature, this work offers an application-independent review and introduces a novel classification taxonomy for feature extraction techniques. Furthermore, it aims at linking theoretical concepts with practical applications, and demonstrates this through two specific use cases: a spectral-based method for condition monitoring of rolling bearings and a wavelet energy analysis for epilepsy detection using EEG signals. In addition to theoretical contributions, this work promotes a collaborative research culture by providing a public repository of relevant Python and MATLAB signal processing codes. This effort is intended to support collaborative research efforts and ensure the reproducibility of the results presented.

Related papers

• Boosting CNN-based Handwriting Recognition Systems with Learnable Relaxation Labeling [48.78361527873024]
  We propose a novel approach to handwriting recognition that integrates the strengths of two distinct methodologies. We introduce a sparsification technique that accelerates the convergence of the algorithm and enhances the overall system's performance.
  arXiv  Detail & Related papers  (2024-09-09T15:12:28Z)
• Riemannian Geometry-Based EEG Approaches: A Literature Review [1.9411911000346784]
  We review recent advancements in the integration of deep learning with riemannian geometry to enhance EEG signal decoding in BCIs. We discuss how these approaches tackle the traditional challenges of noise sensitivity, non-stationarity, and lengthy calibration times. We propose future research directions in manifold learning and riemannian-based classification.
  arXiv  Detail & Related papers  (2024-07-19T13:28:29Z)
• Learning From Crowdsourced Noisy Labels: A Signal Processing Perspective [42.24248330317496]
  This feature article introduces advances in learning from noisy crowdsourced labels. The focus is on key crowdsourcing models and their methodological treatments, from classical statistical models to recent deep learning-based approaches. In particular, this article reviews the connections between signal processing (SP) theory and methods, such as identifiability of tensor and nonnegative matrix factorization.
  arXiv  Detail & Related papers  (2024-07-09T14:34:40Z)
• Multi-task Learning for Radar Signal Characterisation [48.265859815346985]
  This paper presents an approach for tackling radar signal classification and characterisation as a multi-task learning (MTL) problem. We propose the IQ Signal Transformer (IQST) among several reference architectures that allow for simultaneous optimisation of multiple regression and classification tasks. We demonstrate the performance of our proposed MTL model on a synthetic radar dataset, while also providing a first-of-its-kind benchmark for radar signal characterisation.
  arXiv  Detail & Related papers  (2023-06-19T12:01:28Z)
• Signal Transformer: Complex-valued Attention and Meta-Learning for Signal Recognition [33.178794056273304]
  We propose a Complex-valued Attentional MEta Learner (CAMEL) for the problem few of general nonvalued problems with theoretical convergence guarantees. This paper shows the superiority of the proposed data recognition experiments when the state is abundant small data.
  arXiv  Detail & Related papers  (2021-06-05T03:57:41Z)
• Signal Processing and Machine Learning Techniques for Terahertz Sensing: An Overview [89.09270073549182]
  Terahertz (THz) signal generation and radiation methods are shaping the future of wireless systems. THz-specific signal processing techniques should complement this re-surged interest in THz sensing for efficient utilization of the THz band. We present an overview of these techniques, with an emphasis on signal pre-processing. We also address the effectiveness of deep learning techniques by exploring their promising sensing capabilities at the THz band.
  arXiv  Detail & Related papers  (2021-04-09T01:38:34Z)
• Federated Learning: A Signal Processing Perspective [144.63726413692876]
  Federated learning is an emerging machine learning paradigm for training models across multiple edge devices holding local datasets, without explicitly exchanging the data. This article provides a unified systematic framework for federated learning in a manner that encapsulates and highlights the main challenges that are natural to treat using signal processing tools.
  arXiv  Detail & Related papers  (2021-03-31T15:14:39Z)
• A Comprehensive Survey of Machine Learning Based Localization with Wireless Signals [42.89359907212791]
  This paper provides a comprehensive survey of Machine Learning-based localization solutions that use RF signals. A main point of the paper is the interaction between the domain knowledge arising from the physics of localization systems, and the various ML approaches. A detailed discussion is dedicated to the different ML methods that have been applied to localization problems.
  arXiv  Detail & Related papers  (2020-12-21T08:10:46Z)
• Wireless for Machine Learning [91.13476340719087]
  We give an exhaustive review of the state-of-the-art wireless methods that are specifically designed to support machine learning services over distributed datasets. There are two clear themes within the literature, analog over-the-air computation and digital radio resource management optimized for ML. This survey gives a comprehensive introduction to these methods, reviews the most important works, highlights open problems, and discusses application scenarios.
  arXiv  Detail & Related papers  (2020-08-31T11:09:49Z)
• Multilinear Compressive Learning with Prior Knowledge [106.12874293597754]
  Multilinear Compressive Learning (MCL) framework combines Multilinear Compressive Sensing and Machine Learning into an end-to-end system. Key idea behind MCL is the assumption of the existence of a tensor subspace which can capture the essential features from the signal for the downstream learning task. In this paper, we propose a novel solution to address both of the aforementioned requirements, i.e., How to find those tensor subspaces in which the signals of interest are highly separable?
  arXiv  Detail & Related papers  (2020-02-17T19:06:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.