On the Intersection of Signal Processing and Machine Learning: A Use Case-Driven Analysis Approach
- URL: http://arxiv.org/abs/2403.17181v1
- Date: Mon, 25 Mar 2024 20:47:10 GMT
- Title: On the Intersection of Signal Processing and Machine Learning: A Use Case-Driven Analysis Approach
- Authors: Sulaiman Aburakhia, Abdallah Shami, George K. Karagiannidis,
- Abstract summary: This work offers an application-independent review and introduces a novel classification taxonomy for feature extraction techniques.
It aims at linking theoretical concepts with practical applications, and demonstrates this through two specific use cases.
In addition to theoretical contributions, this work promotes a collaborative research culture by providing a public repository of relevant Python and Python-based signal processing codes.
- Score: 28.59539400247894
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Recent advancements in sensing, measurement, and computing technologies have significantly expanded the potential for signal-based applications, leveraging the synergy between signal processing and Machine Learning (ML) to improve both performance and reliability. This fusion represents a critical point in the evolution of signal-based systems, highlighting the need to bridge the existing knowledge gap between these two interdisciplinary fields. Despite many attempts in the existing literature to bridge this gap, most are limited to specific applications and focus mainly on feature extraction, often assuming extensive prior knowledge in signal processing. This assumption creates a significant obstacle for a wide range of readers. To address these challenges, this paper takes an integrated article approach. It begins with a detailed tutorial on the fundamentals of signal processing, providing the reader with the necessary background knowledge. Following this, it explores the key stages of a standard signal processing-based ML pipeline, offering an in-depth review of feature extraction techniques, their inherent challenges, and solutions. Differing from existing literature, this work offers an application-independent review and introduces a novel classification taxonomy for feature extraction techniques. Furthermore, it aims at linking theoretical concepts with practical applications, and demonstrates this through two specific use cases: a spectral-based method for condition monitoring of rolling bearings and a wavelet energy analysis for epilepsy detection using EEG signals. In addition to theoretical contributions, this work promotes a collaborative research culture by providing a public repository of relevant Python and MATLAB signal processing codes. This effort is intended to support collaborative research efforts and ensure the reproducibility of the results presented.
Related papers
- Learning From Crowdsourced Noisy Labels: A Signal Processing Perspective [42.24248330317496]
This feature article introduces advances in learning from noisy crowdsourced labels.
The focus is on key crowdsourcing models and their methodological treatments, from classical statistical models to recent deep learning-based approaches.
In particular, this article reviews the connections between signal processing (SP) theory and methods, such as identifiability of tensor and nonnegative matrix factorization.
arXiv Detail & Related papers (2024-07-09T14:34:40Z) - Multi-task Learning for Radar Signal Characterisation [48.265859815346985]
This paper presents an approach for tackling radar signal classification and characterisation as a multi-task learning (MTL) problem.
We propose the IQ Signal Transformer (IQST) among several reference architectures that allow for simultaneous optimisation of multiple regression and classification tasks.
We demonstrate the performance of our proposed MTL model on a synthetic radar dataset, while also providing a first-of-its-kind benchmark for radar signal characterisation.
arXiv Detail & Related papers (2023-06-19T12:01:28Z) - Investigating Deep Learning Benchmarks for Electrocardiography Signal
Processing [0.0]
We propose texttttorch_ecg, which gathers a large number of neural networks, both from literature and novel, for various ECG processing tasks.
It establishes a convenient and modular way for automatic building and flexible scaling of the networks, as well as a neat and uniform way of organizing the preprocessing procedures and augmentation techniques.
arXiv Detail & Related papers (2022-04-09T08:05:06Z) - Deep Equilibrium Assisted Block Sparse Coding of Inter-dependent
Signals: Application to Hyperspectral Imaging [71.57324258813675]
A dataset of inter-dependent signals is defined as a matrix whose columns demonstrate strong dependencies.
A neural network is employed to act as structure prior and reveal the underlying signal interdependencies.
Deep unrolling and Deep equilibrium based algorithms are developed, forming highly interpretable and concise deep-learning-based architectures.
arXiv Detail & Related papers (2022-03-29T21:00:39Z) - Signal Transformer: Complex-valued Attention and Meta-Learning for
Signal Recognition [33.178794056273304]
We propose a Complex-valued Attentional MEta Learner (CAMEL) for the problem few of general nonvalued problems with theoretical convergence guarantees.
This paper shows the superiority of the proposed data recognition experiments when the state is abundant small data.
arXiv Detail & Related papers (2021-06-05T03:57:41Z) - Signal Processing and Machine Learning Techniques for Terahertz Sensing:
An Overview [89.09270073549182]
Terahertz (THz) signal generation and radiation methods are shaping the future of wireless systems.
THz-specific signal processing techniques should complement this re-surged interest in THz sensing for efficient utilization of the THz band.
We present an overview of these techniques, with an emphasis on signal pre-processing.
We also address the effectiveness of deep learning techniques by exploring their promising sensing capabilities at the THz band.
arXiv Detail & Related papers (2021-04-09T01:38:34Z) - Federated Learning: A Signal Processing Perspective [144.63726413692876]
Federated learning is an emerging machine learning paradigm for training models across multiple edge devices holding local datasets, without explicitly exchanging the data.
This article provides a unified systematic framework for federated learning in a manner that encapsulates and highlights the main challenges that are natural to treat using signal processing tools.
arXiv Detail & Related papers (2021-03-31T15:14:39Z) - A Comprehensive Survey of Machine Learning Based Localization with
Wireless Signals [42.89359907212791]
This paper provides a comprehensive survey of Machine Learning-based localization solutions that use RF signals.
A main point of the paper is the interaction between the domain knowledge arising from the physics of localization systems, and the various ML approaches.
A detailed discussion is dedicated to the different ML methods that have been applied to localization problems.
arXiv Detail & Related papers (2020-12-21T08:10:46Z) - Wireless for Machine Learning [91.13476340719087]
We give an exhaustive review of the state-of-the-art wireless methods that are specifically designed to support machine learning services over distributed datasets.
There are two clear themes within the literature, analog over-the-air computation and digital radio resource management optimized for ML.
This survey gives a comprehensive introduction to these methods, reviews the most important works, highlights open problems, and discusses application scenarios.
arXiv Detail & Related papers (2020-08-31T11:09:49Z) - Multilinear Compressive Learning with Prior Knowledge [106.12874293597754]
Multilinear Compressive Learning (MCL) framework combines Multilinear Compressive Sensing and Machine Learning into an end-to-end system.
Key idea behind MCL is the assumption of the existence of a tensor subspace which can capture the essential features from the signal for the downstream learning task.
In this paper, we propose a novel solution to address both of the aforementioned requirements, i.e., How to find those tensor subspaces in which the signals of interest are highly separable?
arXiv Detail & Related papers (2020-02-17T19:06:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.