One-Bit Compressive Sensing: Can We Go Deep and Blind?
- URL: http://arxiv.org/abs/2203.11278v1
- Date: Sun, 13 Mar 2022 16:06:56 GMT
- Title: One-Bit Compressive Sensing: Can We Go Deep and Blind?
- Authors: Yiming Zeng, Shahin Khobahi, Mojtaba Soltanalian
- Abstract summary: One-bit compressive sensing is concerned with the accurate recovery of an underlying sparse signal of interest from one-bit noisy measurements.
We present a novel data-driven and model-based methodology that achieves blind recovery.
- Score: 15.231885712212083
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: One-bit compressive sensing is concerned with the accurate recovery of an
underlying sparse signal of interest from its one-bit noisy measurements. The
conventional signal recovery approaches for this problem are mainly developed
based on the assumption that an exact knowledge of the sensing matrix is
available. In this work, however, we present a novel data-driven and
model-based methodology that achieves blind recovery; i.e., signal recovery
without requiring the knowledge of the sensing matrix. To this end, we make use
of the deep unfolding technique and develop a model-driven deep neural
architecture which is designed for this specific task. The proposed deep
architecture is able to learn an alternative sensing matrix by taking advantage
of the underlying unfolded algorithm such that the resulting learned recovery
algorithm can accurately and quickly (in terms of the number of iterations)
recover the underlying compressed signal of interest from its one-bit noisy
measurements. In addition, due to the incorporation of the domain knowledge and
the mathematical model of the system into the proposed deep architecture, the
resulting network benefits from enhanced interpretability, has a very small
number of trainable parameters, and requires very small number of training
samples, as compared to the commonly used black-box deep neural network
alternatives for the problem at hand.
Related papers
- Deep Neural Network-assisted improvement of quantum compressed sensing tomography [0.0]
We propose a Deep Neural Network-based post-processing to improve the initial reconstruction provided by compressed sensing.
The idea is to treat the estimated state as a noisy input for the network and perform a deep-supervised denoising task.
We demonstrate through numerical experiments the improvement obtained by the denoising process and exploit the possibility of looping the inference scheme.
arXiv Detail & Related papers (2024-05-16T12:41:25Z) - Neuromorphic Auditory Perception by Neural Spiketrum [27.871072042280712]
We introduce a neural spike coding model called spiketrumtemporal, to transform the time-varying analog signals into efficient spike patterns.
The model provides a sparse and efficient coding scheme with precisely controllable spike rate that facilitates training of spiking neural networks in various auditory perception tasks.
arXiv Detail & Related papers (2023-09-11T13:06:19Z) - On Optimizing Back-Substitution Methods for Neural Network Verification [1.4394939014120451]
We present an approach for making back-substitution produce tighter bounds.
Our technique is general, in the sense that it can be integrated into numerous existing symbolic-bound propagation techniques.
arXiv Detail & Related papers (2022-08-16T11:16:44Z) - Ultrasound Signal Processing: From Models to Deep Learning [64.56774869055826]
Medical ultrasound imaging relies heavily on high-quality signal processing to provide reliable and interpretable image reconstructions.
Deep learning based methods, which are optimized in a data-driven fashion, have gained popularity.
A relatively new paradigm combines the power of the two: leveraging data-driven deep learning, as well as exploiting domain knowledge.
arXiv Detail & Related papers (2022-04-09T13:04:36Z) - Robust lEarned Shrinkage-Thresholding (REST): Robust unrolling for
sparse recover [87.28082715343896]
We consider deep neural networks for solving inverse problems that are robust to forward model mis-specifications.
We design a new robust deep neural network architecture by applying algorithm unfolding techniques to a robust version of the underlying recovery problem.
The proposed REST network is shown to outperform state-of-the-art model-based and data-driven algorithms in both compressive sensing and radar imaging problems.
arXiv Detail & Related papers (2021-10-20T06:15:45Z) - SignalNet: A Low Resolution Sinusoid Decomposition and Estimation
Network [79.04274563889548]
We propose SignalNet, a neural network architecture that detects the number of sinusoids and estimates their parameters from quantized in-phase and quadrature samples.
We introduce a worst-case learning threshold for comparing the results of our network relative to the underlying data distributions.
In simulation, we find that our algorithm is always able to surpass the threshold for three-bit data but often cannot exceed the threshold for one-bit data.
arXiv Detail & Related papers (2021-06-10T04:21:20Z) - A neural anisotropic view of underspecification in deep learning [60.119023683371736]
We show that the way neural networks handle the underspecification of problems is highly dependent on the data representation.
Our results highlight that understanding the architectural inductive bias in deep learning is fundamental to address the fairness, robustness, and generalization of these systems.
arXiv Detail & Related papers (2021-04-29T14:31:09Z) - An error-propagation spiking neural network compatible with neuromorphic
processors [2.432141667343098]
We present a spike-based learning method that approximates back-propagation using local weight update mechanisms.
We introduce a network architecture that enables synaptic weight update mechanisms to back-propagate error signals.
This work represents a first step towards the design of ultra-low power mixed-signal neuromorphic processing systems.
arXiv Detail & Related papers (2021-04-12T07:21:08Z) - LoRD-Net: Unfolded Deep Detection Network with Low-Resolution Receivers [104.01415343139901]
We propose a deep detector entitled LoRD-Net for recovering information symbols from one-bit measurements.
LoRD-Net has a task-based architecture dedicated to recovering the underlying signal of interest.
We evaluate the proposed receiver architecture for one-bit signal recovery in wireless communications.
arXiv Detail & Related papers (2021-02-05T04:26:05Z) - Supervised Learning with First-to-Spike Decoding in Multilayer Spiking
Neural Networks [0.0]
We propose a new supervised learning method that can train multilayer spiking neural networks to solve classification problems.
The proposed learning rule supports multiple spikes fired by hidden neurons, and yet is stable by relying on firstspike responses generated by a deterministic output layer.
We also explore several distinct spike-based encoding strategies in order to form compact representations of input data.
arXiv Detail & Related papers (2020-08-16T15:34:48Z) - Rectified Linear Postsynaptic Potential Function for Backpropagation in
Deep Spiking Neural Networks [55.0627904986664]
Spiking Neural Networks (SNNs) usetemporal spike patterns to represent and transmit information, which is not only biologically realistic but also suitable for ultra-low-power event-driven neuromorphic implementation.
This paper investigates the contribution of spike timing dynamics to information encoding, synaptic plasticity and decision making, providing a new perspective to design of future DeepSNNs and neuromorphic hardware systems.
arXiv Detail & Related papers (2020-03-26T11:13:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.