Influence of Depth Camera Noise Models on Respiration Estimation

• URL: http://arxiv.org/abs/2411.10081v1
• Date: Fri, 15 Nov 2024 09:50:31 GMT
• Title: Influence of Depth Camera Noise Models on Respiration Estimation
• Authors: Maurice Rohr, Sebastian Dill,
• Abstract summary: We show first results of a 3D-rendering simulation pipeline that focuses on different noise models in order to generate realistic, depth-camera based respiratory signals.
• Score: 0.0
• License:
• Abstract: Depth cameras are an interesting modality for capturing vital signs such as respiratory rate. Plenty approaches exist to extract vital signs in a controlled setting, but in order to apply them more flexibly for example in multi-camera settings, a simulated environment is needed to generate enough data for training and testing of new algorithms. We show first results of a 3D-rendering simulation pipeline that focuses on different noise models in order to generate realistic, depth-camera based respiratory signals using both synthetic and real respiratory signals as a baseline. While most noise can be accurately modelled as Gaussian in this context, we can show that as soon as the available image resolution is too low, the differences between different noise models surface.

Related papers

• Enhancement of 3D Camera Synthetic Training Data with Noise Models [1.6385815610837167]
  The goal of this paper is to assess the impact of noise in 3D camera-captured data by modeling the noise of the imaging process. We compiled a dataset of specifically constructed scenes to obtain a noise model. We specifically model lateral noise, affecting the position of captured points in the image plane, and axial noise, affecting the position along the axis to the image plane.
  arXiv  Detail & Related papers  (2024-02-26T11:50:42Z)
• Blue noise for diffusion models [50.99852321110366]
  We introduce a novel and general class of diffusion models taking correlated noise within and across images into account. Our framework allows introducing correlation across images within a single mini-batch to improve gradient flow. We perform both qualitative and quantitative evaluations on a variety of datasets using our method.
  arXiv  Detail & Related papers  (2024-02-07T14:59:25Z)
• NM-FlowGAN: Modeling sRGB Noise without Paired Images using a Hybrid Approach of Normalizing Flows and GAN [9.81778202920426]
  NM-FlowGAN is a hybrid approach that exploits the strengths of both GAN and Normalizing Flows. Our method synthesizes noise using clean images and factors that affect noise characteristics, such as easily obtainable parameters like camera type and ISO settings. In our experiments, our NM-FlowGAN outperforms other baselines in the sRGB noise synthesis task.
  arXiv  Detail & Related papers  (2023-12-15T09:09:25Z)
• Towards General Low-Light Raw Noise Synthesis and Modeling [37.87312467017369]
  We introduce a new perspective to synthesize the signal-independent noise by a generative model. Specifically, we synthesize the signal-dependent and signal-independent noise in a physics- and learning-based manner. In this way, our method can be considered as a general model, that is, it can simultaneously learn different noise characteristics for different ISO levels.
  arXiv  Detail & Related papers  (2023-07-31T09:10:10Z)
• Realistic Noise Synthesis with Diffusion Models [68.48859665320828]
  Deep image denoising models often rely on large amount of training data for the high quality performance. We propose a novel method that synthesizes realistic noise using diffusion models, namely Realistic Noise Synthesize Diffusor (RNSD) RNSD can incorporate guided multiscale content, such as more realistic noise with spatial correlations can be generated at multiple frequencies.
  arXiv  Detail & Related papers  (2023-05-23T12:56:01Z)
• Noise2NoiseFlow: Realistic Camera Noise Modeling without Clean Images [35.29066692454865]
  This paper proposes a framework for training a noise model and a denoiser simultaneously. It relies on pairs of noisy images rather than noisy/clean paired image data. The trained denoiser is shown to significantly improve upon both supervised and weakly supervised baseline denoising approaches.
  arXiv  Detail & Related papers  (2022-06-02T15:31:40Z)
• Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Training [50.018580462619425]
  We propose a novel framework, namely Pixel-level Noise-aware Generative Adrial Network (PNGAN) PNGAN employs a pre-trained real denoiser to map the fake and real noisy images into a nearly noise-free solution space. For better noise fitting, we present an efficient architecture Simple Multi-versa-scale Network (SMNet) as the generator.
  arXiv  Detail & Related papers  (2022-04-06T14:09:02Z)
• Estimating Fine-Grained Noise Model via Contrastive Learning [11.626812663592416]
  We propose an innovative noise model estimation and noise synthesis pipeline for realistic noisy image generation. Our model learns a noise estimation model with fine-grained statistical noise model in a contrastive manner. By calibrating noise models of several sensors, our model can be extended to predict other cameras.
  arXiv  Detail & Related papers  (2022-04-03T02:35:01Z)
• Rethinking Noise Synthesis and Modeling in Raw Denoising [75.55136662685341]
  We introduce a new perspective to synthesize noise by directly sampling from the sensor's real noise. It inherently generates accurate raw image noise for different camera sensors.
  arXiv  Detail & Related papers  (2021-10-10T10:45:24Z)
• Physics-based Noise Modeling for Extreme Low-light Photography [63.65570751728917]
  We study the noise statistics in the imaging pipeline of CMOS photosensors. We formulate a comprehensive noise model that can accurately characterize the real noise structures. Our noise model can be used to synthesize realistic training data for learning-based low-light denoising algorithms.
  arXiv  Detail & Related papers  (2021-08-04T16:36:29Z)
• Designing a Practical Degradation Model for Deep Blind Image Super-Resolution [134.9023380383406]
  Single image super-resolution (SISR) methods would not perform well if the assumed degradation model deviates from those in real images. This paper proposes to design a more complex but practical degradation model that consists of randomly shuffled blur, downsampling and noise degradations.
  arXiv  Detail & Related papers  (2021-03-25T17:40:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.