SRE-CNN: A Spatiotemporal Rotation-Equivariant CNN for Cardiac Cine MR Imaging
- URL: http://arxiv.org/abs/2409.08537v1
- Date: Fri, 13 Sep 2024 04:54:34 GMT
- Title: SRE-CNN: A Spatiotemporal Rotation-Equivariant CNN for Cardiac Cine MR Imaging
- Abstract summary: We propose a novel framework of Stemporal Rotation-Equivariant CNN (SRE-CNN)
The temporal-variant convolutional module enables exploitation the rotation symmetries in both spatial and temporal dimensions.
Experiments conducted on highly rotated dynamic cardiac cine data (up to 20X) have demonstrated the superior performance of our proposed approach.
- Score: 8.183902009412718
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Dynamic MR images possess various transformation symmetries,including the rotation symmetry of local features within the image and along the temporal dimension. Utilizing these symmetries as prior knowledge can facilitate dynamic MR imaging with high spatiotemporal resolution. Equivariant CNN is an effective tool to leverage the symmetry priors. However, current equivariant CNN methods fail to fully exploit these symmetry priors in dynamic MR imaging. In this work, we propose a novel framework of Spatiotemporal Rotation-Equivariant CNN (SRE-CNN), spanning from the underlying high-precision filter design to the construction of the temporal-equivariant convolutional module and imaging model, to fully harness the rotation symmetries inherent in dynamic MR images. The temporal-equivariant convolutional module enables exploitation the rotation symmetries in both spatial and temporal dimensions, while the high-precision convolutional filter, based on parametrization strategy, enhances the utilization of rotation symmetry of local features to improve the reconstruction of detailed anatomical structures. Experiments conducted on highly undersampled dynamic cardiac cine data (up to 20X) have demonstrated the superior performance of our proposed approach, both quantitatively and qualitatively.
Related papers
- Physics-Informed Implicit Neural Representations for Improved Myocardial Perfusion MRI Quantification [1.2835484274728046]
Physics-informed neural networks (PINNs) have been proposed as an alternative to conventional non-linear least squares fitting methods.<n>In this work, we extend the previously proposed PINN framework with implicit neural representations (INRs) to represent the MR signal as a continuoustemporal function.<n>Our proposed PINN with INRs demonstrates improved robustness and parameter estimation accuracy over the previously established methods.
arXiv Detail & Related papers (2026-08-11T11:25:22Z) - ARD-REFSM: Enhancing Reflection Symmetry Detection with Asymmetric Denoising and Rotation Equivariance [7.075059146104427]
Reflection symmetry detection remains challenging due to asymmetric regions and arbitrary orientations of symmetric patterns.<n>We propose an Asymmetric Region Denoising (ARD) module and a Rotation Equivariant Feature Similarity Matching (REFSM) module.<n>We introduce GMSYM, a new benchmark dataset that categorizes images into diverse scenarios and incorporates various interferences to address the limitations of existing reflection symmetry detection benchmarks.
arXiv Detail & Related papers (2026-07-30T09:40:10Z) - Symmetry-Reduced Physics-Informed Learning of Tensegrity Dynamics [33.52984112921709]
Most existing physics-informed neural network (PINN) approaches for tensegrity dynamics do not explicitly exploit intrinsic geometric symmetries.<n>We propose a symmetry-reduced physics-informed neural network (SymPINN) framework that embeds group-theory-based symmetry directly into both the solution expression and the neural network architecture.
arXiv Detail & Related papers (2026-03-18T15:23:23Z) - Flow-Guided Implicit Neural Representation for Motion-Aware Dynamic MRI Reconstruction [19.66198868468091]
Dynamic magnetic resonance imaging (dMRI) captures anatomy temporally-resolved but is often challenged by limited sampling and motion-induced artifacts.<n>In this work, we propose a novel implicit neural representation framework that jointly models both the dynamic image sequence and its underlying motion field.<n> Experiments on dynamic cardiac MRI datasets demonstrate that the method outperforms state-of-the-art motion-inspired and deep learning approaches.
arXiv Detail & Related papers (2025-11-21T04:51:23Z) - HAD: Hierarchical Asymmetric Distillation to Bridge Spatio-Temporal Gaps in Event-Based Object Tracking [80.07224739976911]
Event cameras offer exceptional temporal resolution and a range (modal)<n> RGB cameras excel at capturing rich texture with high resolution, whereas event cameras offer exceptional temporal resolution and a range (modal)
arXiv Detail & Related papers (2025-10-22T13:15:13Z) - Rotation Equivariant Arbitrary-scale Image Super-Resolution [62.41329042683779]
The arbitrary-scale image super-resolution (ASISR) aims to achieve arbitrary-scale high-resolution recoveries from a low-resolution input image.<n>We make efforts to construct a rotation equivariant ASISR method in this study.
arXiv Detail & Related papers (2025-08-07T08:51:03Z) - DUN-SRE: Deep Unrolling Network with Spatiotemporal Rotation Equivariance for Dynamic MRI Reconstruction [18.919056394229976]
Explicit incorporation of symmetry priors in the reconstruction model can significantly improve image quality.<n>Recent Equivariant convolutional neural network (ECNN) has shown great promise in exploiting spatial symmetry priors.<n>DUN-SRE establishes equitemporal rotation through a (2+1)D convolutional architecture.
arXiv Detail & Related papers (2025-06-12T02:44:27Z) - Fast Omni-Directional Image Super-Resolution: Adapting the Implicit Image Function with Pixel and Semantic-Wise Spherical Geometric Priors [38.580815475638595]
This paper proposes a new ODI-SR model characterized by its capacity to perform Fast and Arbitrary-scale ODI-SR processes.
The proposed FAOR outperforms the state-of-the-art ODI-SR models with a much faster inference speed.
arXiv Detail & Related papers (2025-02-09T13:37:50Z) - Optimal Equivariant Architectures from the Symmetries of Matrix-Element Likelihoods [0.0]
Matrix-Element Method (MEM) has long been a cornerstone of data analysis in high-energy physics.
geometric deep learning has enabled neural network architectures that incorporate known symmetries directly into their design.
This paper presents a novel approach that combines MEM-inspired symmetry considerations with equivariant neural network design for particle physics analysis.
arXiv Detail & Related papers (2024-10-24T08:56:37Z) - Empowering Snapshot Compressive Imaging: Spatial-Spectral State Space Model with Across-Scanning and Local Enhancement [51.557804095896174]
We introduce a State Space Model with Across-Scanning and Local Enhancement, named ASLE-SSM, that employs a Spatial-Spectral SSM for global-local balanced context encoding and cross-channel interaction promoting.
Experimental results illustrate ASLE-SSM's superiority over existing state-of-the-art methods, with an inference speed 2.4 times faster than Transformer-based MST and saving 0.12 (M) of parameters.
arXiv Detail & Related papers (2024-08-01T15:14:10Z) - Enhancing Dynamic CT Image Reconstruction with Neural Fields and Optical Flow [0.0]
We show the benefits of introducing explicit motion regularizers for dynamic inverse problems based on partial differential equations.
We also compare neural fields against a grid-based solver and show that the former outperforms the latter in terms of PSNR.
arXiv Detail & Related papers (2024-06-03T13:07:29Z) - Vision-Informed Flow Image Super-Resolution with Quaternion Spatial
Modeling and Dynamic Flow Convolution [49.45309818782329]
Flow image super-resolution (FISR) aims at recovering high-resolution turbulent velocity fields from low-resolution flow images.
Existing FISR methods mainly process the flow images in natural image patterns.
We propose the first flow visual property-informed FISR algorithm.
arXiv Detail & Related papers (2024-01-29T06:48:16Z) - Robust Depth Linear Error Decomposition with Double Total Variation and
Nuclear Norm for Dynamic MRI Reconstruction [15.444386058967579]
There are still problems with dynamic MRI k-space reconstruction based on Compressed Sensing (CS)
In this paper, we propose a novel robust lowrank dynamic MRI reconstruction optimization model via highly under-sampled Fourier Transform (DFT)
Experiments on dynamic MRI data demonstrate the superior performance proposed method in terms of both reconstruction accuracy and time complexity.
arXiv Detail & Related papers (2023-10-23T13:34:59Z) - SceNeRFlow: Time-Consistent Reconstruction of General Dynamic Scenes [75.9110646062442]
We propose SceNeRFlow to reconstruct a general, non-rigid scene in a time-consistent manner.
Our method takes multi-view RGB videos and background images from static cameras with known camera parameters as input.
We show experimentally that, unlike prior work that only handles small motion, our method enables the reconstruction of studio-scale motions.
arXiv Detail & Related papers (2023-08-16T09:50:35Z) - RED-PSM: Regularization by Denoising of Factorized Low Rank Models for Dynamic Imaging [6.527016551650136]
In dynamic tomography, only a single projection at a single view angle may be available at a time.
We propose an approach, RED-PSM, which combines for the first time two powerful techniques to address this challenging imaging problem.
arXiv Detail & Related papers (2023-04-07T05:29:59Z) - Moment evolution equations and moment matching for stochastic image
EPDiff [68.97335984455059]
Models of image deformation allow study of time-continuous effects transforming images by deforming the image domain.
Applications include medical image analysis with both population trends and random subject specific variation.
We use moment approximations of the corresponding Ito diffusion to construct estimators for statistical inference in the parameters full model.
arXiv Detail & Related papers (2021-10-07T11:08:11Z) - Dynamic Mode Decomposition in Adaptive Mesh Refinement and Coarsening
Simulations [58.720142291102135]
Dynamic Mode Decomposition (DMD) is a powerful data-driven method used to extract coherent schemes.
This paper proposes a strategy to enable DMD to extract from observations with different mesh topologies and dimensions.
arXiv Detail & Related papers (2021-04-28T22:14:25Z) - Adaptive Gradient Balancing for UndersampledMRI Reconstruction and
Image-to-Image Translation [60.663499381212425]
We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique.
In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
arXiv Detail & Related papers (2021-04-05T13:05:22Z) - Spatial-temporal switching estimators for imaging locally concentrated
dynamics [18.73097340265486]
A switching linear dynamic system (SLDS) is a natural model under which to pose such problems.
Because of the high parameter space dimensionality, efficient and accurate recovery of the underlying state is challenging.
This paper focuses on the common cases where the dynamic evolution may be adequately modeled as a collection of decoupled, locally concentrated dynamic operators.
arXiv Detail & Related papers (2021-02-19T21:36:47Z) - Temporal Spatial-Adaptive Interpolation with Deformable Refinement for
Electron Microscopic Images [10.26899472047613]
Existing electron microscopic (EM) images suffer from unstable image quality, low PSNR, and disorderly deformation.
We propose a novel framework for EM images that progressively synthesizes interpolated features in a coarse-to-fine manner.
Experimental results demonstrate the superior performance of our approach compared to previous works.
arXiv Detail & Related papers (2021-01-17T20:22:52Z) - Time-Reversal Symmetric ODE Network [138.02741983098454]
Time-reversal symmetry is a fundamental property that frequently holds in classical and quantum mechanics.
We propose a novel loss function that measures how well our ordinary differential equation (ODE) networks comply with this time-reversal symmetry.
We show that, even for systems that do not possess the full time-reversal symmetry, TRS-ODENs can achieve better predictive performances over baselines.
arXiv Detail & Related papers (2020-07-22T12:19:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.