Registering Image Volumes using 3D SIFT and Discrete SP-Symmetry

• URL: http://arxiv.org/abs/2205.15456v1
• Date: Mon, 30 May 2022 22:57:55 GMT
• Title: Registering Image Volumes using 3D SIFT and Discrete SP-Symmetry
• Abstract summary: A binary feature sign $s in -1,+1$ is defined as the sign of the Laplacian operator $nabla2$. A 3D parity transforms $(x,y,z)rightarrow(-x,-y,-z)$ transforms $(x,y,z)rightarrow(-x,-y,-z)$, i.e. SP-invariant or SP-symmetric.
• Score: 2.1829116024916844
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: This paper proposes to extend local image features in 3D to include invariance to discrete symmetry including inversion of spatial axes and image contrast. A binary feature sign $s \in \{-1,+1\}$ is defined as the sign of the Laplacian operator $\nabla^2$, and used to obtain a descriptor that is invariant to image sign inversion $s \rightarrow -s$ and 3D parity transforms $(x,y,z)\rightarrow(-x,-y,-z)$, i.e. SP-invariant or SP-symmetric. SP-symmetry applies to arbitrary scalar image fields $I: R^3 \rightarrow R^1$ mapping 3D coordinates $(x,y,z) \in R^3$ to scalar intensity $I(x,y,z) \in R^1$, generalizing the well-known charge conjugation and parity symmetry (CP-symmetry) applying to elementary charged particles. Feature orientation is modeled as a set of discrete states corresponding to potential axis reflections, independently of image contrast inversion. Two primary axis vectors are derived from image observations and potentially subject to reflection, and a third axis is an axial vector defined by the right-hand rule. Augmenting local feature properties with sign in addition to standard (location, scale, orientation) geometry leads to descriptors that are invariant to coordinate reflections and intensity contrast inversion. Feature properties are factored in to probabilistic point-based registration as symmetric kernels, based on a model of binary feature correspondence. Experiments using the well-known coherent point drift (CPD) algorithm demonstrate that SIFT-CPD kernels achieve the most accurate and rapid registration of the human brain and CT chest, including multiple MRI modalities of differing intensity contrast, and abnormal local variations such as tumors or occlusions. SIFT-CPD image registration is invariant to global scaling, rotation and translation and image intensity inversions of the input data.

Related papers

• $\ ext{GSF-}χ$: Global Stereochemical Fields for Chiral Graph Transformers [49.85093436361195]
  We introduce GSF-$$, a graph transformer in which stereogenic units modulate all pairwise interactions.<n>A $C$ projection separates mirror-even ECD peak counts and positions from mirror-odd peak signs.<n>GSF-$$ leads every central-ECD output and improves axial Rotation and Symbol by $12.6%$ and $7.9%$ over the strongest baseline.
  arXiv  Detail & Related papers  (2026-09-11T07:41:20Z)
• A Unified Framework for the Mechanics of Information in Convolutional Neural Network Image Space [0.8632722291552638]
  This paper introduces a unified mathematical framework for modeling information propagation through convolutional neural networks (CNNs)<n>A correspondence is presented linking discrete filter symmetry and the relativistic energy--momentum relation under the widely used nonlinear rectified convolution operation.
  arXiv  Detail & Related papers  (2026-08-26T19:46:00Z)
• E3DGS: Unified Geometric-Photometric Equivariance for 3D Gaussian Splatting via Color-as-Geometry Embedding [9.35652906982887]
  3D Gaussian Splatting (3DGS) captures scenes by coupling explicit geometry with view-dependent photometry (Spherical Harmonics)<n>Color has been treated as a signal rather than a geometric entity, making it nontrivial to unify symmetry across geometry and appearance as the camera frame changes.<n>We present E3DGS, a rigid-body ($mathrmSE(3)$)variant architecture that processes 3D Gaussians without Clebsch-Gordan tensor products.
  arXiv  Detail & Related papers  (2026-07-17T01:12:26Z)
• Rotation-Invariant Spherical Watermarking via Third-Order SO(3) Representation Coupling [28.45286547806906]
  Reliable watermarking of panoramic imagery is fundamentally challenged by arbitrary 3D rotations.<n>We formulate panoramas as spherical signals and leverage $SO(3)$ representation theory to derive provably rotation-invariant descriptors.
  arXiv  Detail & Related papers  (2026-05-26T08:43:40Z)
• Interpretable Machine Learning for Spatial Science: A Lie-Algebraic Kernel for Rotationally Anisotropic Gaussian Processes [0.0]
  Three-dimensional spatial fields are anisotropic, with directions of rapid and slow variation that need not align with coordinate axes.<n>Standard Gaussian process kernels with Automatic Relevance Determination (ARD) capture only axis-aligned anisotropy.<n>We introduce an interpretable rotationally anisotropic GP kernel that parameterises a three-dimensional SPD covariance metric.
  arXiv  Detail & Related papers  (2026-05-11T19:42:47Z)
• TIGaussian: Disentangle Gaussians for Spatial-Awared Text-Image-3D Alignment [58.46706158310462]
  TIGaussian harnesses 3D Gaussian Splatting (3DGS) characteristics to strengthen cross-modality alignment.<n>Our multi-branch 3DGS tokenizer decouples the intrinsic properties of 3DGS structures into compact latent representations.<n>A text-3D projection module adaptively maps 3D features to text embedding space for better text-3D alignment.
  arXiv  Detail & Related papers  (2026-01-27T06:30:32Z)
• Bounds on Lorentz-violating parameters in magnetically confined 2D systems: A phenomenological approach [0.0]
  We present a framework to constrain minimal SME coefficients $a_mu$ and $b_mu$ using magnetically confined two-dimensional electron systems.<n>Working in the nonrelativistic (Schr"odinger--Pauli) limit with effective mass, we derive the radial problem for cylindrical geometries.
  arXiv  Detail & Related papers  (2025-10-28T11:11:59Z)
• Moment kernels: a simple and scalable approach for equivariance to rotations and reflections in deep convolutional networks [0.0]
  We show that the same equivariance can be achieved using a simple form of convolution kernels.<n>We implement equivariant neural networks using standard convolution modules.
  arXiv  Detail & Related papers  (2025-05-27T20:27:00Z)
• RECON: Robust symmetry discovery via Explicit Canonical Orientation Normalization [29.869911304798553]
  We introduce RECON, a framework to discover each input's intrinsic symmetry distribution from unlabeled data.<n>We demonstrate effective symmetry discovery on 2D image benchmarks and -- for the first time -- extend it to 3D transformation groups.
  arXiv  Detail & Related papers  (2025-05-19T16:10:23Z)
• RSD-DOG : A New Image Descriptor based on Second Order Derivatives [2.174919458782602]
  This paper introduces the new and powerful image patch descriptor based on second order image statistics/derivatives. The considered 3D surface has a rich set of second order features/statistics such as ridges, valleys, cliffs and so on. The obtained descriptor shows a good discriminative power when dealing with the variations in illumination, scale, rotation, blur, viewpoint and compression.
  arXiv  Detail & Related papers  (2024-08-14T17:41:45Z)
• Transformers as Support Vector Machines [54.642793677472724]
  We establish a formal equivalence between the optimization geometry of self-attention and a hard-margin SVM problem. We characterize the implicit bias of 1-layer transformers optimized with gradient descent. We believe these findings inspire the interpretation of transformers as a hierarchy of SVMs that separates and selects optimal tokens.
  arXiv  Detail & Related papers  (2023-08-31T17:57:50Z)
• Deep Diversity-Enhanced Feature Representation of Hyperspectral Images [87.47202258194719]
  We rectify 3D convolution by modifying its topology to enhance the rank upper-bound. We also propose a novel diversity-aware regularization (DA-Reg) term that acts on the feature maps to maximize independence among elements. To demonstrate the superiority of the proposed Re$3$-ConvSet and DA-Reg, we apply them to various HS image processing and analysis tasks.
  arXiv  Detail & Related papers  (2023-01-15T16:19:18Z)
• Using Atom-Like Local Image Features to Study Human Genetics and Neuroanatomy in Large Sets of 3D Medical Image Volumes [0.0]
  The contributions of this thesis stem from technology developed to analyse large sets of volumetric images in terms of atom-like features extracted in 3D image space. New feature properties are introduced including a binary feature sign, analogous to an electrical charge, and a discrete set of symmetric feature orientation states in 3D space.
  arXiv  Detail & Related papers  (2022-08-25T22:27:39Z)
• Orthogonal Matrix Retrieval with Spatial Consensus for 3D Unknown-View Tomography [58.60249163402822]
  Unknown-view tomography (UVT) reconstructs a 3D density map from its 2D projections at unknown, random orientations. The proposed OMR is more robust and performs significantly better than the previous state-of-the-art OMR approach.
  arXiv  Detail & Related papers  (2022-07-06T21:40:59Z)
• Reflection and Rotation Symmetry Detection via Equivariant Learning [40.61825212385055]
  We introduce a group-equivariant convolutional network for symmetry detection, dubbed EquiSym. We present a new dataset, DENse and DIverse symmetry (DENDI), which mitigates limitations of existing benchmarks for reflection and rotation symmetry detection. Experiments show that our method achieves the state of the arts in symmetry detection on LDRS and DENDI datasets.
  arXiv  Detail & Related papers  (2022-03-31T04:18:33Z)
• Hybrid Model-based / Data-driven Graph Transform for Image Coding [54.31406300524195]
  We present a hybrid model-based / data-driven approach to encode an intra-prediction residual block. The first $K$ eigenvectors of a transform matrix are derived from a statistical model, e.g., the asymmetric discrete sine transform (ADST) for stability. Using WebP as a baseline image, experimental results show that our hybrid graph transform achieved better energy compaction than default discrete cosine transform (DCT) and better stability than KLT.
  arXiv  Detail & Related papers  (2022-03-02T15:36:44Z)
• Extreme Rotation Estimation using Dense Correlation Volumes [73.35119461422153]
  We present a technique for estimating the relative 3D rotation of an RGB image pair in an extreme setting. We observe that, even when images do not overlap, there may be rich hidden cues as to their geometric relationship. We propose a network design that can automatically learn such implicit cues by comparing all pairs of points between the two input images.
  arXiv  Detail & Related papers  (2021-04-28T02:00:04Z)
• Self-supervised Geometric Perception [96.89966337518854]
  Self-supervised geometric perception is a framework to learn a feature descriptor for correspondence matching without any ground-truth geometric model labels. We show that SGP achieves state-of-the-art performance that is on-par or superior to the supervised oracles trained using ground-truth labels.
  arXiv  Detail & Related papers  (2021-03-04T15:34:43Z)
• Learning Equivariant Representations [10.745691354609738]
  Convolutional neural networks (CNNs) are successful examples of this principle. We propose equivariant models for different transformations defined by groups of symmetries. These models leverage symmetries in the data to reduce sample and model complexity and improve generalization performance.
  arXiv  Detail & Related papers  (2020-12-04T18:46:17Z)
• SymmetryNet: Learning to Predict Reflectional and Rotational Symmetries of 3D Shapes from Single-View RGB-D Images [26.38270361331076]
  We propose an end-to-end deep neural network which is able to predict both reflectional and rotational symmetries of 3D objects. We also contribute a benchmark of 3D symmetry detection based on single-view RGB-D images.
  arXiv  Detail & Related papers  (2020-08-02T14:10:09Z)
• SU$(3)_1$ Chiral Spin Liquid on the Square Lattice: a View from Symmetric PEPS [55.41644538483948]
  Quantum spin liquids can be faithfully represented and efficiently characterized within the framework of Projectedangled Pair States (PEPS) Characteristic features are revealed by the entanglement spectrum (ES) on an infinitely long cylinder. Special features in the ES are shown to be in correspondence with bulk anyonic correlations, indicating a fine structure in the holographic bulk-edge correspondence.
  arXiv  Detail & Related papers  (2019-12-31T16:30:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.