Reflection and Rotation Symmetry Detection via Equivariant Learning

• URL: http://arxiv.org/abs/2203.16787v1
• Date: Thu, 31 Mar 2022 04:18:33 GMT
• Title: Reflection and Rotation Symmetry Detection via Equivariant Learning
• Authors: Ahyun Seo, Byungjin Kim, Suha Kwak, Minsu Cho
• Abstract summary: We introduce a group-equivariant convolutional network for symmetry detection, dubbed EquiSym. We present a new dataset, DENse and DIverse symmetry (DENDI), which mitigates limitations of existing benchmarks for reflection and rotation symmetry detection. Experiments show that our method achieves the state of the arts in symmetry detection on LDRS and DENDI datasets.
• Score: 40.61825212385055
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The inherent challenge of detecting symmetries stems from arbitrary orientations of symmetry patterns; a reflection symmetry mirrors itself against an axis with a specific orientation while a rotation symmetry matches its rotated copy with a specific orientation. Discovering such symmetry patterns from an image thus benefits from an equivariant feature representation, which varies consistently with reflection and rotation of the image. In this work, we introduce a group-equivariant convolutional network for symmetry detection, dubbed EquiSym, which leverages equivariant feature maps with respect to a dihedral group of reflection and rotation. The proposed network is built end-to-end with dihedrally-equivariant layers and trained to output a spatial map for reflection axes or rotation centers. We also present a new dataset, DENse and DIverse symmetry (DENDI), which mitigates limitations of existing benchmarks for reflection and rotation symmetry detection. Experiments show that our method achieves the state of the arts in symmetry detection on LDRS and DENDI datasets.

Related papers

• SBDet: A Symmetry-Breaking Object Detector via Relaxed Rotation-Equivariance [26.05910177212846]
  Group Equivariant Convolution (GConv) empowers models to explore symmetries hidden in visual data, improving their performance. Traditional GConv methods are limited by the strict operation rules in the group space, making it difficult to adapt to Symmetry-Breaking or non-rigid transformations. We propose a novel Relaxed Rotation-Equivariant Network (R2Net) as the backbone and further develop the Symmetry-Breaking Object Detector (SBDet) for 2D object detection built upon it.
  arXiv  Detail & Related papers  (2024-08-21T16:32:03Z)
• Partial Symmetry Detection for 3D Geometry using Contrastive Learning with Geodesic Point Cloud Patches [10.48309709793733]
  We propose to learn rotation, reflection, translation and scale invariant local shape features for geodesic point cloud patches. We show that our approach is able to extract multiple valid solutions for this ambiguous problem. We incorporate the detected symmetries together with a region growing algorithm to demonstrate a downstream task.
  arXiv  Detail & Related papers  (2023-12-13T15:48:50Z)
• Symmetry Induces Structure and Constraint of Learning [0.0]
  We unveil the importance of the loss function symmetries in affecting, if not deciding, the learning behavior of machine learning models. Common instances of mirror symmetries in deep learning include rescaling, rotation, and permutation symmetry. We show that the theoretical framework can explain intriguing phenomena, such as the loss of plasticity and various collapse phenomena in neural networks.
  arXiv  Detail & Related papers  (2023-09-29T02:21:31Z)
• Oracle-Preserving Latent Flows [58.720142291102135]
  We develop a methodology for the simultaneous discovery of multiple nontrivial continuous symmetries across an entire labelled dataset. The symmetry transformations and the corresponding generators are modeled with fully connected neural networks trained with a specially constructed loss function. The two new elements in this work are the use of a reduced-dimensionality latent space and the generalization to transformations invariant with respect to high-dimensional oracles.
  arXiv  Detail & Related papers  (2023-02-02T00:13:32Z)
• Deep Learning Symmetries and Their Lie Groups, Algebras, and Subalgebras from First Principles [55.41644538483948]
  We design a deep-learning algorithm for the discovery and identification of the continuous group of symmetries present in a labeled dataset. We use fully connected neural networks to model the transformations symmetry and the corresponding generators. Our study also opens the door for using a machine learning approach in the mathematical study of Lie groups and their properties.
  arXiv  Detail & Related papers  (2023-01-13T16:25:25Z)
• Symmetry-Aware Transformer-based Mirror Detection [85.47570468668955]
  We propose a dual-path Symmetry-Aware Transformer-based mirror detection Network (SATNet) SATNet includes two novel modules: Symmetry-Aware Attention Module (SAAM) and Contrast and Fusion Decoder Module (CFDM) Experimental results show that SATNet outperforms both RGB and RGB-D mirror detection methods on all available mirror detection datasets.
  arXiv  Detail & Related papers  (2022-07-13T16:40:01Z)
• Using Machine Learning to Detect Rotational Symmetries from Reflectional Symmetries in 2D Images [0.0]
  This paper focuses on aiding the latter by comparing different state-of-the-art automated symmetry detection algorithms. We propose post-processing improvements to find localised symmetries in images, improve the selection of detected symmetries and identify another symmetry type (rotational) We demonstrate and analyze the performance of the extended algorithm to detect localised symmetries and the machine learning model to classify rotational symmetries.
  arXiv  Detail & Related papers  (2022-01-17T19:14:58Z)
• Learning to Discover Reflection Symmetry via Polar Matching Convolution [33.77926792753373]
  We introduce a new convolutional technique, dubbed the polar matching convolution, which leverages a polar feature pooling, a self-similarity encoding, and a kernel design for axes of different angles. The proposed high-dimensional kernel convolution network effectively learns to discover symmetry patterns from real-world images. Experiments demonstrate that our method outperforms state-of-the-art methods in terms of accuracy and robustness.
  arXiv  Detail & Related papers  (2021-08-30T01:50:51Z)
• On Learning Sets of Symmetric Elements [63.12061960528641]
  This paper presents a principled approach to learning sets of general symmetric elements. We first characterize the space of linear layers that are equivariant both to element reordering and to the inherent symmetries of elements. We further show that networks that are composed of these layers, called Deep Sets for Symmetric Elements (DSS) layers, are universal approximators of both invariant and equivariant functions.
  arXiv  Detail & Related papers  (2020-02-20T07:29:20Z)
• Structured GANs [91.3755431537592]
  symmetric GANs are applied to face image synthesis in order to generate novel faces with a varying amount of symmetry. We also present an unsupervised face rotation capability, which is based on the novel notion of one-shot fine tuning.
  arXiv  Detail & Related papers  (2020-01-15T10:25:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.