PDO-e$\text{S}^\text{2}$CNNs: Partial Differential Operator Based Equivariant Spherical CNNs

• URL: http://arxiv.org/abs/2104.03584v1
• Date: Thu, 8 Apr 2021 07:54:50 GMT
• Title: PDO-e$\text{S}^\text{2}$CNNs: Partial Differential Operator Based Equivariant Spherical CNNs
• Authors: Zhengyang Shen, Tiancheng Shen, Zhouchen Lin, Jinwen Ma
• Abstract summary: We use partial differential operators to design a spherical equivariant CNN, PDO-e$textStext2$CNN, which is exactly rotation equivariant in the continuous domain. In experiments, PDO-e$textStext2$CNNs show greater parameter efficiency and outperform other spherical CNNs significantly on several tasks.
• Score: 77.53203546732664
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Spherical signals exist in many applications, e.g., planetary data, LiDAR scans and digitalization of 3D objects, calling for models that can process spherical data effectively. It does not perform well when simply projecting spherical data into the 2D plane and then using planar convolution neural networks (CNNs), because of the distortion from projection and ineffective translation equivariance. Actually, good principles of designing spherical CNNs are avoiding distortions and converting the shift equivariance property in planar CNNs to rotation equivariance in the spherical domain. In this work, we use partial differential operators (PDOs) to design a spherical equivariant CNN, PDO-e$\text{S}^\text{2}$CNN, which is exactly rotation equivariant in the continuous domain. We then discretize PDO-e$\text{S}^\text{2}$CNNs, and analyze the equivariance error resulted from discretization. This is the first time that the equivariance error is theoretically analyzed in the spherical domain. In experiments, PDO-e$\text{S}^\text{2}$CNNs show greater parameter efficiency and outperform other spherical CNNs significantly on several tasks.

Related papers

• The Lie Derivative for Measuring Learned Equivariance [84.29366874540217]
  We study the equivariance properties of hundreds of pretrained models, spanning CNNs, transformers, and Mixer architectures. We find that many violations of equivariance can be linked to spatial aliasing in ubiquitous network layers, such as pointwise non-linearities. For example, transformers can be more equivariant than convolutional neural networks after training.
  arXiv  Detail & Related papers  (2022-10-06T15:20:55Z)
• Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutions [5.8808473430456525]
  No existing spherical convolutional neural network (CNN) framework is both computationally scalable and rotationally equivariant. We develop a hybrid discrete-continuous (DISCO) group convolution that is simultaneously equivariant and computationally to high-resolution. For 4k spherical images we realize a saving of $109$ in computational cost and $104$ in memory usage when compared to the most efficient alternative equivariant spherical convolution.
  arXiv  Detail & Related papers  (2022-09-27T18:00:01Z)
• PDO-s3DCNNs: Partial Differential Operator Based Steerable 3D CNNs [69.85869748832127]
  In this work, we employ partial differential operators (PDOs) to model 3D filters, and derive general steerable 3D CNNs called PDO-s3DCNNs. We prove that the equivariant filters are subject to linear constraints, which can be solved efficiently under various conditions.
  arXiv  Detail & Related papers  (2022-08-07T13:37:29Z)
• Learning Equivariant Representations [10.745691354609738]
  Convolutional neural networks (CNNs) are successful examples of this principle. We propose equivariant models for different transformations defined by groups of symmetries. These models leverage symmetries in the data to reduce sample and model complexity and improve generalization performance.
  arXiv  Detail & Related papers  (2020-12-04T18:46:17Z)
• Spherical Convolutional Neural Networks: Stability to Perturbations in SO(3) [175.96910854433574]
  Spherical convolutional neural networks (Spherical CNNs) learn nonlinear representations from 3D data by exploiting the data structure. This paper investigates the properties that Spherical CNNs exhibit as they pertain to the rotational structure inherent in spherical signals.
  arXiv  Detail & Related papers  (2020-10-12T17:16:07Z)
• Efficient Generalized Spherical CNNs [7.819876182082904]
  We present a generalized spherical CNN framework that encompasses various existing approaches and allows them to be leveraged alongside each other. We show that these developments allow the construction of more expressive hybrid models that achieve state-of-the-art accuracy and parameter efficiency on spherical benchmark problems.
  arXiv  Detail & Related papers  (2020-10-09T18:00:05Z)
• PDO-eConvs: Partial Differential Operator Based Equivariant Convolutions [71.60219086238254]
  We deal with the issue from the connection between convolutions and partial differential operators (PDOs) In implementation, we discretize the system using the numerical schemes of PDOs, deriving approximately equivariant convolutions (PDO-eConvs) Experiments on rotated MNIST and natural image classification show that PDO-eConvs perform competitively yet use parameters much more efficiently.
  arXiv  Detail & Related papers  (2020-07-20T18:57:26Z)
• Spin-Weighted Spherical CNNs [58.013031812072356]
  We present a new type of spherical CNN that allows anisotropic filters in an efficient way, without ever leaving the sphere domain. The key idea is to consider spin-weighted spherical functions, which were introduced in physics in the study of gravitational waves. Our method outperforms previous methods on tasks like classification of spherical images, classification of 3D shapes and semantic segmentation of spherical panoramas.
  arXiv  Detail & Related papers  (2020-06-18T17:57:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.