Efficient Model-Agnostic Multi-Group Equivariant Networks

• URL: http://arxiv.org/abs/2310.09675v2
• Date: Mon, 07 Oct 2024 16:28:52 GMT
• Title: Efficient Model-Agnostic Multi-Group Equivariant Networks
• Authors: Razan Baltaji, Sourya Basu, Lav R. Varshney,
• Abstract summary: We provide efficient model-agnostic equivariant designs for two related problems. One is a network with multiple inputs each with potentially different groups acting on them, and another is a single input but the group acting on it is a large product group. We find equivariant models are robust to such transformations and perform competitively otherwise.
• Score: 18.986283562123713
• License:
• Abstract: Constructing model-agnostic group equivariant networks, such as equitune (Basu et al., 2023b) and its generalizations (Kim et al., 2023), can be computationally expensive for large product groups. We address this problem by providing efficient model-agnostic equivariant designs for two related problems: one where the network has multiple inputs each with potentially different groups acting on them, and another where there is a single input but the group acting on it is a large product group. For the first design, we initially consider a linear model and characterize the entire equivariant space that satisfies this constraint. This characterization gives rise to a novel fusion layer between different channels that satisfies an invariance-symmetry (IS) constraint, which we call an IS layer. We then extend this design beyond linear models, similar to equitune, consisting of equivariant and IS layers. We also show that the IS layer is a universal approximator of invariant-symmetric functions. Inspired by the first design, we use the notion of the IS property to design a second efficient model-agnostic equivariant design for large product groups acting on a single input. For the first design, we provide experiments on multi-image classification where each view is transformed independently with transformations such as rotations. We find equivariant models are robust to such transformations and perform competitively otherwise. For the second design, we consider three applications: language compositionality on the SCAN dataset to product groups; fairness in natural language generation from GPT-2 to address intersectionality; and robust zero-shot image classification with CLIP. Overall, our methods are simple and general, competitive with equitune and its variants, while also being computationally more efficient.

Related papers

• EKAN: Equivariant Kolmogorov-Arnold Networks [69.30866522377694]
  Kolmogorov-Arnold Networks (KANs) have seen great success in scientific domains. However, spline functions may not respect symmetry in tasks, which is crucial prior knowledge in machine learning. We propose Equivariant Kolmogorov-Arnold Networks (EKAN) to broaden their applicability to more fields.
  arXiv  Detail & Related papers  (2024-10-01T06:34:58Z)
• G-RepsNet: A Fast and General Construction of Equivariant Networks for Arbitrary Matrix Groups [8.24167511378417]
  Group equivariant networks are useful in a wide range of deep learning tasks. Here, we introduce Group Representation Networks (G-RepsNets), a lightweight equivariant network for arbitrary groups. We show that G-RepsNet is competitive to G-FNO (Helwig et al., 2023) and EGNN (Satorras et al., 2023) on N-body predictions and solving PDEs, respectively.
  arXiv  Detail & Related papers  (2024-02-23T16:19:49Z)
• EDGI: Equivariant Diffusion for Planning with Embodied Agents [17.931089055248062]
  Embodied agents operate in a structured world, often solving tasks with spatial, temporal, and permutation symmetries. We introduce the Equivariant diffuser for Generating Interactions (EDGI), an algorithm for planning and model-based reinforcement learning. EDGI is substantially more sample efficient and generalizes better across the symmetry group than non-equivariant models.
  arXiv  Detail & Related papers  (2023-03-22T09:19:39Z)
• Equi-Tuning: Group Equivariant Fine-Tuning of Pretrained Models [56.88106830869487]
  We introduce equi-tuning, a novel fine-tuning method that transforms (potentially non-equivariant) pretrained models into group equivariant models. We provide applications of equi-tuning on three different tasks: image classification, compositional generalization in language, and fairness in natural language generation.
  arXiv  Detail & Related papers  (2022-10-13T08:45:23Z)
• Design equivariant neural networks for 3D point cloud [0.0]
  This work seeks to improve the generalization and robustness of existing neural networks for 3D point clouds. The main challenge when designing equivariant models for point clouds is how to trade-off the performance of the model and the complexity. The proposed procedure is general and forms a fundamental approach to group equivariant neural networks.
  arXiv  Detail & Related papers  (2022-05-02T02:57:13Z)
• Frame Averaging for Invariant and Equivariant Network Design [50.87023773850824]
  We introduce Frame Averaging (FA), a framework for adapting known (backbone) architectures to become invariant or equivariant to new symmetry types. We show that FA-based models have maximal expressive power in a broad setting. We propose a new class of universal Graph Neural Networks (GNNs), universal Euclidean motion invariant point cloud networks, and Euclidean motion invariant Message Passing (MP) GNNs.
  arXiv  Detail & Related papers  (2021-10-07T11:05:23Z)
• Group Equivariant Subsampling [60.53371517247382]
  Subsampling is used in convolutional neural networks (CNNs) in the form of pooling or strided convolutions. We first introduce translation equivariant subsampling/upsampling layers that can be used to construct exact translation equivariant CNNs. We then generalise these layers beyond translations to general groups, thus proposing group equivariant subsampling/upsampling.
  arXiv  Detail & Related papers  (2021-06-10T16:14:00Z)
• Structured Reordering for Modeling Latent Alignments in Sequence Transduction [86.94309120789396]
  We present an efficient dynamic programming algorithm performing exact marginal inference of separable permutations. The resulting seq2seq model exhibits better systematic generalization than standard models on synthetic problems and NLP tasks.
  arXiv  Detail & Related papers  (2021-06-06T21:53:54Z)
• LieTransformer: Equivariant self-attention for Lie Groups [49.9625160479096]
  Group equivariant neural networks are used as building blocks of group invariant neural networks. We extend the scope of the literature to self-attention, that is emerging as a prominent building block of deep learning models. We propose the LieTransformer, an architecture composed of LieSelfAttention layers that are equivariant to arbitrary Lie groups and their discrete subgroups.
  arXiv  Detail & Related papers  (2020-12-20T11:02:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.