Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Models

• URL: http://arxiv.org/abs/2605.03438v2
• Date: Sun, 10 May 2026 13:13:59 GMT
• Title: Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Models
• Abstract summary: 3D point cloud foundation models (PFMs) have demonstrated strong transferability across diverse downstream tasks.<n>Existing PEFT approaches are primarily designed for Transformer-based backbones.<n>We propose Mantis, the first Mamba-native PEFT framework for 3D PFMs.
• Score: 25.87142945118221
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Pre-trained 3D point cloud foundation models (PFMs) have demonstrated strong transferability across diverse downstream tasks. However, full fine-tuning these models is computationally expensive and storage-intensive. Parameter-efficient fine-tuning (PEFT) offers a promising alternative, but existing PEFT approaches are primarily designed for Transformer-based backbones and rely on token-level prompting or feature transformation. Mamba-based backbones introduce a granularity mismatch between token-level adaptation and state-level sequence dynamics. Consequently, straightforward transfer of existing PEFT approaches to frozen Mamba backbones leads to substantial accuracy degradation and unstable optimization. To address this issue, we propose Mantis, the first Mamba-native PEFT framework for 3D PFMs. Specifically, a State-Aware Adapter (SAA) is introduced to inject lightweight task-conditioned control signals into selective state-space updates, enabling state-level adaptation while keeping the pre-trained backbone frozen. Moreover, different valid point cloud serializations are regularized by Dual-Serialization Consistency Distillation (DSCD), thereby reducing serialization-induced instability. Extensive experiments across multiple benchmarks demonstrate that our Mantis achieves competitive performance with only about 5% trainable parameters. Our code is available at https://github.com/gzhhhhhhh/Mantis.

Related papers

• Point-Selection Fine-Tuning Framework for Robust Point Cloud Classification [13.13510696965873]
  PSFT is a point-selection fine-tuning framework that improves robustness while remaining parameter-efficient.<n>We show that PSFT consistently reduces corruption error on Model-C and ModelNet40-C across all tested 3D pre-trained backbones.
  arXiv  Detail & Related papers  (2026-07-22T03:27:18Z)
• Point Ladder Tuning: Parameter-Efficient Hierarchical Adaptation for 3D Point Cloud Understanding [4.750456629699177]
  Point Ladder Tuning (PLT) is a PEFT framework that performs hierarchical, instance-conditioned adaptation while keeping the backbone frozen.<n>For dense prediction, we introduce a lightweight segmentation head that progressively upsamples fused features.<n>Experiments on classification and dense prediction show that consistently surpasses prior PEFT baselines with minimal parameters.
  arXiv  Detail & Related papers  (2026-07-21T15:06:37Z)
• Tri-Efficient Transfer Learning for Point Cloud Videos [32.14641034344552]
  PoinTriE aims to mine richer supervision signals from existing data rather than blindly scaling datasets.<n>For pre-training, pseudo-motion trajectories are synthesized via rigid transformations, paired with text corpora and 2D projections derived from raw point clouds.<n>During fine-tuning, we freeze the pretrained backbone and only update a lightweight Spatio-temporal Side Network built with LoRA units.
  arXiv  Detail & Related papers  (2026-06-23T05:55:02Z)
• ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning [14.501555924276824]
  Low-Rank Adaptation (LoRA) achieves adaptation by inserting independent low-rank perturbations directly to individual weights.<n>We propose ShadowPEFT, a centralized PEFT framework that instead performs layer-level refinement through a depth-shared shadow module.
  arXiv  Detail & Related papers  (2026-04-21T09:17:35Z)
• An Adapter-free Fine-tuning Approach for Tuning 3D Foundation Models [22.63554774942836]
  We propose Momentum-Consistency Fine-Tuning (MCFT) to bridge the gap between full and parameter-efficient fine-tuning.<n>MCFT selectively fine-tunes a portion of the pre-trained encoder while enforcing a momentum-based consistency constraint.<n>We extend MCFT with two variants: a semi-supervised framework that leverages abundant unlabeled data to enhance few-shot performance, and a pruning-based variant that improves computational efficiency.
  arXiv  Detail & Related papers  (2026-03-24T21:28:37Z)
• MT-PCR: A Hybrid Mamba-Transformer with Spatial Serialization for Hierarchical Point Cloud Registration [15.482436877752331]
  We propose MT-PCR, the first point cloud registration framework that integrates both Mamba and Transformer modules.<n>We show that MT-PCR outperforms Transformer-based and concurrent state-of-the-art methods in both accuracy and efficiency.
  arXiv  Detail & Related papers  (2025-06-16T07:49:43Z)
• PMA: Towards Parameter-Efficient Point Cloud Understanding via Point Mamba Adapter [54.33433051500349]
  We propose Point Mamba Adapter (PMA), which constructs an ordered feature sequence from all layers of the pre-trained model.<n>We also propose a geometry-constrained gate prompt generator (G2PG) shared across different layers.
  arXiv  Detail & Related papers  (2025-05-27T09:27:16Z)
• Token Adaptation via Side Graph Convolution for Efficient Fine-tuning of 3D Point Cloud Transformers [1.19658449368018]
  This paper proposes a novel PEFT algorithm called Side Token Adaptation on a neighborhood Graph (STAG) to achieve superior temporal and spatial efficiency.<n>STAG employs a graph convolutional side network operating in parallel with a frozen backbone Transformer to adapt tokens to downstream tasks.<n>We also present Point Cloud Classification 13 (PCC13), a new benchmark comprising diverse publicly available 3D point cloud datasets.
  arXiv  Detail & Related papers  (2025-02-19T22:58:56Z)
• Point Cloud Mamba: Point Cloud Learning via State Space Model [73.7454734756626]
  We show that Mamba-based point cloud methods can outperform previous methods based on transformer or multi-layer perceptrons (MLPs) In particular, we demonstrate that Mamba-based point cloud methods can outperform previous methods based on transformer or multi-layer perceptrons (MLPs) Point Cloud Mamba surpasses the state-of-the-art (SOTA) point-based method PointNeXt and achieves new SOTA performance on the ScanNN, ModelNet40, ShapeNetPart, and S3DIS datasets.
  arXiv  Detail & Related papers  (2024-03-01T18:59:03Z)
• Adaptive Point Transformer [88.28498667506165]
  Adaptive Point Cloud Transformer (AdaPT) is a standard PT model augmented by an adaptive token selection mechanism. AdaPT dynamically reduces the number of tokens during inference, enabling efficient processing of large point clouds.
  arXiv  Detail & Related papers  (2024-01-26T13:24:45Z)
• OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models [81.7855202178564]
  We present OpenDelta, an open-source library that overcomes limitations by providing a plug-and-play implementation of various delta tuning methods. Our novel techniques eliminate the need to modify the backbone PTMs' code, making OpenDelta compatible with different, even novel PTMs.
  arXiv  Detail & Related papers  (2023-07-05T16:30:14Z)
• Consolidator: Mergeable Adapter with Grouped Connections for Visual Adaptation [53.835365470800916]
  We show how to efficiently and effectively transfer knowledge in a vision transformer. We propose consolidator to modify the pre-trained model with the addition of a small set of tunable parameters. Our consolidator can reach up to 7.56 better accuracy than full fine-tuning with merely 0.35% parameters.
  arXiv  Detail & Related papers  (2023-04-30T23:59:02Z)
• PVP: Pre-trained Visual Parameter-Efficient Tuning [29.05396521860764]
  Large-scale pre-trained transformers have demonstrated remarkable success in various computer vision tasks. It is still highly challenging to fully fine-tune these models for downstream tasks due to their high computational and storage costs. We propose a Pre-trained Visual. efficient (PVP) Tuning framework, which pre-trains the parameter-efficient tuning modules first and then leverages the pre-trained modules.
  arXiv  Detail & Related papers  (2023-04-26T15:55:29Z)
• Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Models [64.49254199311137]
  We propose a novel Instance-aware Dynamic Prompt Tuning (IDPT) strategy for pre-trained point cloud models. The essence of IDPT is to develop a dynamic prompt generation module to perceive semantic prior features of each point cloud instance. In experiments, IDPT outperforms full fine-tuning in most tasks with a mere 7% of the trainable parameters.
  arXiv  Detail & Related papers  (2023-04-14T16:03:09Z)
• DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models [152.29364079385635]
  As pre-trained models grow bigger, the fine-tuning process can be time-consuming and computationally expensive. We propose a framework for resource- and parameter-efficient fine-tuning by leveraging the sparsity prior in both weight updates and the final model weights. Our proposed framework, dubbed Dually Sparsity-Embedded Efficient Tuning (DSEE), aims to achieve two key objectives: (i) parameter efficient fine-tuning and (ii) resource-efficient inference.
  arXiv  Detail & Related papers  (2021-10-30T03:29:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.