3D Meta-Segmentation Neural Network
- URL: http://arxiv.org/abs/2110.04297v1
- Date: Fri, 8 Oct 2021 01:47:54 GMT
- Title: 3D Meta-Segmentation Neural Network
- Authors: Yu Hao, Yi Fang
- Abstract summary: We present a novel meta-learning strategy that regards the 3D shape segmentation function as a task.
By training over a number of 3D part segmentation tasks, our method is capable to learn the prior over the respective 3D segmentation function space.
We demonstrate that our model achieves superior part segmentation performance with the few-shot setting on the widely used dataset: ShapeNet.
- Score: 12.048487830494107
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Though deep learning methods have shown great success in 3D point cloud part
segmentation, they generally rely on a large volume of labeled training data,
which makes the model suffer from unsatisfied generalization abilities to
unseen classes with limited data. To address this problem, we present a novel
meta-learning strategy that regards the 3D shape segmentation function as a
task. By training over a number of 3D part segmentation tasks, our method is
capable to learn the prior over the respective 3D segmentation function space
which leads to an optimal model that is rapidly adapting to new part
segmentation tasks. To implement our meta-learning strategy, we propose two
novel modules: meta part segmentation learner and part segmentation learner.
During the training process, the part segmentation learner is trained to
complete a specific part segmentation task in the few-shot scenario. In the
meantime, the meta part segmentation learner is trained to capture the prior
from multiple similar part segmentation tasks. Based on the learned information
of task distribution, our meta part segmentation learner is able to dynamically
update the part segmentation learner with optimal parameters which enable our
part segmentation learner to rapidly adapt and have great generalization
ability on new part segmentation tasks. We demonstrate that our model achieves
superior part segmentation performance with the few-shot setting on the widely
used dataset: ShapeNet.
Related papers
- SegPoint: Segment Any Point Cloud via Large Language Model [62.69797122055389]
We propose a model, called SegPoint, to produce point-wise segmentation masks across a diverse range of tasks.
SegPoint is the first model to address varied segmentation tasks within a single framework.
arXiv Detail & Related papers (2024-07-18T17:58:03Z) - Tracking Anything with Decoupled Video Segmentation [87.07258378407289]
We develop a decoupled video segmentation approach (DEVA)
It is composed of task-specific image-level segmentation and class/task-agnostic bi-directional temporal propagation.
We show that this decoupled formulation compares favorably to end-to-end approaches in several data-scarce tasks.
arXiv Detail & Related papers (2023-09-07T17:59:41Z) - AIMS: All-Inclusive Multi-Level Segmentation [93.5041381700744]
We propose a new task, All-Inclusive Multi-Level (AIMS), which segments visual regions into three levels: part, entity, and relation.
We also build a unified AIMS model through multi-dataset multi-task training to address the two major challenges of annotation inconsistency and task correlation.
arXiv Detail & Related papers (2023-05-28T16:28:49Z) - Ensembling Instance and Semantic Segmentation for Panoptic Segmentation [0.0]
Methods first performs instance segmentation and semantic segmentation separately, then combines the two to generate panoptic segmentation results.
We add several expert models of Mask R-CNN in instance segmentation to tackle the data imbalance problem in the training data.
In semantic segmentation, we trained several models with various backbones and use an ensemble strategy which further boosts the segmentation results.
arXiv Detail & Related papers (2023-04-20T14:02:01Z) - Semi-Weakly Supervised Object Kinematic Motion Prediction [56.282759127180306]
Given a 3D object, kinematic motion prediction aims to identify the mobile parts as well as the corresponding motion parameters.
We propose a graph neural network to learn the map between hierarchical part-level segmentation and mobile parts parameters.
The network predictions yield a large scale of 3D objects with pseudo labeled mobility information.
arXiv Detail & Related papers (2023-03-31T02:37:36Z) - Task-Adaptive Feature Transformer with Semantic Enrichment for Few-Shot
Segmentation [21.276981570672064]
Few-shot learning allows machines to classify novel classes using only a few labeled samples.
We propose a learnable module that can be placed on top of existing segmentation networks for performing few-shot segmentation.
Experiments on PASCAL-$5i$ and COCO-$20i$ datasets confirm that the added modules successfully extend the capability of existing segmentators.
arXiv Detail & Related papers (2022-02-14T06:16:26Z) - iSeg3D: An Interactive 3D Shape Segmentation Tool [48.784624011210475]
We propose an effective annotation tool, named iSeg for 3D shape.
Under our observation, most objects can be considered as the composition of finite primitive shapes.
We train iSeg3D model on our built primitive-composed shape data to learn the geometric prior knowledge in a self-supervised manner.
arXiv Detail & Related papers (2021-12-24T08:15:52Z) - LRGNet: Learnable Region Growing for Class-Agnostic Point Cloud
Segmentation [19.915593390338337]
This research proposes a learnable region growing method for class-agnostic point cloud segmentation.
The proposed method is able to segment any class of objects using a single deep neural network without any assumptions about their shapes and sizes.
arXiv Detail & Related papers (2021-03-16T15:58:01Z) - Task-Adaptive Feature Transformer for Few-Shot Segmentation [21.276981570672064]
We propose a learnable module for few-shot segmentation, the task-adaptive feature transformer (TAFT)
TAFT linearly transforms task-specific high-level features to a set of task-agnostic features well-suited to the segmentation job.
Experiments on the PASCAL-$5i$ dataset confirm that this combination successfully adds few-shot learning capability to the segmentation algorithm.
arXiv Detail & Related papers (2020-10-22T04:35:37Z) - Learning Fast and Robust Target Models for Video Object Segmentation [83.3382606349118]
Video object segmentation (VOS) is a highly challenging problem since the initial mask, defining the target object, is only given at test-time.
Most previous approaches fine-tune segmentation networks on the first frame, resulting in impractical frame-rates and risk of overfitting.
We propose a novel VOS architecture consisting of two network components.
arXiv Detail & Related papers (2020-02-27T21:58:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.