On-Device Unsupervised Image Segmentation

• URL: http://arxiv.org/abs/2303.12753v1
• Date: Fri, 24 Feb 2023 00:51:17 GMT
• Title: On-Device Unsupervised Image Segmentation
• Authors: Junhuan Yang, Yi Sheng, Yuzhou Zhang, Weiwen Jiang, Lei Yang
• Abstract summary: We build the HDC-based unsupervised segmentation framework, namely "SegHDC" On a standard segmentation dataset, SegHDC can achieve a 28.0% improvement in Intersection over Union (IoU) score. SegHDC can obtain segmentation results within 3 minutes while achieving a 0.9587 IoU score.
• Score: 5.9990534851802915
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Along with the breakthrough of convolutional neural networks, learning-based segmentation has emerged in many research works. Most of them are based on supervised learning, requiring plenty of annotated data; however, to support segmentation, a label for each pixel is required, which is obviously expensive. As a result, the issue of lacking annotated segmentation data commonly exists. Continuous learning is a promising way to deal with this issue; however, it still has high demands on human labor for annotation. What's more, privacy is highly required in segmentation data for real-world applications, which further calls for on-device learning. In this paper, we aim to resolve the above issue in an alternative way: Instead of supervised segmentation, we propose to develop efficient unsupervised segmentation that can be executed on edge devices. Based on our observation that segmentation can obtain high performance when pixels are mapped to a high-dimension space, we for the first time bring brain-inspired hyperdimensional computing (HDC) to the segmentation task. We build the HDC-based unsupervised segmentation framework, namely "SegHDC". In SegHDC, we devise a novel encoding approach that follows the Manhattan distance. A clustering algorithm is further developed on top of the encoded high-dimension vectors to obtain segmentation results. Experimental results show SegHDC can significantly surpass neural network-based unsupervised segmentation. On a standard segmentation dataset, DSB2018, SegHDC can achieve a 28.0% improvement in Intersection over Union (IoU) score; meanwhile, it achieves over 300x speedup on Raspberry PI. What's more, for a larger size image in the BBBC005 dataset, the existing approach cannot be accommodated to Raspberry PI due to out of memory; on the other hand, SegHDC can obtain segmentation results within 3 minutes while achieving a 0.9587 IoU score.

Related papers

• Bayesian Self-Training for Semi-Supervised 3D Segmentation [59.544558398992386]
  3D segmentation is a core problem in computer vision. densely labeling 3D point clouds to employ fully-supervised training remains too labor intensive and expensive. Semi-supervised training provides a more practical alternative, where only a small set of labeled data is given, accompanied by a larger unlabeled set.
  arXiv  Detail & Related papers  (2024-09-12T14:54:31Z)
• Unsupervised Universal Image Segmentation [59.0383635597103]
  We propose an Unsupervised Universal model (U2Seg) adept at performing various image segmentation tasks. U2Seg generates pseudo semantic labels for these segmentation tasks via leveraging self-supervised models. We then self-train the model on these pseudo semantic labels, yielding substantial performance gains.
  arXiv  Detail & Related papers  (2023-12-28T18:59:04Z)
• Learning Semantic Segmentation with Query Points Supervision on Aerial Images [57.09251327650334]
  We present a weakly supervised learning algorithm to train semantic segmentation algorithms. Our proposed approach performs accurate semantic segmentation and improves efficiency by significantly reducing the cost and time required for manual annotation.
  arXiv  Detail & Related papers  (2023-09-11T14:32:04Z)
• Tracking Anything with Decoupled Video Segmentation [87.07258378407289]
  We develop a decoupled video segmentation approach (DEVA) It is composed of task-specific image-level segmentation and class/task-agnostic bi-directional temporal propagation. We show that this decoupled formulation compares favorably to end-to-end approaches in several data-scarce tasks.
  arXiv  Detail & Related papers  (2023-09-07T17:59:41Z)
• A Review of Panoptic Segmentation for Mobile Mapping Point Clouds [16.78395191633382]
  3D point cloud panoptic segmentation is the combined task to (i) assign each point to a semantic class and (ii) separate the points in each class into object instances. Recently there has been an increased interest in such comprehensive 3D scene understanding, building on the rapid advances of semantic segmentation. Yet, to date there is very little work about panoptic segmentation of outdoor mobile-mapping data, and no systematic comparisons.
  arXiv  Detail & Related papers  (2023-04-27T07:07:18Z)
• Label conditioned segmentation [14.66405859401613]
  Semantic segmentation is an important task in computer vision that is often tackled with convolutional neural networks (CNNs) For segmentation tasks with multiple classes, the standard approach is to use a network that computes a multi-channel probabilistic segmentation map. We propose a simple yet effective method to address this challenge. In our approach, the segmentation network produces a single-channel output, while being conditioned on a single class label, which determines the output class of the network.
  arXiv  Detail & Related papers  (2022-03-17T22:21:10Z)
• CvS: Classification via Segmentation For Small Datasets [52.821178654631254]
  This paper presents CvS, a cost-effective classifier for small datasets that derives the classification labels from predicting the segmentation maps. We evaluate the effectiveness of our framework on diverse problems showing that CvS is able to achieve much higher classification results compared to previous methods when given only a handful of examples.
  arXiv  Detail & Related papers  (2021-10-29T18:41:15Z)
• Scaling Semantic Segmentation Beyond 1K Classes on a Single GPU [87.48110331544885]
  We propose a novel training methodology to train and scale the existing semantic segmentation models. We demonstrate a clear benefit of our approach on a dataset with 1284 classes, bootstrapped from LVIS and COCO annotations, with three times better mIoU than the DeeplabV3+ model.
  arXiv  Detail & Related papers  (2020-12-14T13:12:38Z)
• Shape-aware Semi-supervised 3D Semantic Segmentation for Medical Images [24.216869988183092]
  We propose a shapeaware semi-supervised segmentation strategy to leverage abundant unlabeled data and to enforce a geometric shape constraint on the segmentation output. We develop a multi-task deep network that jointly predicts semantic segmentation and signed distance mapDM) of object surfaces. Experiments show that our method outperforms current state-of-the-art approaches with improved shape estimation.
  arXiv  Detail & Related papers  (2020-07-21T11:44:52Z)
• An Auto-Encoder Strategy for Adaptive Image Segmentation [18.333542893112007]
  We propose a novel perspective of segmentation as a discrete representation learning problem. We present a variational autoencoder segmentation strategy that is flexible and adaptive. We demonstrate that a Markov Random Field prior can yield significantly better results than a spatially independent prior.
  arXiv  Detail & Related papers  (2020-04-29T00:53:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.