Unsupervised Superpixel Generation using Edge-Sparse Embedding
- URL: http://arxiv.org/abs/2211.15474v2
- Date: Tue, 29 Nov 2022 09:08:21 GMT
- Title: Unsupervised Superpixel Generation using Edge-Sparse Embedding
- Authors: Jakob Geusen, Gustav Bredell, Tianfei Zhou, Ender Konukoglu
- Abstract summary: partitioning an image into superpixels based on the similarity of pixels with respect to features can significantly reduce data complexity and improve subsequent image processing tasks.
We propose a non-convolutional image decoder to reduce the expected number of contrasts and enforce smooth, connected edges in the reconstructed image.
We generate edge-sparse pixel embeddings by encoding additional spatial information into the piece-wise smooth activation maps from the decoder's last hidden layer and use a standard clustering algorithm to extract high quality superpixels.
- Score: 18.92698251515116
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Partitioning an image into superpixels based on the similarity of pixels with
respect to features such as colour or spatial location can significantly reduce
data complexity and improve subsequent image processing tasks. Initial
algorithms for unsupervised superpixel generation solely relied on local cues
without prioritizing significant edges over arbitrary ones. On the other hand,
more recent methods based on unsupervised deep learning either fail to properly
address the trade-off between superpixel edge adherence and compactness or lack
control over the generated number of superpixels. By using random images with
strong spatial correlation as input, \ie, blurred noise images, in a
non-convolutional image decoder we can reduce the expected number of contrasts
and enforce smooth, connected edges in the reconstructed image. We generate
edge-sparse pixel embeddings by encoding additional spatial information into
the piece-wise smooth activation maps from the decoder's last hidden layer and
use a standard clustering algorithm to extract high quality superpixels. Our
proposed method reaches state-of-the-art performance on the BSDS500,
PASCAL-Context and a microscopy dataset.
Related papers
- Pixel-Inconsistency Modeling for Image Manipulation Localization [63.54342601757723]
Digital image forensics plays a crucial role in image authentication and manipulation localization.
This paper presents a generalized and robust manipulation localization model through the analysis of pixel inconsistency artifacts.
Experiments show that our method successfully extracts inherent pixel-inconsistency forgery fingerprints.
arXiv Detail & Related papers (2023-09-30T02:54:51Z) - Saliency Enhancement using Superpixel Similarity [77.34726150561087]
Saliency Object Detection (SOD) has several applications in image analysis.
Deep-learning-based SOD methods are among the most effective, but they may miss foreground parts with similar colors.
We introduce a post-processing method, named textitSaliency Enhancement over Superpixel Similarity (SESS)
We demonstrate that SESS can consistently and considerably improve the results of three deep-learning-based SOD methods on five image datasets.
arXiv Detail & Related papers (2021-12-01T17:22:54Z) - Small Lesion Segmentation in Brain MRIs with Subpixel Embedding [105.1223735549524]
We present a method to segment MRI scans of the human brain into ischemic stroke lesion and normal tissues.
We propose a neural network architecture in the form of a standard encoder-decoder where predictions are guided by a spatial expansion embedding network.
arXiv Detail & Related papers (2021-09-18T00:21:17Z) - Generating Superpixels for High-resolution Images with Decoupled Patch
Calibration [82.21559299694555]
Patch Networks (PCNet) is designed to efficiently and accurately implement high-resolution superpixel segmentation.
DPC takes a local patch from the high-resolution images and dynamically generates a binary mask to impose the network to focus on region boundaries.
In particular, DPC takes a local patch from the high-resolution images and dynamically generates a binary mask to impose the network to focus on region boundaries.
arXiv Detail & Related papers (2021-08-19T10:33:05Z) - Implicit Integration of Superpixel Segmentation into Fully Convolutional
Networks [11.696069523681178]
We propose a way to implicitly integrate a superpixel scheme into CNNs.
Our proposed method hierarchically groups pixels at downsampling layers and generates superpixels.
We evaluate our method on several tasks such as semantic segmentation, superpixel segmentation, and monocular depth estimation.
arXiv Detail & Related papers (2021-03-05T02:20:26Z) - AINet: Association Implantation for Superpixel Segmentation [82.21559299694555]
We propose a novel textbfAssociation textbfImplantation (AI) module to enable the network to explicitly capture the relations between the pixel and its surrounding grids.
Our method could not only achieve state-of-the-art performance but maintain satisfactory inference efficiency.
arXiv Detail & Related papers (2021-01-26T10:40:13Z) - Superpixel Segmentation Based on Spatially Constrained Subspace
Clustering [57.76302397774641]
We consider each representative region with independent semantic information as a subspace, and formulate superpixel segmentation as a subspace clustering problem.
We show that a simple integration of superpixel segmentation with the conventional subspace clustering does not effectively work due to the spatial correlation of the pixels.
We propose a novel convex locality-constrained subspace clustering model that is able to constrain the spatial adjacent pixels with similar attributes to be clustered into a superpixel.
arXiv Detail & Related papers (2020-12-11T06:18:36Z) - Superpixel Segmentation with Fully Convolutional Networks [32.878045921919714]
We present a novel method that employs a simple fully convolutional network to predict superpixels on a regular image grid.
Experimental results on benchmark datasets show that our method achieves state-of-the-art superpixel segmentation performance.
We modify a popular network architecture for stereo matching to simultaneously predict superpixels and disparities.
arXiv Detail & Related papers (2020-03-29T02:42:07Z) - Multi-Scale Superpatch Matching using Dual Superpixel Descriptors [0.6875312133832078]
Over-segmentation into superpixels is a very effective dimensionality reduction strategy, enabling fast dense image processing.
The inherent irregularity of the image decomposition compared to standard hierarchical multi-resolution schemes is a problem.
We introduce the dual superpatch, a novel superpixel neighborhood descriptor.
arXiv Detail & Related papers (2020-03-09T22:04:04Z) - Texture Superpixel Clustering from Patch-based Nearest Neighbor Matching [2.84279467589473]
We propose a new Nearest Neighbor-based Superpixel Clustering (NNSC) method to generate texture-aware superpixels in a limited computational time.
arXiv Detail & Related papers (2020-03-09T21:11:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.