STENet: Superpixel Token Enhancing Network for RGB-D Salient Object Detection
- URL: http://arxiv.org/abs/2603.21999v1
- Date: Mon, 23 Mar 2026 14:06:46 GMT
- Title: STENet: Superpixel Token Enhancing Network for RGB-D Salient Object Detection
- Abstract summary: We propose a novel Superpixel Token Enhancing Network (STENet), which introduces superpixels into cross-modal interaction.<n>Our STENet achieves competitive performance compared to state-of-the-art methods.
- Score: 15.471917655885562
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Transformer-based methods for RGB-D Salient Object Detection (SOD) have gained significant interest, owing to the transformer's exceptional capacity to capture long-range pixel dependencies. Nevertheless, current RGB-D SOD methods face challenges, such as the quadratic complexity of the attention mechanism and the limited local detail extraction. To overcome these limitations, we propose a novel Superpixel Token Enhancing Network (STENet), which introduces superpixels into cross-modal interaction. STENet follows the two-stream encoder-decoder structure. Its cores are two tailored superpixel-driven cross-modal interaction modules, responsible for global and local feature enhancement. Specifically, we update the superpixel generation method by expanding the neighborhood range of each superpixel, allowing for flexible transformation between pixels and superpixels. With the updated superpixel generation method, we first propose the Superpixel Attention Global Enhancing Module to model the global pixel-to-superpixel relationship rather than the traditional global pixel-to-pixel relationship, which can capture region-level information and reduce computational complexity. We also propose the Superpixel Attention Local Refining Module, which leverages pixel similarity within superpixels to filter out a subset of pixels (i.e., local pixels) and then performs feature enhancement on these local pixels, thereby capturing concerned local details. Furthermore, we fuse the globally and locally enhanced features along with the cross-scale features to achieve comprehensive feature representation. Experiments on seven RGB-D SOD datasets reveal that our STENet achieves competitive performance compared to state-of-the-art methods. The code and results of our method are available at https://github.com/Mark9010/STENet.
Related papers
- PixelSR: Efficient Screen Content Super-Resolution via Pixel Classification [58.92928505513181]
Existing works in screen content super-resolution underutilize the special characteristics of screen content.<n>We propose PixelSR, a method to improve super-resolution performance but with faster inference speed.<n> Experiments show our PixelSR achieves state-of-the-art performance with shorter inference time in screen content super-resolution.
arXiv Detail & Related papers (2026-08-01T13:03:47Z) - Square Superpixel Generation and Representation Learning via Granular Ball Computing [97.99956628286243]
Superpixels provide a compact region-based representation that preserves object boundaries and local structures.<n>Most existing superpixel algorithms produce irregularly shaped regions, which are not well aligned with regular operators such as convolutions.<n>Motivated by the adaptive representation and coverage property of granular-ball computing, we develop a square superpixel generation approach.
arXiv Detail & Related papers (2026-03-31T09:06:58Z) - Pixel-Inconsistency Modeling for Image Manipulation Localization [59.968362815126326]
Digital image forensics plays a crucial role in image authentication and manipulation localization.
This paper presents a generalized and robust manipulation localization model through the analysis of pixel inconsistency artifacts.
Experiments show that our method successfully extracts inherent pixel-inconsistency forgery fingerprints.
arXiv Detail & Related papers (2023-09-30T02:54:51Z) - Superpixel Transformers for Efficient Semantic Segmentation [32.537400525407186]
We propose a solution by leveraging the idea of superpixels, an over-segmentation of the image, and applying them with a modern transformer framework.
Our method achieves state-of-the-art performance in semantic segmentation due to the rich superpixel features generated by the global self-attention mechanism.
arXiv Detail & Related papers (2023-09-28T23:09:30Z) - Adaptive Superpixel for Active Learning in Semantic Segmentation [34.0733215363568]
We propose a superpixel-based active learning framework, which collects a dominant label per superpixel instead of pixel-wise annotations.
Obtaining a dominant label per superpixel drastically reduces annotators' burden as it requires fewer clicks.
We also devise a sieving mechanism that identifies and excludes potentially noisy annotations from learning.
arXiv Detail & Related papers (2023-03-29T16:07:06Z) - Decoupled-and-Coupled Networks: Self-Supervised Hyperspectral Image
Super-Resolution with Subpixel Fusion [67.35540259040806]
We propose a subpixel-level HS super-resolution framework by devising a novel decoupled-and-coupled network, called DCNet.
As the name suggests, DC-Net first decouples the input into common (or cross-sensor) and sensor-specific components.
We append a self-supervised learning module behind the CSU net by guaranteeing the material consistency to enhance the detailed appearances of the restored HS product.
arXiv Detail & Related papers (2022-05-07T23:40:36Z) - Saliency Enhancement using Superpixel Similarity [77.34726150561087]
Saliency Object Detection (SOD) has several applications in image analysis.
Deep-learning-based SOD methods are among the most effective, but they may miss foreground parts with similar colors.
We introduce a post-processing method, named textitSaliency Enhancement over Superpixel Similarity (SESS)
We demonstrate that SESS can consistently and considerably improve the results of three deep-learning-based SOD methods on five image datasets.
arXiv Detail & Related papers (2021-12-01T17:22:54Z) - Generating Superpixels for High-resolution Images with Decoupled Patch
Calibration [82.21559299694555]
Patch Networks (PCNet) is designed to efficiently and accurately implement high-resolution superpixel segmentation.
DPC takes a local patch from the high-resolution images and dynamically generates a binary mask to impose the network to focus on region boundaries.
In particular, DPC takes a local patch from the high-resolution images and dynamically generates a binary mask to impose the network to focus on region boundaries.
arXiv Detail & Related papers (2021-08-19T10:33:05Z) - Implicit Integration of Superpixel Segmentation into Fully Convolutional
Networks [11.696069523681178]
We propose a way to implicitly integrate a superpixel scheme into CNNs.
Our proposed method hierarchically groups pixels at downsampling layers and generates superpixels.
We evaluate our method on several tasks such as semantic segmentation, superpixel segmentation, and monocular depth estimation.
arXiv Detail & Related papers (2021-03-05T02:20:26Z) - AINet: Association Implantation for Superpixel Segmentation [82.21559299694555]
We propose a novel textbfAssociation textbfImplantation (AI) module to enable the network to explicitly capture the relations between the pixel and its surrounding grids.
Our method could not only achieve state-of-the-art performance but maintain satisfactory inference efficiency.
arXiv Detail & Related papers (2021-01-26T10:40:13Z) - Superpixel Segmentation Based on Spatially Constrained Subspace
Clustering [57.76302397774641]
We consider each representative region with independent semantic information as a subspace, and formulate superpixel segmentation as a subspace clustering problem.
We show that a simple integration of superpixel segmentation with the conventional subspace clustering does not effectively work due to the spatial correlation of the pixels.
We propose a novel convex locality-constrained subspace clustering model that is able to constrain the spatial adjacent pixels with similar attributes to be clustered into a superpixel.
arXiv Detail & Related papers (2020-12-11T06:18:36Z) - Texture-Aware Superpixel Segmentation [5.027313829438866]
We develop a Texture-Aware SuperPixel (TASP) method to segment smooth and textured areas.<n>To ensure texture homogeneity within superpixels, a new pixel to superpixel patch-based distance is proposed.<n>TASP outperforms the segmentation accuracy of the state-of-the-art methods on texture and also natural color image datasets.
arXiv Detail & Related papers (2019-01-30T21:37:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.