Affinity Fusion Graph-based Framework for Natural Image Segmentation

• URL: http://arxiv.org/abs/2006.13542v3
• Date: Fri, 15 Jan 2021 03:33:23 GMT
• Title: Affinity Fusion Graph-based Framework for Natural Image Segmentation
• Authors: Yang Zhang, Moyun Liu, Jingwu He, Fei Pan, and Yanwen Guo
• Abstract summary: The framework combines adjacency-graphs and kernel spectral clustering based graphs (KSC-graphs) according to a new definition named affinity nodes of multi-scale superpixels. A KSC-graph is built via a novel kernel spectral clustering to explore the nonlinear relationships among these affinity nodes. An adjacency-graph at each scale is constructed, which is further used to update the proposed KSC-graph at affinity nodes.
• Score: 20.674669923674834
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper proposes an affinity fusion graph framework to effectively connect different graphs with highly discriminating power and nonlinearity for natural image segmentation. The proposed framework combines adjacency-graphs and kernel spectral clustering based graphs (KSC-graphs) according to a new definition named affinity nodes of multi-scale superpixels. These affinity nodes are selected based on a better affiliation of superpixels, namely subspace-preserving representation which is generated by sparse subspace clustering based on subspace pursuit. Then a KSC-graph is built via a novel kernel spectral clustering to explore the nonlinear relationships among these affinity nodes. Moreover, an adjacency-graph at each scale is constructed, which is further used to update the proposed KSC-graph at affinity nodes. The fusion graph is built across different scales, and it is partitioned to obtain final segmentation result. Experimental results on the Berkeley segmentation dataset and Microsoft Research Cambridge dataset show the superiority of our framework in comparison with the state-of-the-art methods. The code is available at https://github.com/Yangzhangcst/AF-graph.

Related papers

• SSHPool: The Separated Subgraph-based Hierarchical Pooling [47.78745802682822]
  We develop a novel local graph pooling method, namely the Separated Subgraph-based Hierarchical Pooling (SSH) for graph classification. We individually employ the local graph convolution units as the local structure to further compress each subgraph into a coarsened node. We develop an end-to-end GNN framework associated with the SSHPool module for graph classification.
  arXiv  Detail & Related papers  (2024-03-24T13:03:35Z)
• Graph Contrastive Learning under Heterophily via Graph Filters [51.46061703680498]
  Graph contrastive learning (CL) methods learn node representations in a self-supervised manner by maximizing the similarity between the augmented node representations obtained via a GNN-based encoder. In this work, we propose an effective graph CL method, namely HLCL, for learning graph representations under heterophily. Our extensive experiments show that HLCL outperforms state-of-the-art graph CL methods on benchmark datasets with heterophily, as well as large-scale real-world graphs, by up to 7%, and outperforms graph supervised learning methods on datasets with heterophily by up to 10%.
  arXiv  Detail & Related papers  (2023-03-11T08:32:39Z)
• Clustering Edges in Directed Graphs [0.40611352512781856]
  We develop a framework for edge clustering, a new method for exploratory data analysis. Edges sharing a functional affinity are assigned to the same group and form an influence subgraph cluster. We present several diverse examples demonstrating the potential for widespread application of edge clustering in scientific research.
  arXiv  Detail & Related papers  (2022-02-23T16:24:55Z)
• Adaptive Fusion Affinity Graph with Noise-free Online Low-rank Representation for Natural Image Segmentation [3.7189024338041836]
  We propose an adaptive affinity fusion graph (AFA-graph) with noise-free low-rank representation in an online manner for natural image segmentation. Experimental results on the BSD300, BSD500, MSRC, and PASCAL VOC show the effectiveness of AFA-graph in comparison with state-of-the-art approaches.
  arXiv  Detail & Related papers  (2021-10-22T10:15:27Z)
• Spectral-Spatial Global Graph Reasoning for Hyperspectral Image Classification [50.899576891296235]
  Convolutional neural networks have been widely applied to hyperspectral image classification. Recent methods attempt to address this issue by performing graph convolutions on spatial topologies.
  arXiv  Detail & Related papers  (2021-06-26T06:24:51Z)
• Seeing All From a Few: Nodes Selection Using Graph Pooling for Graph Clustering [37.68977275752782]
  noisy edges and nodes in the graph may make the clustering results worse. We propose a novel dual graph embedding network(DGEN) to improve the robustness of the graph clustering to the noisy nodes and edges. Experiments on three benchmark graph datasets demonstrate the superiority compared with several state-of-the-art algorithms.
  arXiv  Detail & Related papers  (2021-04-30T06:51:51Z)
• Graph Pooling with Node Proximity for Hierarchical Representation Learning [80.62181998314547]
  We propose a novel graph pooling strategy that leverages node proximity to improve the hierarchical representation learning of graph data with their multi-hop topology. Results show that the proposed graph pooling strategy is able to achieve state-of-the-art performance on a collection of public graph classification benchmark datasets.
  arXiv  Detail & Related papers  (2020-06-19T13:09:44Z)
• Sequential Graph Convolutional Network for Active Learning [53.99104862192055]
  We propose a novel pool-based Active Learning framework constructed on a sequential Graph Convolution Network (GCN) With a small number of randomly sampled images as seed labelled examples, we learn the parameters of the graph to distinguish labelled vs unlabelled nodes. We exploit these characteristics of GCN to select the unlabelled examples which are sufficiently different from labelled ones.
  arXiv  Detail & Related papers  (2020-06-18T00:55:10Z)
• Graph Neural Networks with Composite Kernels [60.81504431653264]
  We re-interpret node aggregation from the perspective of kernel weighting. We present a framework to consider feature similarity in an aggregation scheme. We propose feature aggregation as the composition of the original neighbor-based kernel and a learnable kernel to encode feature similarities in a feature space.
  arXiv  Detail & Related papers  (2020-05-16T04:44:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.