Bridging Graph Drawing and Dimensionality Reduction with Stochastic Stress Optimization
- URL: http://arxiv.org/abs/2605.00641v1
- Date: Fri, 01 May 2026 13:22:56 GMT
- Title: Bridging Graph Drawing and Dimensionality Reduction with Stochastic Stress Optimization
- Abstract summary: Dimensionality Reduction (DR) and Graph Drawing (GD) aim to visualize abstract, non-linear structures, yet rely on different optimization paradigms.<n>We bridge these domains by adapting Gradient Descent (SGD) techniques from graph drawing to vector data embedding.
- Score: 0.22940141855172028
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Both Dimensionality Reduction (DR) and Graph Drawing (GD) aim to visualize abstract, non-linear structures, yet rely on different optimization paradigms. This contrast is evident in Multidimensional Scaling (MDS), which typically depends on the SMACOF algorithm despite graph drawing results showing that simpler stochastic optimization schemes can be more effective for the same objective. We bridge these domains by adapting Stochastic Gradient Descent (SGD) techniques from graph drawing to vector data embedding. We present a scikit-learn compatible estimator that minimizes global stress through local pairwise updates, improving upon the existing implementation. Experiments on standard high-dimensional benchmarks show that our stochastic solver converges substantially faster than SMACOF while achieving comparable or lower stress.
Related papers
- Rethinking Efficient Graph Coarsening via a Non-Selfishness Principle [56.92868481531399]
We propose a non-selfishness principle that prioritizes the collective interference of neighborhood in coarsening.<n>We derive a faster variant NOPE*, which reduces O(dot d) interference evaluation to O(d) based on the local isotropy assumption.<n>Learning on coarsened graphs yields comparable performance to original graphs, and can even show superior performance over LLM-based graph reasoning.
arXiv Detail & Related papers (2026-05-13T05:24:35Z) - LARGE: A Locally Adaptive Regularization Approach for Estimating Gaussian Graphical Models [2.3696387635465608]
We develop Locally Adaptive Regularization for Graph Estimation (LARGE)<n>LARGE is an approach to adaptively learn nodewise tuning parameters to improve graph estimation and selection.<n>We demonstrate the practical utility of our method by estimating brain connectivity from a real fMRI data set.
arXiv Detail & Related papers (2026-01-14T18:37:50Z) - Word2VecGD: Neural Graph Drawing with Cosine-Stress Optimization [0.0]
Instead of relying on exact shortest-path distances, we optimize layouts using cosine dissimilarities.<n>Our framework integrates differentiable stress optimization with gradient descent.
arXiv Detail & Related papers (2025-09-22T03:09:55Z) - Matrix Completion with Graph Information: A Provable Nonconvex Optimization Approach [5.235925587710112]
We consider the problem of matrix completion with graphs as side information depicting the interrelations between variables.<n>We propose in this paper a graph regularized matrix completion algorithm called GSGD, based on preconditioned projected descent approach.
arXiv Detail & Related papers (2025-02-12T16:21:01Z) - Stochastic Variance-Reduced Iterative Hard Thresholding in Graph Sparsity Optimization [0.626226809683956]
We introduce two methods to solve gradient-based graph sparsity optimization: GraphRG-IHT and GraphSG-IHT.
We provide a general general for theoretical analysis, demonstrating that methods enjoy a gradient-based framework.
arXiv Detail & Related papers (2024-07-24T03:26:26Z) - Clusterpath Gaussian Graphical Modeling [0.0]
We introduce the Clusterpath estimator of the Gaussian Graphical Model (CGGM)<n>We group variables together, which in turn results in a block-structured precision matrix.<n>We show that CGGM not only matches, but oftentimes outperforms other state-of-the-art methods for variable clustering in graphical models.
arXiv Detail & Related papers (2024-06-30T10:11:18Z) - Learning Graphical Factor Models with Riemannian Optimization [70.13748170371889]
This paper proposes a flexible algorithmic framework for graph learning under low-rank structural constraints.
The problem is expressed as penalized maximum likelihood estimation of an elliptical distribution.
We leverage geometries of positive definite matrices and positive semi-definite matrices of fixed rank that are well suited to elliptical models.
arXiv Detail & Related papers (2022-10-21T13:19:45Z) - Optimal Propagation for Graph Neural Networks [51.08426265813481]
We propose a bi-level optimization approach for learning the optimal graph structure.
We also explore a low-rank approximation model for further reducing the time complexity.
arXiv Detail & Related papers (2022-05-06T03:37:00Z) - Cogradient Descent for Dependable Learning [64.02052988844301]
We propose a dependable learning based on Cogradient Descent (CoGD) algorithm to address the bilinear optimization problem.
CoGD is introduced to solve bilinear problems when one variable is with sparsity constraint.
It can also be used to decompose the association of features and weights, which further generalizes our method to better train convolutional neural networks (CNNs)
arXiv Detail & Related papers (2021-06-20T04:28:20Z) - Zeroth-Order Hybrid Gradient Descent: Towards A Principled Black-Box
Optimization Framework [100.36569795440889]
This work is on the iteration of zero-th-order (ZO) optimization which does not require first-order information.
We show that with a graceful design in coordinate importance sampling, the proposed ZO optimization method is efficient both in terms of complexity as well as as function query cost.
arXiv Detail & Related papers (2020-12-21T17:29:58Z) - Cogradient Descent for Bilinear Optimization [124.45816011848096]
We introduce a Cogradient Descent algorithm (CoGD) to address the bilinear problem.
We solve one variable by considering its coupling relationship with the other, leading to a synchronous gradient descent.
Our algorithm is applied to solve problems with one variable under the sparsity constraint.
arXiv Detail & Related papers (2020-06-16T13:41:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.