Local Algorithms for Estimating Effective Resistance
- URL: http://arxiv.org/abs/2106.03476v1
- Date: Mon, 7 Jun 2021 10:08:12 GMT
- Title: Local Algorithms for Estimating Effective Resistance
- Authors: Pan Peng, Daniel Lopatta, Yuichi Yoshida, Gramoz Goranci
- Abstract summary: In this work, we design several emphlocal algorithms for estimating effective resistances on massive graphs.
Our main algorithm approximates the effective resistance between any vertices pair $s,t$ with an arbitrarily small additive error.
We perform an extensive empirical study on several benchmark datasets, validating our algorithms.
- Score: 26.54556748340991
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Effective resistance is an important metric that measures the similarity of
two vertices in a graph. It has found applications in graph clustering,
recommendation systems and network reliability, among others. In spite of the
importance of the effective resistances, we still lack efficient algorithms to
exactly compute or approximate them on massive graphs.
In this work, we design several \emph{local algorithms} for estimating
effective resistances, which are algorithms that only read a small portion of
the input while still having provable performance guarantees. To illustrate,
our main algorithm approximates the effective resistance between any vertex
pair $s,t$ with an arbitrarily small additive error $\varepsilon$ in time
$O(\mathrm{poly}(\log n/\varepsilon))$, whenever the underlying graph has
bounded mixing time. We perform an extensive empirical study on several
benchmark datasets, validating the performance of our algorithms.
Related papers
- Addressing Noise and Efficiency Issues in Graph-Based Machine Learning
Models From the Perspective of Adversarial Attack [2.1937382384136637]
We propose treating noisy edges as adversarial attack and use a spectral adversarial robustness evaluation method to diminish the impact of noisy edges on the performance of graph algorithms.
Our method identifies those points that are less vulnerable to noisy edges and leverages only these robust points to perform graph-based algorithms.
arXiv Detail & Related papers (2024-01-28T10:03:37Z) - Efficient Graph Field Integrators Meet Point Clouds [59.27295475120132]
We present two new classes of algorithms for efficient field integration on graphs encoding point clouds.
The first class, SeparatorFactorization(SF), leverages the bounded genus of point cloud mesh graphs, while the second class, RFDiffusion(RFD), uses popular epsilon-nearest-neighbor graph representations for point clouds.
arXiv Detail & Related papers (2023-02-02T08:33:36Z) - Scalable and Effective Conductance-based Graph Clustering [9.938406925123722]
We develop a graph clustering framework textitPCon.
We show that many existing solutions can be reduced to our framework.
Based on our framework, we propose two novel algorithms textitPCon_core and emphPCon_de with linear time and space complexity.
arXiv Detail & Related papers (2022-11-22T12:45:27Z) - Efficient Dataset Distillation Using Random Feature Approximation [109.07737733329019]
We propose a novel algorithm that uses a random feature approximation (RFA) of the Neural Network Gaussian Process (NNGP) kernel.
Our algorithm provides at least a 100-fold speedup over KIP and can run on a single GPU.
Our new method, termed an RFA Distillation (RFAD), performs competitively with KIP and other dataset condensation algorithms in accuracy over a range of large-scale datasets.
arXiv Detail & Related papers (2022-10-21T15:56:13Z) - Communication-Efficient Adam-Type Algorithms for Distributed Data Mining [93.50424502011626]
We propose a class of novel distributed Adam-type algorithms (emphi.e., SketchedAMSGrad) utilizing sketching.
Our new algorithm achieves a fast convergence rate of $O(frac1sqrtnT + frac1(k/d)2 T)$ with the communication cost of $O(k log(d))$ at each iteration.
arXiv Detail & Related papers (2022-10-14T01:42:05Z) - A Fast PC Algorithm with Reversed-order Pruning and A Parallelization
Strategy [22.31288740171446]
The PC algorithm is the state-of-the-art algorithm for causal structure discovery on observational data.
It can be computationally expensive in the worst case due to the conditional independence tests are performed.
This makes the algorithm computationally intractable when the task contains several hundred or thousand nodes.
We propose a critical observation that the conditional set rendering two nodes independent is non-unique, and including certain redundant nodes do not sacrifice result accuracy.
arXiv Detail & Related papers (2021-09-10T02:22:10Z) - Large-Scale Network Embedding in Apache Spark [1.3769786711365102]
We propose an efficient and effective distributed algorithm for network embedding on large graphs using Apache Spark.
We demonstrate in various experiments that our proposed approach is able to handle graphs with billions of edges within a few hours and is at least 4 times faster than the state-of-the-art approaches.
arXiv Detail & Related papers (2021-06-20T04:42:24Z) - Efficient Computation of Expectations under Spanning Tree Distributions [67.71280539312536]
We propose unified algorithms for the important cases of first-order expectations and second-order expectations in edge-factored, non-projective spanning-tree models.
Our algorithms exploit a fundamental connection between gradients and expectations, which allows us to derive efficient algorithms.
arXiv Detail & Related papers (2020-08-29T14:58:26Z) - Online Dense Subgraph Discovery via Blurred-Graph Feedback [87.9850024070244]
We introduce a novel learning problem for dense subgraph discovery.
We first propose a edge-time algorithm that obtains a nearly-optimal solution with high probability.
We then design a more scalable algorithm with a theoretical guarantee.
arXiv Detail & Related papers (2020-06-24T11:37:33Z) - Fast Graph Attention Networks Using Effective Resistance Based Graph
Sparsification [70.50751397870972]
FastGAT is a method to make attention based GNNs lightweight by using spectral sparsification to generate an optimal pruning of the input graph.
We experimentally evaluate FastGAT on several large real world graph datasets for node classification tasks.
arXiv Detail & Related papers (2020-06-15T22:07:54Z) - A Study of Performance of Optimal Transport [16.847501106437534]
We show that network simplex and augmenting path based algorithms can consistently outperform numerical matrix-scaling based methods.
We present a new algorithm that improves upon the classical Kuhn-Munkres algorithm.
arXiv Detail & Related papers (2020-05-03T20:37:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.