Metricizing the Euclidean Space towards Desired Distance Relations in
Point Clouds
- URL: http://arxiv.org/abs/2211.03674v2
- Date: Tue, 25 Apr 2023 17:33:43 GMT
- Title: Metricizing the Euclidean Space towards Desired Distance Relations in
Point Clouds
- Authors: Stefan Rass, Sandra K\"onig, Shahzad Ahmad, Maksim Goman
- Abstract summary: We attack unsupervised learning algorithms, specifically $k$-Means and density-based (DBSCAN) clustering algorithms.
We show that the results of clustering algorithms may not generally be trustworthy, unless there is a standardized and fixed prescription to use a specific distance function.
- Score: 1.2366208723499545
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Given a set of points in the Euclidean space $\mathbb{R}^\ell$ with $\ell>1$,
the pairwise distances between the points are determined by their spatial
location and the metric $d$ that we endow $\mathbb{R}^\ell$ with. Hence, the
distance $d(\mathbf x,\mathbf y)=\delta$ between two points is fixed by the
choice of $\mathbf x$ and $\mathbf y$ and $d$. We study the related problem of
fixing the value $\delta$, and the points $\mathbf x,\mathbf y$, and ask if
there is a topological metric $d$ that computes the desired distance $\delta$.
We demonstrate this problem to be solvable by constructing a metric to
simultaneously give desired pairwise distances between up to $O(\sqrt\ell)$
many points in $\mathbb{R}^\ell$. We then introduce the notion of an
$\varepsilon$-semimetric $\tilde{d}$ to formulate our main result: for all
$\varepsilon>0$, for all $m\geq 1$, for any choice of $m$ points $\mathbf
y_1,\ldots,\mathbf y_m\in\mathbb{R}^\ell$, and all chosen sets of values
$\{\delta_{ij}\geq 0: 1\leq i<j\leq m\}$, there exists an
$\varepsilon$-semimetric $\tilde{\delta}:\mathbb{R}^\ell\times
\mathbb{R}^\ell\to\mathbb{R}$ such that $\tilde{d}(\mathbf y_i,\mathbf
y_j)=\delta_{ij}$, i.e., the desired distances are accomplished, irrespectively
of the topology that the Euclidean or other norms would induce. We showcase our
results by using them to attack unsupervised learning algorithms, specifically
$k$-Means and density-based (DBSCAN) clustering algorithms. These have manifold
applications in artificial intelligence, and letting them run with externally
provided distance measures constructed in the way as shown here, can make
clustering algorithms produce results that are pre-determined and hence
malleable. This demonstrates that the results of clustering algorithms may not
generally be trustworthy, unless there is a standardized and fixed prescription
to use a specific distance function.
Related papers
- The Communication Complexity of Approximating Matrix Rank [50.6867896228563]
We show that this problem has randomized communication complexity $Omega(frac1kcdot n2log|mathbbF|)$.
As an application, we obtain an $Omega(frac1kcdot n2log|mathbbF|)$ space lower bound for any streaming algorithm with $k$ passes.
arXiv Detail & Related papers (2024-10-26T06:21:42Z) - Optimal Estimator for Linear Regression with Shuffled Labels [17.99906229036223]
This paper considers the task of linear regression with shuffled labels.
$mathbf Y in mathbb Rntimes m, mathbf Pi in mathbb Rntimes p, mathbf B in mathbb Rptimes m$, and $mathbf Win mathbb Rntimes m$, respectively.
arXiv Detail & Related papers (2023-10-02T16:44:47Z) - For Kernel Range Spaces a Constant Number of Queries Are Sufficient [13.200502573462712]
A kernel range space concerns a set of points $X subset mathbbRd$ and the space of all queries by a fixed kernel.
Anvarepsilon$-cover is a subset of points $Q subset mathbbRd$ for any $p in mathbbRd$ that $frac1n |R_p - R_q|leq varepsilon$ for some $q in Q$.
arXiv Detail & Related papers (2023-06-28T19:19:33Z) - Fast $(1+\varepsilon)$-Approximation Algorithms for Binary Matrix
Factorization [54.29685789885059]
We introduce efficient $(1+varepsilon)$-approximation algorithms for the binary matrix factorization (BMF) problem.
The goal is to approximate $mathbfA$ as a product of low-rank factors.
Our techniques generalize to other common variants of the BMF problem.
arXiv Detail & Related papers (2023-06-02T18:55:27Z) - Learning a Single Neuron with Adversarial Label Noise via Gradient
Descent [50.659479930171585]
We study a function of the form $mathbfxmapstosigma(mathbfwcdotmathbfx)$ for monotone activations.
The goal of the learner is to output a hypothesis vector $mathbfw$ that $F(mathbbw)=C, epsilon$ with high probability.
arXiv Detail & Related papers (2022-06-17T17:55:43Z) - Spectral properties of sample covariance matrices arising from random
matrices with independent non identically distributed columns [50.053491972003656]
It was previously shown that the functionals $texttr(AR(z))$, for $R(z) = (frac1nXXT- zI_p)-1$ and $Ain mathcal M_p$ deterministic, have a standard deviation of order $O(|A|_* / sqrt n)$.
Here, we show that $|mathbb E[R(z)] - tilde R(z)|_F
arXiv Detail & Related papers (2021-09-06T14:21:43Z) - Threshold Phenomena in Learning Halfspaces with Massart Noise [56.01192577666607]
We study the problem of PAC learning halfspaces on $mathbbRd$ with Massart noise under Gaussian marginals.
Our results qualitatively characterize the complexity of learning halfspaces in the Massart model.
arXiv Detail & Related papers (2021-08-19T16:16:48Z) - Locally Private $k$-Means Clustering with Constant Multiplicative
Approximation and Near-Optimal Additive Error [10.632986841188]
We bridge the gap between the exponents of $n$ in the upper and lower bounds on the additive error with two new algorithms.
It is possible to solve the locally private $k$-means problem in a constant number of rounds with constant factor multiplicative approximation.
arXiv Detail & Related papers (2021-05-31T14:41:40Z) - Approximating the Riemannian Metric from Point Clouds via Manifold
Moving Least Squares [2.2774471443318753]
We present a naive algorithm that yields approximate geodesic distances with a rate of convergence $ O(h) $ provable approximations.
We show the potential and the robustness to noise of the proposed method on some numerical simulations.
arXiv Detail & Related papers (2020-07-20T04:42:17Z) - The Average-Case Time Complexity of Certifying the Restricted Isometry
Property [66.65353643599899]
In compressed sensing, the restricted isometry property (RIP) on $M times N$ sensing matrices guarantees efficient reconstruction of sparse vectors.
We investigate the exact average-case time complexity of certifying the RIP property for $Mtimes N$ matrices with i.i.d. $mathcalN(0,1/M)$ entries.
arXiv Detail & Related papers (2020-05-22T16:55:01Z) - Sets Clustering [25.358415142404752]
We prove that a core-set of $O(logn)$ sets always exists, and can be computed in $O(nlogn)$ time.
Applying an inefficient but optimal algorithm on this coreset allows us to obtain the first PTAS ($1+varepsilon$ approximation) for the sets-$k$-means problem.
Open source code and experimental results for document classification and facility locations are also provided.
arXiv Detail & Related papers (2020-03-09T13:30:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.