Matrix hypercontractivity, streaming algorithms and LDCs: the large
alphabet case
- URL: http://arxiv.org/abs/2109.02600v2
- Date: Tue, 21 Feb 2023 04:52:35 GMT
- Title: Matrix hypercontractivity, streaming algorithms and LDCs: the large
alphabet case
- Authors: Srinivasan Arunachalam, Jo\~ao F. Doriguello
- Abstract summary: We prove a hypercontractive inequality for matrix-valued functions defined over large alphabets.
We show that every streaming algorithm in the adversarial model achieving a $(r-varepsilon)$-approximation requires $Omega(n1-2/t)$ quantum space.
- Score: 5.88864611435337
- License: http://creativecommons.org/publicdomain/zero/1.0/
- Abstract: We prove a hypercontractive inequality for matrix-valued functions defined
over large alphabets, generalizing the result of Ben-Aroya, Regev, de Wolf
(FOCS'08) for the Boolean alphabet. For such we prove a generalization of the
$2$-uniform convexity inequality of Ball, Carlen, Lieb (Inventiones
Mathematicae'94). Using our inequality, we present upper and lower bounds for
the communication complexity of Hidden Hypermatching when defined over large
alphabets, which generalizes the well-known Boolean Hidden Matching problem. We
then consider streaming algorithms for approximating the value of Unique Games
on a $t$-hyperedge hypergraph: an edge-counting argument gives an
$r$-approximation with $O(\log{n})$ space. On the other hand, via our
communication lower bound we show that every streaming algorithm in the
adversarial model achieving a $(r-\varepsilon)$-approximation requires
$\Omega(n^{1-2/t})$ quantum space. This generalizes the seminal work of
Kapralov, Khanna, Sudan (SODA'15), and expand to the quantum setting results
from Kapralov, Krachun (STOC'19) and Chou et al. (STOC'22).
We next present a lower bound for locally decodable codes ($\mathsf{LDC}$)
over large alphabets. An $\mathsf{LDC}$ $C:\mathbb{Z}_r^n\to \mathbb{Z}_r^N$ is
an encoding of $x$ into a codeword in such a way that one can recover an
arbitrary $x_i$ (with probability at least $1/r+\varepsilon$) by making a few
queries to a corrupted codeword. The main question here is the trade-off
between $N$ and $n$. Via hypercontractivity, we give an exponential lower bound
$N= 2^{\Omega(\varepsilon^4 n/r^4)}$ for $2$-query (possibly non-linear)
$\mathsf{LDC}$s over $\mathbb{Z}_r$ and using the non-commutative Khintchine
inequality we improved our bound to $N= 2^{\Omega(\varepsilon^2 n/r^2)}$.
Previously exponential lower bounds were known for $r=2$ (Kerenidis, de Wolf
(JCSS'04)) and linear codes (Dvir, Shpilka (SICOMP'07)).
Related papers
- The Communication Complexity of Approximating Matrix Rank [50.6867896228563]
We show that this problem has randomized communication complexity $Omega(frac1kcdot n2log|mathbbF|)$.
As an application, we obtain an $Omega(frac1kcdot n2log|mathbbF|)$ space lower bound for any streaming algorithm with $k$ passes.
arXiv Detail & Related papers (2024-10-26T06:21:42Z) - Sample-Efficient Linear Regression with Self-Selection Bias [7.605563562103568]
We consider the problem of linear regression with self-selection bias in the unknown-index setting.
We provide a novel and near optimally sample-efficient (in terms of $k$) algorithm to recover $mathbfw_1,ldots,mathbfw_kin.
Our algorithm succeeds under significantly relaxed noise assumptions, and therefore also succeeds in the related setting of max-linear regression.
arXiv Detail & Related papers (2024-02-22T02:20:24Z) - Fast swap regret minimization and applications to approximate correlated
equilibria [20.047624953965965]
For any constant $varepsilon>0$, our algorithm obtains $varepsilon T$-swap regret within only $T = mathsfpolylog(n)$ rounds.
Our algorithm has an exponential dependence on $varepsilon$, but we prove a new, matching lower bound.
arXiv Detail & Related papers (2023-10-30T15:35:24Z) - Fast $(1+\varepsilon)$-Approximation Algorithms for Binary Matrix
Factorization [54.29685789885059]
We introduce efficient $(1+varepsilon)$-approximation algorithms for the binary matrix factorization (BMF) problem.
The goal is to approximate $mathbfA$ as a product of low-rank factors.
Our techniques generalize to other common variants of the BMF problem.
arXiv Detail & Related papers (2023-06-02T18:55:27Z) - Learning a Single Neuron with Adversarial Label Noise via Gradient
Descent [50.659479930171585]
We study a function of the form $mathbfxmapstosigma(mathbfwcdotmathbfx)$ for monotone activations.
The goal of the learner is to output a hypothesis vector $mathbfw$ that $F(mathbbw)=C, epsilon$ with high probability.
arXiv Detail & Related papers (2022-06-17T17:55:43Z) - Exponential Separation between Quantum and Classical Ordered Binary
Decision Diagrams, Reordering Method and Hierarchies [68.93512627479197]
We study quantum Ordered Binary Decision Diagrams($OBDD$) model.
We prove lower bounds and upper bounds for OBDD with arbitrary order of input variables.
We extend hierarchy for read$k$-times Ordered Binary Decision Diagrams ($k$-OBDD$) of width.
arXiv Detail & Related papers (2022-04-22T12:37:56Z) - Degree vs. Approximate Degree and Quantum Implications of Huang's
Sensitivity Theorem [4.549831511476248]
We show that for any total Boolean function $f$, $bullet quad mathrmdeg(f) = O(widetildemathrmdeg(f)2)$: The degree of $f$ is at mosttrivial quadratic in the approximate degree of $f$.
We show that if $f$ is a non monotone graph property of an $n$-vertex graph specified by its adjacency matrix, then $mathrmQ(f)=Omega(n)$, which is also optimal.
arXiv Detail & Related papers (2020-10-23T19:21:28Z) - An Optimal Separation of Randomized and Quantum Query Complexity [67.19751155411075]
We prove that for every decision tree, the absolute values of the Fourier coefficients of a given order $ellsqrtbinomdell (1+log n)ell-1,$ sum to at most $cellsqrtbinomdell (1+log n)ell-1,$ where $n$ is the number of variables, $d$ is the tree depth, and $c>0$ is an absolute constant.
arXiv Detail & Related papers (2020-08-24T06:50:57Z) - A Direct Product Theorem for One-Way Quantum Communication [6.891238879512672]
We prove a direct product theorem for the one-way entanglement-assisted quantum communication complexity of a general relation $fsubseteqmathcalXtimesmathcalYtimesmathcalZ$.
As far as we are aware, this is the first direct product theorem for quantum communication.
arXiv Detail & Related papers (2020-08-20T13:31:41Z) - Tight Quantum Lower Bound for Approximate Counting with Quantum States [49.6558487240078]
We prove tight lower bounds for the following variant of the counting problem considered by Aaronson, Kothari, Kretschmer, and Thaler ( 2020)
The task is to distinguish whether an input set $xsubseteq [n]$ has size either $k$ or $k'=(1+varepsilon)k$.
arXiv Detail & Related papers (2020-02-17T10:53:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.