Efficient Algorithms for Rotation Averaging Problems
- URL: http://arxiv.org/abs/2103.10024v1
- Date: Thu, 18 Mar 2021 05:22:45 GMT
- Title: Efficient Algorithms for Rotation Averaging Problems
- Authors: Yihong Dong, Lunchen Xie and Qingjiang Shi
- Abstract summary: The averaging problem is a fundamental task in computer applications.
We propose a block-based averaging algorithm with guaranteed convergence to stationary points.
We also propose an alternative averaging algorithm by applying upper-bound minimization.
- Score: 17.101725065752486
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The rotation averaging problem is a fundamental task in computer vision
applications. It is generally very difficult to solve due to the nonconvex
rotation constraints. While a sufficient optimality condition is available in
the literature, there is a lack of \yhedit{a} fast convergent algorithm to
achieve stationary points. In this paper, by exploring the problem structure,
we first propose a block coordinate descent (BCD)-based rotation averaging
algorithm with guaranteed convergence to stationary points. Afterwards, we
further propose an alternative rotation averaging algorithm by applying
successive upper-bound minimization (SUM) method. The SUM-based rotation
averaging algorithm can be implemented in parallel and thus is more suitable
for addressing large-scale rotation averaging problems. Numerical examples
verify that the proposed rotation averaging algorithms have superior
convergence performance as compared to the state-of-the-art algorithm.
Moreover, by checking the sufficient optimality condition, we find from
extensive numerical experiments that the proposed two algorithms can achieve
globally optimal solutions.
Related papers
- Accelerating Cutting-Plane Algorithms via Reinforcement Learning
Surrogates [49.84541884653309]
A current standard approach to solving convex discrete optimization problems is the use of cutting-plane algorithms.
Despite the existence of a number of general-purpose cut-generating algorithms, large-scale discrete optimization problems continue to suffer from intractability.
We propose a method for accelerating cutting-plane algorithms via reinforcement learning.
arXiv Detail & Related papers (2023-07-17T20:11:56Z) - Efficient and Accurate Optimal Transport with Mirror Descent and
Conjugate Gradients [15.128885770407132]
We design a novel algorithm for optimal transport by drawing from the entropic optimal transport, mirror descent and conjugate gradients literatures.
Our scalable and GPU parallelizable algorithm is able to compute the Wasserstein distance with extreme precision, reaching relative error rates of $10-8$ without numerical stability issues.
arXiv Detail & Related papers (2023-07-17T14:09:43Z) - Fast Computation of Optimal Transport via Entropy-Regularized Extragradient Methods [75.34939761152587]
Efficient computation of the optimal transport distance between two distributions serves as an algorithm that empowers various applications.
This paper develops a scalable first-order optimization-based method that computes optimal transport to within $varepsilon$ additive accuracy.
arXiv Detail & Related papers (2023-01-30T15:46:39Z) - PROMPT: Parallel Iterative Algorithm for $\ell_{p}$ norm linear
regression via Majorization Minimization with an application to
semi-supervised graph learning [0.0]
We consider the problem of $ell_p$ norm linear regression, which has several applications such as in sparse recovery, data clustering, and semi-supervised learning.
We propose an iterative algorithm : Parallel IteRative AlgOrithM for $ell_P$ norm regression via MajorizaTion Minimization (PROMPT)
arXiv Detail & Related papers (2021-10-23T10:19:11Z) - Provably Faster Algorithms for Bilevel Optimization [54.83583213812667]
Bilevel optimization has been widely applied in many important machine learning applications.
We propose two new algorithms for bilevel optimization.
We show that both algorithms achieve the complexity of $mathcalO(epsilon-1.5)$, which outperforms all existing algorithms by the order of magnitude.
arXiv Detail & Related papers (2021-06-08T21:05:30Z) - Lower Bounds and Optimal Algorithms for Smooth and Strongly Convex
Decentralized Optimization Over Time-Varying Networks [79.16773494166644]
We consider the task of minimizing the sum of smooth and strongly convex functions stored in a decentralized manner across the nodes of a communication network.
We design two optimal algorithms that attain these lower bounds.
We corroborate the theoretical efficiency of these algorithms by performing an experimental comparison with existing state-of-the-art methods.
arXiv Detail & Related papers (2021-06-08T15:54:44Z) - Rotation Coordinate Descent for Fast Globally Optimal Rotation Averaging [47.3713707521106]
We present a fast algorithm that achieves global optimality called rotation coordinate descent (RCD)
Unlike block coordinate descent (BCD) which solves SDP by updating the semidefinite matrix in a row-by-row fashion, RCD directly maintains and updates all valid rotations throughout the iterations.
We mathematically prove the convergence of our algorithm and empirically show its superior efficiency over state-of-the-art global methods.
arXiv Detail & Related papers (2021-03-15T11:31:34Z) - A Two-Timescale Framework for Bilevel Optimization: Complexity Analysis
and Application to Actor-Critic [142.1492359556374]
Bilevel optimization is a class of problems which exhibit a two-level structure.
We propose a two-timescale approximation (TTSA) algorithm for tackling such a bilevel problem.
We show that a two-timescale natural actor-critic policy optimization algorithm can be viewed as a special case of our TTSA framework.
arXiv Detail & Related papers (2020-07-10T05:20:02Z) - Optimal and Practical Algorithms for Smooth and Strongly Convex
Decentralized Optimization [21.555331273873175]
We consider the task of decentralized minimization of the sum of smooth strongly convex functions stored across the nodes of a network.
We propose two new algorithms for this decentralized optimization problem and equip them with complexity guarantees.
arXiv Detail & Related papers (2020-06-21T11:23:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.