An N-Point Linear Solver for Line and Motion Estimation with Event Cameras
- URL: http://arxiv.org/abs/2404.00842v1
- Date: Mon, 1 Apr 2024 00:47:02 GMT
- Title: An N-Point Linear Solver for Line and Motion Estimation with Event Cameras
- Abstract summary: Event cameras respond primarily to edges--formed by strong gradients--that are well-suited for motion estimation.
Recent work has shown that events generated by single lines satisfy a novel constraint which describes a manifold in space-time volume.
We show that, with suitable line parametrization, this system of constraints is actually linear in the unknowns.
- Score: 45.67822962085412
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Event cameras respond primarily to edges--formed by strong gradients--and are thus particularly well-suited for line-based motion estimation. Recent work has shown that events generated by a single line each satisfy a polynomial constraint which describes a manifold in the space-time volume. Multiple such constraints can be solved simultaneously to recover the partial linear velocity and line parameters. In this work, we show that, with a suitable line parametrization, this system of constraints is actually linear in the unknowns, which allows us to design a novel linear solver. Unlike existing solvers, our linear solver (i) is fast and numerically stable since it does not rely on expensive root finding, (ii) can solve both minimal and overdetermined systems with more than 5 events, and (iii) admits the characterization of all degenerate cases and multiple solutions. The found line parameters are singularity-free and have a fixed scale, which eliminates the need for auxiliary constraints typically encountered in previous work. To recover the full linear camera velocity we fuse observations from multiple lines with a novel velocity averaging scheme that relies on a geometrically-motivated residual, and thus solves the problem more efficiently than previous schemes which minimize an algebraic residual. Extensive experiments in synthetic and real-world settings demonstrate that our method surpasses the previous work in numerical stability, and operates over 600 times faster.
Related papers
- A Scalable Approach to Solve the Carleman Linearized Burgers' Equation on a Quantum Computer [0.16311150636417257]
The Carleman linearization method has been proposed to transform a nonlinear ordinary differential equation into a linear system of equations.<n>Here, we address several major challenges enabling us to solve the Carleman linearized one-dimensional Burgers' equation on real and simulated quantum hardware.<n> circuits with a combined number of spatial and temporal discretization points totaling up to $280 approx 1024$ are transpiled onto real quantum hardware.
arXiv Detail & Related papers (2026-07-09T22:44:18Z) - A Convex Quasilinearization Method for Solving Nonlinear PDEs with Physics-Informed Neural Networks [0.0]
We present a numerical method for the forward solution of nonlinear partial differential equations (PDEs)<n>The method, LiL-Q, is assessed on seven benchmarks, including systems (planestrain elasticity and the incompressible Navier-Stokes equations in two and three dimensions) and steady flow with heterogeneous permeability.
arXiv Detail & Related papers (2026-06-16T17:09:59Z) - Quantum Algorithms for Nonlinear Differential Equations via Pivot-Shifted Carleman Linearization [3.4002853946164726]
We develop a pivot-shifted framework for quantum algorithms solving quadratic nonlinear ordinary differential equations.<n>By shifting the dynamics by a pivot state prior to Carleman lifting, we enlarge the class of nonlinear systems that can be efficiently simulated on quantum computers.
arXiv Detail & Related papers (2026-05-19T16:26:02Z) - Provably Efficient Quantum Algorithms for Solving Nonlinear Differential Equations Using Multiple Bosonic Modes Coupled with Qubits [9.366500214140164]
We present an analog, continuous-variable algorithm based on bosonic modes with qubit-based adaptive measurements that avoids Hilbert-space digitization.<n>Unlike many analog schemes, the algorithm is provably efficient: advancing a first-order, $L$-grid point, $d$-dimensional, order-$K$ spatial-derivative, degree-$r$-nonline.
arXiv Detail & Related papers (2025-11-13T04:09:32Z) - Variational Quantum Framework for Nonlinear PDE Constrained Optimization Using Carleman Linearization [0.8704964543257243]
We present a novel variational quantum framework for nonlinear partial differential equation (PDE) constrained optimization problems.
We use Carleman linearization (CL) to transform a system of ordinary differential equations into a system of infinite but linear system of ODE.
We present detailed computational error and complexity analysis and prove that under suitable assumptions, our proposed framework can provide potential advantage over classical techniques.
arXiv Detail & Related papers (2024-10-17T15:51:41Z) - Motion and Structure from Event-based Normal Flow [26.513167481193225]
Neuromorphic event-based cameras place great demands on approaches that use raw event data as input to solve this fundamental problem.
Existing state-of-the-art solutions typically infer implicitly data association by iteratively reversing the event data generation process.
We show that the event-based normal flow can be used, via the proposed geometric error term, as an alternative to the full flow in solving a family of geometric problems.
arXiv Detail & Related papers (2024-07-17T01:11:20Z) - A 5-Point Minimal Solver for Event Camera Relative Motion Estimation [47.45081895021988]
We introduce a novel minimal 5-point solver that estimates line parameters and linear camera velocity projections, which can be fused into a single, averaged linear velocity when considering multiple lines.
Our method consistently achieves a 100% success rate in estimating linear velocity where existing closed-form solvers only achieve between 23% and 70%.
arXiv Detail & Related papers (2023-09-29T08:30:18Z) - Constrained Optimization via Exact Augmented Lagrangian and Randomized
Iterative Sketching [55.28394191394675]
We develop an adaptive inexact Newton method for equality-constrained nonlinear, nonIBS optimization problems.
We demonstrate the superior performance of our method on benchmark nonlinear problems, constrained logistic regression with data from LVM, and a PDE-constrained problem.
arXiv Detail & Related papers (2023-05-28T06:33:37Z) - Message Passing Neural PDE Solvers [60.77761603258397]
We build a neural message passing solver, replacing allally designed components in the graph with backprop-optimized neural function approximators.
We show that neural message passing solvers representationally contain some classical methods, such as finite differences, finite volumes, and WENO schemes.
We validate our method on various fluid-like flow problems, demonstrating fast, stable, and accurate performance across different domain topologies, equation parameters, discretizations, etc., in 1D and 2D.
arXiv Detail & Related papers (2022-02-07T17:47:46Z) - Numerical Approximation of Partial Differential Equations by a Variable
Projection Method with Artificial Neural Networks [0.0]
We present a method for solving linear and nonlinear PDEs based on the variable projection (VarPro) framework and artificial neural networks (ANNs)
For linear PDEs, enforcing the boundary/initial value problem on the collocation points leads to a separable nonlinear least squares problem about the network coefficients.
We reformulate this problem by the VarPro approach to eliminate the linear output-layer coefficients, leading to a reduced problem about the hidden-layer coefficients only.
arXiv Detail & Related papers (2022-01-24T22:31:38Z) - Scaling the Convex Barrier with Sparse Dual Algorithms [141.4085318878354]
We present two novel dual algorithms for tight and efficient neural network bounding.
Both methods recover the strengths of the new relaxation: tightness and a linear separation oracle.
We can obtain better bounds than off-the-shelf solvers in only a fraction of their running time.
arXiv Detail & Related papers (2021-01-14T19:45:17Z) - Conditional gradient methods for stochastically constrained convex
minimization [54.53786593679331]
We propose two novel conditional gradient-based methods for solving structured convex optimization problems.
The most important feature of our framework is that only a subset of the constraints is processed at each iteration.
Our algorithms rely on variance reduction and smoothing used in conjunction with conditional gradient steps, and are accompanied by rigorous convergence guarantees.
arXiv Detail & Related papers (2020-07-07T21:26:35Z) - A Visual-inertial Navigation Method for High-Speed Unmanned Aerial
Vehicles [3.3366749199503807]
The paper investigates the localization problem of high-speed high-altitude unmanned aerial vehicle (UAV) with a monocular camera and inertial navigation system.
It proposes a navigation method utilizing the complementarity of vision and inertial devices to overcome the singularity which arises from the horizontal flight of UAV.
arXiv Detail & Related papers (2020-02-12T04:28:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.