Learning Efficient Meshflow and Optical Flow from Event Cameras

• URL: http://arxiv.org/abs/2510.04111v1
• Date: Sun, 05 Oct 2025 09:30:59 GMT
• Title: Learning Efficient Meshflow and Optical Flow from Event Cameras
• Authors: Xinglong Luo, Ao Luo, Kunming Luo, Zhengning Wang, Ping Tan, Bing Zeng, Shuaicheng Liu,
• Abstract summary: Event-based meshflow estimation is a novel task that involves predicting a spatially smooth sparse motion field from event cameras.<n>We propose Efficient Event-based MeshFlow network, a lightweight model featuring a specially crafted encoder-decoder architecture.<n>We conduct comprehensive experiments to show the exceptional performance and runtime efficiency (30x faster) of our EEMFlow model compared to the recent state-of-the-art flow method.
• Score: 89.06553762828521
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we explore the problem of event-based meshflow estimation, a novel task that involves predicting a spatially smooth sparse motion field from event cameras. To start, we review the state-of-the-art in event-based flow estimation, highlighting two key areas for further research: i) the lack of meshflow-specific event datasets and methods, and ii) the underexplored challenge of event data density. First, we generate a large-scale High-Resolution Event Meshflow (HREM) dataset, which showcases its superiority by encompassing the merits of high resolution at 1280x720, handling dynamic objects and complex motion patterns, and offering both optical flow and meshflow labels. These aspects have not been fully explored in previous works. Besides, we propose Efficient Event-based MeshFlow (EEMFlow) network, a lightweight model featuring a specially crafted encoder-decoder architecture to facilitate swift and accurate meshflow estimation. Furthermore, we upgrade EEMFlow network to support dense event optical flow, in which a Confidence-induced Detail Completion (CDC) module is proposed to preserve sharp motion boundaries. We conduct comprehensive experiments to show the exceptional performance and runtime efficiency (30x faster) of our EEMFlow model compared to the recent state-of-the-art flow method. As an extension, we expand HREM into HREM+, a multi-density event dataset contributing to a thorough study of the robustness of existing methods across data with varying densities, and propose an Adaptive Density Module (ADM) to adjust the density of input event data to a more optimal range, enhancing the model's generalization ability. We empirically demonstrate that ADM helps to significantly improve the performance of EEMFlow and EEMFlow+ by 8% and 10%, respectively. Code and dataset are released at https://github.com/boomluo02/EEMFlowPlus.

Related papers

• EDCFlow: Exploring Temporally Dense Difference Maps for Event-based Optical Flow Estimation [17.388776062997813]
  We present a lightweight event-based optical flow network (EDCFlow) to achieve high-quality flow estimation at a higher resolution.<n>EDCFlow achieves better performance with lower complexity compared to existing methods, offering superior generalization.
  arXiv  Detail & Related papers  (2025-06-04T02:55:04Z)
• Event Signal Filtering via Probability Flux Estimation [58.31652473933809]
  Events offer a novel paradigm for capturing scene dynamics via asynchronous sensing, but their inherent randomness often leads to degraded signal quality.<n>Event signal filtering is thus essential for enhancing fidelity by reducing this internal randomness and ensuring consistent outputs across diverse acquisition conditions.<n>This paper introduces a generative, online filtering framework called Event Density Flow Filter (EDFilter)<n>Experiments validate EDFilter's performance across tasks like event filtering, super-resolution, and direct event-based blob tracking.
  arXiv  Detail & Related papers  (2025-04-10T07:03:08Z)
• FlowTS: Time Series Generation via Rectified Flow [67.41208519939626]
  FlowTS is an ODE-based model that leverages rectified flow with straight-line transport in probability space.<n>For unconditional setting, FlowTS achieves state-of-the-art performance, with context FID scores of 0.019 and 0.011 on Stock and ETTh datasets.<n>For conditional setting, we have achieved superior performance in solar forecasting.
  arXiv  Detail & Related papers  (2024-11-12T03:03:23Z)
• SimulFlow: Simultaneously Extracting Feature and Identifying Target for Unsupervised Video Object Segmentation [28.19471998380114]
  Unsupervised video object segmentation (UVOS) aims at detecting the primary objects in a given video sequence without any human interposing. Most existing methods rely on two-stream architectures that separately encode the appearance and motion information before fusing them to identify the target and generate object masks. We propose a novel UVOS model called SimulFlow that simultaneously performs feature extraction and target identification.
  arXiv  Detail & Related papers  (2023-11-30T06:44:44Z)
• AnyFlow: Arbitrary Scale Optical Flow with Implicit Neural Representation [17.501820140334328]
  We introduce AnyFlow, a robust network that estimates accurate flow from images of various resolutions. We establish a new state-of-the-art performance of cross-dataset generalization on the KITTI dataset.
  arXiv  Detail & Related papers  (2023-03-29T07:03:51Z)
• BlinkFlow: A Dataset to Push the Limits of Event-based Optical Flow Estimation [76.66876888943385]
  Event cameras provide high temporal precision, low data rates, and high dynamic range visual perception. We present a novel simulator, BlinkSim, for the fast generation of large-scale data for event-based optical flow.
  arXiv  Detail & Related papers  (2023-03-14T09:03:54Z)
• GMFlow: Learning Optical Flow via Global Matching [124.57850500778277]
  We propose a GMFlow framework for learning optical flow estimation. It consists of three main components: a customized Transformer for feature enhancement, a correlation and softmax layer for global feature matching, and a self-attention layer for flow propagation. Our new framework outperforms 32-iteration RAFT's performance on the challenging Sintel benchmark.
  arXiv  Detail & Related papers  (2021-11-26T18:59:56Z)
• EMFlow: Data Imputation in Latent Space via EM and Deep Flow Models [5.076419064097734]
  We introduce an imputation approach, called EMFlow, that performs imputation in a latent space via an online version of Expectation-Maximization algorithm. The proposed EMFlow has superior performance to competing methods in terms of both imputation quality and convergence speed.
  arXiv  Detail & Related papers  (2021-06-09T04:35:56Z)
• Learning Monocular Dense Depth from Events [53.078665310545745]
  Event cameras produce brightness changes in the form of a stream of asynchronous events instead of intensity frames. Recent learning-based approaches have been applied to event-based data, such as monocular depth prediction. We propose a recurrent architecture to solve this task and show significant improvement over standard feed-forward methods.
  arXiv  Detail & Related papers  (2020-10-16T12:36:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.