MobileEgo Anywhere: Open Infrastructure for long horizon egocentric data on commodity hardware

• URL: http://arxiv.org/abs/2605.05945v4
• Date: Thu, 14 May 2026 07:57:22 GMT
• Title: MobileEgo Anywhere: Open Infrastructure for long horizon egocentric data on commodity hardware
• Abstract summary: MobileEgo Anywhere is a framework designed to facilitate the collection of robust, hour plus egocentric trajectories using commodity mobile hardware.<n>We release a novel dataset comprising 200 hours of diverse, long form egocentric data with persistent state tracking.<n>We provide a comprehensive processing pipeline to convert raw mobile captures into standardized, training ready formats for Vision Language Action model and foundation model research.
• Score: 0.35918066453136693
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The recent advancement of Vision Language Action (VLA) models has driven a critical demand for large scale egocentric datasets. However, existing datasets are often limited by short episode durations, typically spanning only a few minutes, which fails to capture the long horizon temporal dependencies necessary for complex robotic task execution. To bridge this gap, we present MobileEgo Anywhere, a framework designed to facilitate the collection of robust, hour plus egocentric trajectories using commodity mobile hardware. We leverage the ubiquitous sensor suites of modern smartphones to provide high fidelity, long term camera pose tracking, effectively removing the high hardware barriers associated with traditional robotics data collection. Our contributions are three fold: (1) we release a novel dataset comprising 200 hours of diverse, long form egocentric data with persistent state tracking; (2) we open source a mobile application that enables any user to record egocentric data, and (3) we provide a comprehensive processing pipeline to convert raw mobile captures into standardized, training ready formats for Vision Language Action model and foundation model research. By democratizing the data collection process, this work enables the massive scale acquisition of long horizon data across varied global environments, accelerating the development of generalizable robotic policies.

Related papers

• OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis [98.43366988856592]
  We present OpenMobile, an open-source framework that synthesizes high-quality task instructions and agent trajectories.<n>Agents trained on our data achieve competitive results across three dynamic mobile agent benchmarks.
  arXiv  Detail & Related papers  (2026-04-16T14:53:08Z)
• AoE: Always-on Egocentric Human Video Collection for Embodied AI [44.083451969789216]
  Embodied foundation models require large-scale, high-quality real-world interaction data for pre-training and scaling.<n>We propose the Always-on Egocentric (AoE) data collection system, which aims to simplify hardware dependencies by leveraging humans themselves and their smartphones.
  arXiv  Detail & Related papers  (2026-02-27T10:41:49Z)
• MobileManiBench: Simplifying Model Verification for Mobile Manipulation [70.30578259859512]
  MobileManiBench is a large-scale benchmark for mobile-based robotic manipulation.<n>MobileManiBench features 2 mobile platforms (parallel-gripper and dexterous-hand robots), 2 synchronized cameras (head and right wrist), 630 objects in 20 categories, 5 skills (open, close, pull, push, pick) with over 100 tasks performed in 100 realistic scenes, yielding 300K trajectories.
  arXiv  Detail & Related papers  (2026-02-05T02:49:52Z)
• AIRoA MoMa Dataset: A Large-Scale Hierarchical Dataset for Mobile Manipulation [27.07279683330287]
  AIRoA MoMa is a large-scale real-world multimodal dataset for mobile manipulation.<n>It includes synchronized RGB images, joint states, six-axis wrist force-torque signals, and internal robot states.<n>The initial dataset comprises 25,469 episodes collected with the Human Support Robot (HSR) and is fully standardized in the LeRobot v2.1 format.
  arXiv  Detail & Related papers  (2025-09-29T16:51:47Z)
• Real-Time Detection and Tracking of Foreign Object Intrusions in Power Systems via Feature-Based Edge Intelligence [4.60587070358843]
  This paper presents a novel framework for real-time foreign object intrusion (FOI) detection and tracking in power transmission systems.<n>The framework integrates: (1) a YOLOv7 segmentation model for fast and robust object localization, (2) a ConvNeXt-based feature extractor trained with triplet loss to generate discriminative embeddings, and (3) a feature-assisted IoU tracker.<n>To enable scalable field deployment, the pipeline is optimized for deployment on low-cost edge hardware using mixed-precision inference.
  arXiv  Detail & Related papers  (2025-09-16T17:17:03Z)
• InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation [54.09384502044162]
  We introduce InterAct, a large-scale 3D HOI benchmark featuring dataset and methodological advancements.<n>First, we consolidate and standardize 21.81 hours of HOI data from diverse sources, enriching it with detailed textual annotations.<n>Second, we propose a unified optimization framework to enhance data quality by reducing artifacts and correcting hand motions.<n>Third, we define six benchmarking tasks and develop a unified HOI generative modeling perspective, achieving state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-09-11T15:43:54Z)
• Learning Primitive Embodied World Models: Towards Scalable Robotic Learning [50.32986780156215]
  We propose a novel paradigm for world modeling--Primitive Embodied World Models (PEWM)<n>By restricting video generation to fixed short horizons, our approach enables fine-grained alignment between linguistic concepts and visual representations of robotic actions.<n>Our framework bridges the gap between fine-grained physical interaction and high-level reasoning, paving the way toward scalable, interpretable, and general-purpose embodied intelligence.
  arXiv  Detail & Related papers  (2025-08-28T14:31:48Z)
• ROVR-Open-Dataset: A Large-Scale Depth Dataset for Autonomous Driving [62.9051914830949]
  We present ROVR, a large-scale, diverse, and cost-efficient depth dataset designed to capture the complexity of real-world driving.<n>A lightweight acquisition pipeline ensures scalable collection, while sparse but statistically sufficient ground truth supports robust training.<n> Benchmarking with state-of-the-art monocular depth models reveals severe cross-dataset generalization failures.
  arXiv  Detail & Related papers  (2025-08-19T16:13:49Z)
• Scalable Video-to-Dataset Generation for Cross-Platform Mobile Agents [57.59830804627066]
  We introduce MONDAY, a large-scale dataset of 313K annotated frames from 20K instructional videos capturing real-world mobile OS navigation.<n>Models that include MONDAY in their pre-training phases demonstrate robust cross-platform generalization capabilities.<n>We present an automated framework that leverages publicly available video content to create comprehensive task datasets.
  arXiv  Detail & Related papers  (2025-05-19T02:39:03Z)
• UniMTS: Unified Pre-training for Motion Time Series [32.419834492563155]
  We introduce UniMTS, the first unified pre-training procedure for motion time series. We employ a contrastive learning framework that aligns motion time series with text descriptions enriched by large language models. Our model shows exceptional generalizability across 18 motion time series classification benchmark datasets.
  arXiv  Detail & Related papers  (2024-10-18T06:39:13Z)
• EgoTracks: A Long-term Egocentric Visual Object Tracking Dataset [19.496721051685135]
  Embodied tracking is a key component to many egocentric vision problems. EgoTracks is a new dataset for long-term egocentric visual object tracking. We show improvements that can be made to a STARK tracker to significantly increase its performance on egocentric data.
  arXiv  Detail & Related papers  (2023-01-09T09:10:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.