Learning a System-Level Surrogate for Hydraulic Excavators: A Simulation-to-Real LSTM Approach
- URL: http://arxiv.org/abs/2607.15656v1
- Date: Fri, 17 Jul 2026 06:04:08 GMT
- Title: Learning a System-Level Surrogate for Hydraulic Excavators: A Simulation-to-Real LSTM Approach
- Abstract summary: This paper proposes a simulation-to-real framework for learning a system-level digital surrogate.<n>Instead of modeling internal dynamics, the excavator is treated as an input-output operator.<n>The proposed model can serve as a drop-in surrogate for both simulation and physical systems.
- Score: 19.924870252624647
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Developing autonomous hydraulic excavators is constrained by limited access to physical machines and the high cost of real-world experimentation. This paper proposes a simulation-to-real framework for learning a system-level digital surrogate using Long Short-Term Memory (LSTM) networks. Instead of modeling internal dynamics, the excavator is treated as an input-output operator, and the surrogate is trained to reproduce its closed-loop behavior under identical control inputs. The approach is first validated in a MuJoCo simulation environment and then transferred to a real excavator. To address measurement inconsistencies in real-world data, a consistency-aware state estimation method based on adaptive Kalman filtering is introduced. Experimental results demonstrate that the learned surrogate achieves high fidelity in both angular velocity and long-horizon trajectory reproduction under closed-loop autoregressive evaluation. These results confirm that the proposed model can serve as a drop-in surrogate for both simulation and physical systems, enabling scalable and efficient development of excavation automation algorithms.
Related papers
- WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulation [85.15806404962193]
Action-conditioned world models (ACWMs) promise to provide embodied AI with scalable predictive simulators for planning, policy evaluation, and data generation.<n>We evaluate ACWMs through the observable capabilities expected of physical simulators.<n>WorldSimProbe reveals systematic action-realization degradation across control variation, structured failures in interaction grounding and dynamics.
arXiv Detail & Related papers (2026-08-10T08:48:06Z) - SkyJEPA: Learning Long-Horizon World Models for Zero-Shot Sim-to-Real Control of Quadrotors [48.60897189520386]
We introduce the JEPA-style model for real-time quadrotor control.<n>We combine a latent dynamics model with a novel physics-inspired prober that maps frozen latents to interpretable state.<n>To reduce the dependence on expensive and unsafe real-world data collection, we develop a structured pipeline for automated dataset generation.
arXiv Detail & Related papers (2026-06-22T15:00:59Z) - Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racing [73.88859384645264]
Out-Of-Distribution (OOD) generalization to various racetracks utilizes Machine Learning (ML) to encode the mathematical relation between sensor data and vehicle actuation for end-to-end control.<n>This paper presents a DRL method that parameterizes nonlinear vehicle dynamics from the spectral distribution of depth measurements with a non-geometric, physics-informed reward, to infer vehicle time-optimal and overtaking racing controls with an Artificial Neural Network (ANN)<n>The policy outperforms human demonstrations by 12% in OOD tracks on proportionally scaled hardware, by maximizing the friction circle with tire dynamics that resemble an empirical Pacejka tire model.
arXiv Detail & Related papers (2026-04-10T17:12:07Z) - Simulation Distillation: Pretraining World Models in Simulation for Rapid Real-World Adaptation [46.80452332618188]
Simulation Distillation (SimDist) is a framework that distills structural priors from a simulator into a latent world model.<n>By transferring reward and value models directly from simulation, SimDist provides dense planning signals from raw perception.<n>SimDist substantially outperforms prior methods in data efficiency, stability, and final performance.
arXiv Detail & Related papers (2026-03-16T18:00:23Z) - RC-NF: Robot-Conditioned Normalizing Flow for Real-Time Anomaly Detection in Robotic Manipulation [68.7948300643741]
We propose Robot-Conditioned Normalizing Flow (RC-NF), a real-time monitoring model for robotic anomaly detection and intervention.<n>RC-NF decouples the processing of task-aware robot and object states within the normalizing flow.<n>It achieves state-of-the-art performance across all anomaly types compared to previous methods in monitoring robotic tasks.
arXiv Detail & Related papers (2026-03-11T10:14:37Z) - Data-Driven Control of a Magnetically Actuated Fish-Like Robot [2.5782420501870296]
Magnetically actuated fish-like robots offer promising solutions for underwater exploration due to their miniaturization and agility.<n>This paper proposes a data-driven control framework to address these complexities without relying on analytical modeling.
arXiv Detail & Related papers (2026-03-05T04:08:08Z) - Machine learning based radiative parameterization scheme and its performance in operational reforecast experiments [21.24990493675443]
This study investigates limitations inherent to hybrid forecasting frameworks that embed deep neural networks into numerical prediction models.<n>A residual convolutional neural network is employed to approximate the Rapidive Transfer Model for General Circulation Models (RRTMG) within the global operational system of China Meteorological Administration.<n>A LibTorch-based coupling method is utilized, which is more suitable for real-time operational computations.
arXiv Detail & Related papers (2026-01-20T04:45:45Z) - Data-Driven Prediction of Dynamic Interactions Between Robot Appendage and Granular Material [2.551529992410986]
An alternative data-driven modeling approach has been proposed to gain insights into robot motion interaction with granular terrain at certain length scales.<n>This approach can be used online and is based on offline data, obtained from the offline collection of high-fidelity simulation data and a set of sparse experimental data.<n>Results are expected to help robot navigation and exploration in unknown and complex terrains during both online and offline phases.
arXiv Detail & Related papers (2025-06-12T16:43:21Z) - Machine learning surrogates for efficient hydrologic modeling: Insights from stochastic simulations of managed aquifer recharge [0.0]
We show that machine learning surrogate models can achieve under 10% mean absolute percentage error.<n>We apply this workflow to simulations of variably saturated groundwater flow at a prospective managed aquifer recharge site.<n> ML surrogate models can achieve under 10% mean absolute percentage error and yield order-of-magnitude runtime savings.
arXiv Detail & Related papers (2024-07-30T15:24:27Z) - Continual learning autoencoder training for a particle-in-cell
simulation via streaming [52.77024349608834]
upcoming exascale era will provide a new generation of physics simulations with high resolution.
These simulations will have a high resolution, which will impact the training of machine learning models since storing a high amount of simulation data on disk is nearly impossible.
This work presents an approach that trains a neural network concurrently to a running simulation without data on a disk.
arXiv Detail & Related papers (2022-11-09T09:55:14Z) - Physics-informed machine learning with differentiable programming for
heterogeneous underground reservoir pressure management [64.17887333976593]
Avoiding over-pressurization in subsurface reservoirs is critical for applications like CO2 sequestration and wastewater injection.
Managing the pressures by controlling injection/extraction are challenging because of complex heterogeneity in the subsurface.
We use differentiable programming with a full-physics model and machine learning to determine the fluid extraction rates that prevent over-pressurization.
arXiv Detail & Related papers (2022-06-21T20:38:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.