EWAM: An Enhanced World Action Model for Closed-Loop Online Adaptation in Embodied Intelligence
- URL: http://arxiv.org/abs/2606.12690v1
- Date: Wed, 10 Jun 2026 21:24:46 GMT
- Title: EWAM: An Enhanced World Action Model for Closed-Loop Online Adaptation in Embodied Intelligence
- Abstract summary: EWAM is a closed-loop online adaptation architecture built upon a pretrained and fully frozen Cosmos3 backbone network.<n>Its performance gains stem entirely from an inference-time co-reasoning mechanism composed of four inserted lightweight neural layers.<n>Unlike naive feature fusion, the memory, anomaly detection, and correction modules are deeply integrated into the Cosmos3 forward path.
- Score: 2.660415540961114
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this paper, we propose the Enhanced World Action Model (EWAM), a closed-loop online adaptation architecture built upon a pretrained and fully frozen Cosmos3 backbone network. Evaluated entirely under a zero-shot task protocol, EWAM is centrally focused on reducing the amount of additional deployment data required to adapt to new task layouts. Notably, no extra task-specific demonstration sets were introduced in any of the evaluations, and no fine-tuning was performed on the backbone network. Its performance gains stem entirely from an inference-time co-reasoning mechanism composed of four inserted lightweight neural layers: the Neural Experience Memory Layer located in the intermediate layers of the Diffusion Transformer (DiT) provides task-relevant execution context; the Neural Anomaly Detection Layer after the state prediction head monitors the divergence between predicted and actual states in real time; the Neural Policy Routing Layer dynamically selects direct execution, conservative replanning, or rollback recovery based on the anomaly severity; and the Neural Action Correction Layer refines the generated action chunks using execution diagnostics. Unlike naive feature fusion, the memory, anomaly detection, and correction modules are deeply integrated into the Cosmos3 forward path in a differentiable manner, with only the final routing decision being a discrete supervised one.
Related papers
- AdaReP:Adaptive Re-Planning under Model Mismatch for Neural World-Model Predictive Control [20.745587519033833]
We analyze how stale-plan penalties scale with the reuse tolerance, the accumulated mismatch since the last replanning step, and the local dynamics sensitivity.<n>We propose AdaReP, a training-free wrapper that adapts the replanning tolerance online using the current deviation from the cached rollout and a local sensitivity estimate.<n>Across image-space planning, latent-space control, and real-world robotic manipulation, AdaReP substantially reduces planner-side computation while maintaining comparable task performance, including over 80% fewer queries on a 50-trial physical robot study.
arXiv Detail & Related papers (2026-06-22T09:27:50Z) - Monitoring Neural Training with Topology: A Footprint-Predictable Collapse Index [51.56484100374058]
We propose an online, topology-aware monitor for evolving neural representations that couples Modular Morse Homology Maintenance (MMHM) with a composite Collapse Index (CI)<n>Instead of rebuilding complexes each epoch, we apply sparse edits at a fixed scale and maintain a discrete Morse matching, yielding fast, incremental updates.
arXiv Detail & Related papers (2026-04-28T19:21:21Z) - Visual prompting reimagined: The power of the Activation Prompts [72.85146015928626]
We introduce a concept, termed activation prompt (AP), which extends the scope of the input-level VP.<n>AP is closely related to normalization tuning in convolutional neural networks and vision transformers.<n>We show that AP is closely related to normalization tuning in convolutional neural networks and vision transformers.
arXiv Detail & Related papers (2026-04-07T20:28:24Z) - Self-Supervised Multi-Stage Domain Unlearning for White-Matter Lesion Segmentation [0.0]
We propose an unsupervised domain adaptation technique based on self-supervised multi-stage unlearning.<n>In comparison, the SSMSU demonstrated the advantage of unlearning by enhancing lesion sensitivity and limiting false detections.
arXiv Detail & Related papers (2026-03-04T22:27:20Z) - A Graph Prompt Fine-Tuning Method for WSN Spatio-Temporal Correlation Anomaly Detection [13.649966886916658]
Anomaly detection of multi-temporal modal data in WirelessSN Network (WSN) can provide an important guarantee for reliable network operation.<n>Existing anomaly detection methods have the problems of insufficient extraction of-temporal correlation features, high cost of anomaly sample category and imbalance of anomaly samples.<n>In this paper, we design a graph neural network anomaly detection backbone network-temporal correlation features and a multi-task self-supervised training strategy.
arXiv Detail & Related papers (2026-01-19T05:58:53Z) - Towards Efficient General Feature Prediction in Masked Skeleton Modeling [59.46799426434277]
We propose a novel General Feature Prediction framework (GFP) for efficient mask skeleton modeling.<n>Our key innovation is replacing conventional low-level reconstruction with high-level feature prediction that spans from local motion patterns to global semantic representations.
arXiv Detail & Related papers (2025-09-03T18:05:02Z) - Variational Density Propagation Continual Learning [0.0]
Deep Neural Networks (DNNs) deployed to the real world are regularly subject to out-of-distribution (OoD) data.
This paper proposes a framework for adapting to data distribution drift modeled by benchmark Continual Learning datasets.
arXiv Detail & Related papers (2023-08-22T21:51:39Z) - A Generic Shared Attention Mechanism for Various Backbone Neural Networks [53.36677373145012]
Self-attention modules (SAMs) produce strongly correlated attention maps across different layers.
Dense-and-Implicit Attention (DIA) shares SAMs across layers and employs a long short-term memory module.
Our simple yet effective DIA can consistently enhance various network backbones.
arXiv Detail & Related papers (2022-10-27T13:24:08Z) - Self-Supervised Masked Convolutional Transformer Block for Anomaly
Detection [122.4894940892536]
We present a novel self-supervised masked convolutional transformer block (SSMCTB) that comprises the reconstruction-based functionality at a core architectural level.
In this work, we extend our previous self-supervised predictive convolutional attentive block (SSPCAB) with a 3D masked convolutional layer, a transformer for channel-wise attention, as well as a novel self-supervised objective based on Huber loss.
arXiv Detail & Related papers (2022-09-25T04:56:10Z) - Non-Gradient Manifold Neural Network [79.44066256794187]
Deep neural network (DNN) generally takes thousands of iterations to optimize via gradient descent.
We propose a novel manifold neural network based on non-gradient optimization.
arXiv Detail & Related papers (2021-06-15T06:39:13Z) - Modeling from Features: a Mean-field Framework for Over-parameterized
Deep Neural Networks [54.27962244835622]
This paper proposes a new mean-field framework for over- parameterized deep neural networks (DNNs)
In this framework, a DNN is represented by probability measures and functions over its features in the continuous limit.
We illustrate the framework via the standard DNN and the Residual Network (Res-Net) architectures.
arXiv Detail & Related papers (2020-07-03T01:37:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.