Event-Conditioned Diagnostics of Kinematic, Contact, and Object-Permanence Fields in Passive Object-State World Models
- URL: http://arxiv.org/abs/2606.28455v1
- Date: Fri, 26 Jun 2026 10:11:59 GMT
- Title: Event-Conditioned Diagnostics of Kinematic, Contact, and Object-Permanence Fields in Passive Object-State World Models
- Abstract summary: We study event-conditioned latent physical structure in passive object-state world models.<n> Protocol tests whether hidden representations encode event-regime information.<n>Results support event-conditioned organization and fixed-horizon functional sensitivity of latent physical fields.
- Score: 6.556150313826966
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: World models can predict future physical states, but prediction accuracy alone does not explain how physical information is organized and used inside their latent dynamics. We introduce a controlled diagnostic protocol for studying event-conditioned latent physical structure in passive object-state world models. The protocol tests whether hidden representations encode event-regime information, whether event contexts reweight non-exclusive physical field readouts, and whether field-aligned representational components have functional consequences for prediction. Using a balanced controlled-generator dataset with free-motion, collision, and occlusion events, we evaluate recurrent, attention-based, and latent state-space transition models under a fixed-horizon forecasting setup. The models learn useful predictive dynamics and their hidden states support reliable event-regime readout. Event contexts systematically reweight kinematic, contact, and object-permanence field readouts: free motion is kinematic-dominant, collision combines kinematic and contact structure, and occlusion combines motion-related and object-permanence structure. Time-aligned and directional-consistency analyses further show phase-related shifts in field emphasis. Finally, fixed-horizon projection causal field effect (CFE) shows that suppressing field-aligned directions can degrade event-relevant prediction, with strongest evidence for contact-aligned structure in collision-contact windows and more qualified evidence for object-permanence-aligned structure in hard-occlusion hidden windows. These results support event-conditioned organization and fixed-horizon functional sensitivity of latent physical fields, while not implying explicit physical modules, isolated causal circuits, or context-invariant sliding-window generalization.
Related papers
- Orthogonal JEPA: Factorized Predictive States for Latent World Models [95.20158869896393]
We introduce method, a latent world-modeling framework based on predictive factorization.<n>We show that method can allocate redundant capacity to dominant signals while providing weak or conflicting gradients to less dominant predictive structure.<n>Experiments on controlled vision, single-cell transcriptomics, longitudinal health records, continuous control, and molecular dynamics evaluate representation quality, forecasting, planning, and long-horizon stability.
arXiv Detail & Related papers (2026-08-20T13:59:57Z) - DyG$^2$T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformer [86.4618122245946]
DyG$2$T is a dynamics modeling framework that infers object motion trajectories by spatially completing and temporally discriminating Key Point representations.<n>Experiments on both synthetic and real-world datasets demonstrate that DyG$2$T achieves accurate dynamics modeling and reasoning.
arXiv Detail & Related papers (2026-08-19T03:44:28Z) - GeoIMO: Geometry-Driven Independent Motion Classification for Event Cameras [37.09823149373976]
We present a geometry-driven framework that classifies detected objects as static or independently moving by exploiting ego-motion structure directly from the event stream.<n> Experiments on MVSEC and the Prophesee 1 Megapixel Automotive Detection dataset demonstrate consistent performance across diverse driving scenarios.
arXiv Detail & Related papers (2026-06-23T12:30:42Z) - PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation [75.9028457575434]
Generating 3D tabletop scenes is a fundamental yet underexplored problem for interactive and generalist robotic learning.<n>Here, we introduce PhyScene3D, a framework that reformulates generation as a Human-Mimetic Constructive Process.<n>Experiments demonstrate that PhyScene3D outperforms state-of-the-art approaches in both semantic accuracy and physical validity.
arXiv Detail & Related papers (2026-06-01T03:56:32Z) - CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models [25.976578205889776]
CRONOS is an intervention-based benchmark designed to evaluate counterfactual physical consistency.<n>Built in an Unreal Engine environment, CRONOS enables controlled, high-fidelity generation of videos across diverse scenes and dynamics.
arXiv Detail & Related papers (2026-05-22T14:51:22Z) - Hypergraph-State Collaborative Reasoning for Multi-Object Tracking [63.32950991964095]
We propose a collaborative reasoning framework that enhances motion estimation through joint inference among multiple correlated objects.<n>By allowing objects with similar motion states to mutually constrain and refine each other, our framework stabilizes noisy trajectories and infers plausible motion continuity even when target is occluded.
arXiv Detail & Related papers (2026-04-14T12:37:39Z) - From Perception to Action: An Interactive Benchmark for Vision Reasoning [51.11355591375073]
Causal Hierarchy of Actions and Interactions (CHAIN) benchmark designed to evaluate whether models can understand, plan, and execute structured action sequences grounded in physical constraints.<n> CHAIN shifts evaluation from passive perception to active problem solving, spanning tasks such as interlocking mechanical puzzles and 3D stacking and packing.<n>Our results show that top-performing models still struggle to internalize physical structure and causal constraints, often failing to produce reliable long-horizon plans and cannot robustly translate perceived structure into effective actions.
arXiv Detail & Related papers (2026-02-24T15:33:02Z) - Defining Energy Indicators for Impact Identification on Aerospace Composites: A Physics-Informed Machine Learning Perspective [0.4104921880358479]
Energy estimation is critical to impact identification on aerospace composites.<n>This study introduces a physics-informed framework that embeds domain knowledge into machine learning.
arXiv Detail & Related papers (2025-11-03T13:58:03Z) - Context-Aware Zero-Shot Anomaly Detection in Surveillance Using Contrastive and Predictive Spatiotemporal Modeling [0.0]
This work introduces a context-aware zero-shot anomaly detection framework that identifies abnormal events without exposure to anomaly examples during training.<n>The proposed hybrid architecture combines TimeSformer, DPC, and CLIP to extract rich spatial-temporal features.<n>A context-gating mechanism further enhances decision-making by modulating predictions with scene-aware cues or global video features.
arXiv Detail & Related papers (2025-08-25T20:22:35Z) - A Robotics-Inspired Scanpath Model Reveals the Importance of Uncertainty and Semantic Object Cues for Gaze Guidance in Dynamic Scenes [8.64158103104882]
We present a computational model that simulates object segmentation and gaze behavior in an interconnected manner.<n>We show how our model's modular design allows for extensions, such as incorporating saccadic momentum or pre-saccadic attention.
arXiv Detail & Related papers (2024-08-02T15:20:34Z) - TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild [77.59069361196404]
TRiPOD is a novel method for predicting body dynamics based on graph attentional networks.
To incorporate a real-world challenge, we learn an indicator representing whether an estimated body joint is visible/invisible at each frame.
Our evaluation shows that TRiPOD outperforms all prior work and state-of-the-art specifically designed for each of the trajectory and pose forecasting tasks.
arXiv Detail & Related papers (2021-04-08T20:01:00Z) - Causal Discovery in Physical Systems from Videos [123.79211190669821]
Causal discovery is at the core of human cognition.
We consider the task of causal discovery from videos in an end-to-end fashion without supervision on the ground-truth graph structure.
arXiv Detail & Related papers (2020-07-01T17:29:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.