Observation-Aligned Mask Priors for Learning Physical Dynamics from Authentic Occlusions

• URL: http://arxiv.org/abs/2605.16818v1
• Date: Sat, 16 May 2026 05:23:49 GMT
• Title: Observation-Aligned Mask Priors for Learning Physical Dynamics from Authentic Occlusions
• Abstract summary: Observation-Aligned Mask Priors is a framework that learns the distribution of authentic observation masks.<n>We show that this intersection-based partitioning gives every valid dimension a strictly positive probability of being queried.
• Score: 5.712248310668237
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Learning physical dynamics directly from incomplete observations is challenging because authentic occlusions are structured, sample-dependent, and often missing not at random, whereas existing methods typically rely on heuristic masking rules or predefined mask distributions. We propose Observation-Aligned Mask Priors, a framework that learns the distribution of authentic observation masks and uses it to construct context-query partitions for training from incomplete data. Specifically, we pretrain a Bayesian Flow Network (BFN) on binary observation masks to capture real occlusion topologies, then guide BFN sampling with a globally normalized cross-entropy objective to generate sample-specific masks aligned with each sparse observation. The intersection between the guided mask and the observed mask defines the context, and the remaining observed entries become query targets for a diffusion-based reconstruction model. We show that this intersection-based partitioning gives every valid observed dimension a strictly positive probability of being queried, preventing zero-query dead zones and local generative collapse. Experiments on three real-world oceanographic datasets with authentic satellite occlusions, across resolutions up to 256$\times$256, show consistent improvements over strong diffusion baselines in MSE and PSNR. These results demonstrate that learning mask priors from authentic occlusions is an effective alternative to heuristic masking for learning from incomplete physical observations without access to fully observed fields.

Related papers

• Impute-EM: Native Mixed-State Diffusion Models for Heterogeneous Data Imputation [71.74203645336385]
  Impute-EM alternates between imputing missing entries with the current model and refitting a diffusion backbone on completed data.<n>We characterize the update and show that the observed mask-indexed marginals match the targets at the limit.
  arXiv  Detail & Related papers  (2026-09-14T09:39:13Z)
• Masked Diffusion Modeling for Anomaly Detection [20.76040356148893]
  We propose Masked Diffusion for Anomaly Detection (MaskDiff-AD) for categorical, mixed-type, and discrete sequence data.<n>MaskDiff-AD constructs anomaly scores from the difficulty of reconstructing randomly masked coordinates.<n>Experiments show that MaskDiff-AD achieves competitive performance against classical, diffusion-based, and recent tabular/text anomaly detection baselines.
  arXiv  Detail & Related papers  (2026-05-28T14:59:17Z)
• Structure-Aware Masking for Protein Representation Learning [0.0]
  We introduce Bucket Masking, a structure-aware masking strategy that selects groups of residues based on their proximity in three-dimensional space.<n>By conditioning the masking distribution on residue contacts, Bucket Masking shifts the learning objective toward modeling long-range interactions.<n>Across four downstream protein fitness prediction tasks, Bucket Masking enables up to a 14% improvement over standard random masking.
  arXiv  Detail & Related papers  (2026-05-15T19:36:54Z)
• DPM++: Dynamic Masked Metric Learning for Occluded Person Re-identification [32.9985650634494]
  DPM++ is a Dynamic Masked Metric Learning framework for occluded person re-identification.<n>It learns an input-adaptive masked metric that dynamically selects reliable identity subspaces for each occluded instance.<n>It consistently outperforms previous state-of-the-art methods in both holistic and occlusion scenarios.
  arXiv  Detail & Related papers  (2026-05-07T17:47:23Z)
• GenMask: Adapting DiT for Segmentation via Direct Mask Generation [81.54526445834294]
  We argue that instead of indirect adaptation, segmentation tasks should be trained directly in a generative manner.<n>We introduce timesteps sampling strategy for binary masks that emphasizes extreme noise levels for segmentation and moderate noise for image generation.<n>We present GenMask, a DiT trains to generate black-and-white segmentation masks as well as colorful images in RGB space under the original generative objective.
  arXiv  Detail & Related papers  (2026-03-25T03:52:05Z)
• LADMIM: Logical Anomaly Detection with Masked Image Modeling in Discrete Latent Space [0.0]
  Masked image modeling is a self-supervised learning technique that predicts the feature representation of masked regions in an image. We propose a novel approach that leverages the characteristics of MIM to detect logical anomalies effectively. We evaluate the proposed method on the MVTecLOCO dataset, achieving an average AUC of 0.867.
  arXiv  Detail & Related papers  (2024-10-14T07:50:56Z)
• Bridge the Points: Graph-based Few-shot Segment Anything Semantically [79.1519244940518]
  Recent advancements in pre-training techniques have enhanced the capabilities of vision foundation models. Recent studies extend the SAM to Few-shot Semantic segmentation (FSS) We propose a simple yet effective approach based on graph analysis.
  arXiv  Detail & Related papers  (2024-10-09T15:02:28Z)
• Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptation [49.827306773992376]
  Continual Test-Time Adaptation (CTTA) is proposed to migrate a source pre-trained model to continually changing target distributions. Our proposed method attains state-of-the-art performance in both classification and segmentation CTTA tasks.
  arXiv  Detail & Related papers  (2023-12-19T15:34:52Z)
• Prediction with Incomplete Data under Agnostic Mask Distribution Shift [35.86200694774949]
  We consider prediction with incomplete data in the presence of distribution shift. We leverage the observation that for each mask, there is an invariant optimal predictor. We propose a novel prediction method called StableMiss.
  arXiv  Detail & Related papers  (2023-05-18T14:06:06Z)
• RARE: Robust Masked Graph Autoencoder [45.485891794905946]
  Masked graph autoencoder (MGAE) has emerged as a promising self-supervised graph pre-training (SGP) paradigm. We propose a novel SGP method termed Robust mAsked gRaph autoEncoder (RARE) to improve the certainty in inferring masked data.
  arXiv  Detail & Related papers  (2023-04-04T03:35:29Z)
• Self-Supervised Training with Autoencoders for Visual Anomaly Detection [61.62861063776813]
  We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold. We adapt a self-supervised learning regime that exploits discriminative information during training but focuses on the submanifold of normal examples. We achieve a new state-of-the-art result on the MVTec AD dataset -- a challenging benchmark for visual anomaly detection in the manufacturing domain.
  arXiv  Detail & Related papers  (2022-06-23T14:16:30Z)
• Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection [97.93062818228015]
  We propose to integrate the reconstruction-based functionality into a novel self-supervised predictive architectural building block. Our block is equipped with a loss that minimizes the reconstruction error with respect to the masked area in the receptive field. We demonstrate the generality of our block by integrating it into several state-of-the-art frameworks for anomaly detection on image and video.
  arXiv  Detail & Related papers  (2021-11-17T13:30:31Z)
• Improving Self-supervised Pre-training via a Fully-Explored Masked Language Model [57.77981008219654]
  Masked Language Model (MLM) framework has been widely adopted for self-supervised language pre-training. We propose a fully-explored masking strategy, where a text sequence is divided into a certain number of non-overlapping segments.
  arXiv  Detail & Related papers  (2020-10-12T21:28:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.