SeT-Diff: Towards Semantic Foundation Models for HPC Telemetry and Time-Series

• URL: http://arxiv.org/abs/2607.22548v1
• Date: Mon, 11 May 2026 00:43:50 GMT
• Title: SeT-Diff: Towards Semantic Foundation Models for HPC Telemetry and Time-Series
• Abstract summary: Current machine learning approaches for HPC and its telemetry rely on a static subset of anonymous, fixed-position sensor variables tailored to single tasks.<n>We propose SeT-Diff, the first foundational model for compute node telemetry and time-series.<n> Experiments on a real-world supercomputer dataset demonstrate a Mean Absolute Error (MAE) of 0.0470 on reconstruction tasks.
• Score: 1.6138291258655066
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Data centers and their compute nodes require accurate and flexible digital twins capable of modeling the complex interplay of workloads, environmental parameters, and physical metrics. Current machine learning approaches for HPC and its telemetry typically rely on a static subset of anonymous, fixed-position sensor variables tailored to single tasks. Consequently, these models become obsolete when target tasks change or sensor metrics vary. We propose SeT-Diff, the first foundational model for compute node telemetry and time-series. Unlike rigid architectures, our diffusion-based approach conditions the generative process on each sensor's semantic description, decoupling the system dynamics from the structure of the dataset. Experiments on a real-world supercomputer dataset demonstrate a Mean Absolute Error (MAE) of 0.0470 on reconstruction tasks. SeT-Diff exhibits zero-shot permutation stability, maintaining accuracy with negligible degradation even when sensors are shuffled. A single pre-trained model effectively performs data imputation, forecasting, and virtual sensing - achieving a 0.033 MAE in thermal inference - making SeT-Diff an effective data-driven digital twin for HPC systems.

Related papers

• RigPI: Dynamic Parameter Identification of Rigid Body via VLM-Seeded Differentiable Simulation [16.686983429272214]
  RigPI is a framework for identifying dynamic parameters of rigid bodies and multi-link rigid bodies during robot-object interaction.<n> RigPI integrates vision-based semantic priors, force-torque measurements, and motion observations within a differentiable simulation pipeline.<n>Extensive real-world experiments on objects with revolute and prismatic joints demonstrate that RigPI achieves accurate and stable parameter estimates.
  arXiv  Detail & Related papers  (2026-06-23T22:15:42Z)
• Bridging the Sim-to-Real Gap in Semiconductor Visual Program Synthesis via Input Binarization [4.275696286826178]
  We propose a visual program synthesis framework in which a Vision-Language Model (VLM) converts inspection images into editable Domain-Specific Language () code describing circuit geometries.<n>Because the VLM is trained solely on synthetic DSL-rendered data, a domain gap arises when processing real Scanning Electron Microscope (SEM) images.<n>We bridge this gap with an input binarization strategy that strips SEM-specific texture and noise, letting the model focus on geometric structure.
  arXiv  Detail & Related papers  (2026-06-01T16:06:20Z)
• Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting [52.53742727060265]
  Foundation models (FMs) for the Earth system learn statistical relationships between physical variables across massive datasets.<n>Here, we introduce Earth System Foundation Model (ESFM), a fully open model building on the 3Dwin UNet backbone of the pioneering model.<n>We present findings using dense gridded data (ERA5, CMIP6), regionally masked dense data, sparse gridded MODIS satellite data, and station data.<n>Results demonstrate competitive or superior performance relative to state-of-the-art benchmarks.
  arXiv  Detail & Related papers  (2026-04-20T11:40:39Z)
• SourceNet: Interpretable Sim-to-Real Inference on Variable-Geometry Sensor Arrays for Earthquake Source Inversion [7.936803576241796]
  SourceNet is a Transformer-based framework that treats the sensor array as a flexible set to model arbitrary geometries.<n>By pre-training on 100,000 synthetic events and fine-tuning on 2,000 real world events, SourceNet achieves state-of-the-art precision on held-out real data.
  arXiv  Detail & Related papers  (2026-01-09T21:42:28Z)
• Data assimilation and discrepancy modeling with shallow recurrent decoders [2.47593085771929]
  We propose a machine learning framework for Data Assimilation with a SHallow REcurrent Decoder (DA-SHRED)<n>Our algorithm incorporates a sparse identification of nonlinear dynamics based regression model in the latent space to identify functionals corresponding to missing dynamics in the simulation model.<n>We demonstrate that DA-SHRED successfully closes the SIM2REAL gap and additionally recovers missing dynamics in highly complex systems.
  arXiv  Detail & Related papers  (2025-12-01T01:01:48Z)
• InJecteD: Analyzing Trajectories and Drift Dynamics in Denoising Diffusion Probabilistic Models for 2D Point Cloud Generation [48.55037712252843]
  InJecteD is a framework for interpreting Denoising Diffusion Probabilistic Models (DDPMs)<n>We apply this framework to three datasets from the Datasaurus Dozen bullseye, dino, and circle.<n>Our approach quantifies trajectory properties, including displacement, velocity, clustering, and drift field dynamics.
  arXiv  Detail & Related papers  (2025-09-09T14:53:19Z)
• High-Fidelity Digital Twins for Bridging the Sim2Real Gap in LiDAR-Based ITS Perception [3.1508266388327324]
  This paper proposes a high-fidelity digital twin (HiFi DT) framework that incorporates real-world background geometry, lane-level road topology, and sensor-specific specifications and placement.<n>Experiments show that the DT-trained model outperforms the equivalent model trained on real data by 4.8%.
  arXiv  Detail & Related papers  (2025-09-03T00:12:58Z)
• Spatial-Temporal-Spectral Unified Modeling for Remote Sensing Dense Prediction [20.1863553357121]
  Current deep learning architectures for remote sensing are fundamentally rigid.<n>We introduce the Spatial-Temporal-Spectral Unified Network (STSUN) for unified modeling.<n> STSUN can adapt to input and output data with arbitrary spatial sizes, temporal lengths, and spectral bands.<n>It unifies various dense prediction tasks and diverse semantic class predictions.
  arXiv  Detail & Related papers  (2025-05-18T07:39:17Z)
• Learning Physics From Video: Unsupervised Physical Parameter Estimation for Continuous Dynamical Systems [49.11170948406405]
  We propose an unsupervised method to estimate the physical parameters of known, continuous governing equations from single videos.<n>We take the field closer to reality by recording Delfys75: our own real-world dataset of 75 videos for five different types of dynamical systems.
  arXiv  Detail & Related papers  (2024-10-02T09:44:54Z)
• Graph Neural Networks for Virtual Sensing in Complex Systems: Addressing Heterogeneous Temporal Dynamics [8.715570103753697]
  Real-time condition monitoring is crucial for the reliable and efficient operation of complex systems.<n>Virtual sensing addresses limitations by leveraging readily available sensor data and system knowledge.<n>We propose a Heterogeneous Temporal Graph Neural Network (HTGNN) framework.
  arXiv  Detail & Related papers  (2024-07-26T12:16:53Z)
• PeFAD: A Parameter-Efficient Federated Framework for Time Series Anomaly Detection [51.20479454379662]
  We propose a. Federated Anomaly Detection framework named PeFAD with the increasing privacy concerns. We conduct extensive evaluations on four real datasets, where PeFAD outperforms existing state-of-the-art baselines by up to 28.74%.
  arXiv  Detail & Related papers  (2024-06-04T13:51:08Z)
• Synthetic location trajectory generation using categorical diffusion models [50.809683239937584]
  Diffusion models (DPMs) have rapidly evolved to be one of the predominant generative models for the simulation of synthetic data. We propose using DPMs for the generation of synthetic individual location trajectories (ILTs) which are sequences of variables representing physical locations visited by individuals.
  arXiv  Detail & Related papers  (2024-02-19T15:57:39Z)
• Learning IMM Filter Parameters from Measurements using Gradient Descent [45.335821132209766]
  In intrinsic parameters of targets under track can be completely unobservable until the system is deployed. With state-of-the-art sensor systems growing more and more complex, the number of parameters naturally increases. In this paper, the parameters of an interacting multiple model (IMM) filter are optimized solely using measurements.
  arXiv  Detail & Related papers  (2023-07-13T08:35:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.