HPC-Enabled Video-based Coastal Wave Parameter Estimation Using V-JEPA and Deep Spatiotemporal Learning

• URL: http://arxiv.org/abs/2607.11998v1
• Date: Mon, 13 Jul 2026 16:57:46 GMT
• Title: HPC-Enabled Video-based Coastal Wave Parameter Estimation Using V-JEPA and Deep Spatiotemporal Learning
• Abstract summary: This paper presents a video-based and high performance computing (HPC) enabled deep learning framework for joint sensor free estimation of five coastal wave parameters.<n>The proposed architecture comprises of ViT Small backbone for robust feature extraction in visually challenging VEPA.<n>The framework demonstrates statistically significant temporal generalization (PCC of 0.451 to 0.832), confirming proof of concept feasibility.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: High deployment cost, poor spatial coverage and susceptibility to storm conditions are all challenges faced by traditional in-situ methods. This paper presents a video-based and high performance computing (HPC) enabled deep learning framework for joint sensor free estimation of five coastal wave parameters, namely significant wave height (Hs), maximum wave height (Hmax), peak period (Tp), zero upcrossing period (Tz) and wave direction (theta) from monocular coastal video. The proposed architecture comprises of a V-JEPA (self supervised) ViT Small backbone for robust spatiotemporal feature extraction in visually challenging scenarios, a dual-stream SlowFast temporal encoder for broad bandwidth representation of wave motion in both hydrodynamic breaking and swell regimes, an optical flow stream based on Farneback optical flow algorithm for adding saliency information to the structure with emphasis on hydrodynamically active wavelength bands of waves, and a multi-task regression layer with dispersion constraints (Airy wave dispersion lambda_p = 0.1). The model was trained on an NVIDIA DGX A100 cluster and was early stopped at epoch 31 and achieved Pearson correlation coefficients of 0.451, 0.578, 0.643, 0.680 and 0.832 for Hs, Hmax, Tp, Tz and wave direction respectively, with generalization ability to geographically diverse held out test data sites. While operating in a data-limited regime (6 annotated training scenes), the framework demonstrates statistically significant temporal correlations (PCC of 0.451 to 0.832), confirming proof of concept feasibility; R2 values (max 0.246) indicate that variance capture will improve with larger annotated datasets.

Related papers

• ROMNet: a hybrid reduced order modeling and machine learning approach to waveform inversion [53.79823394212125]
  Waveform inversion seeks to estimate the wave speed of a heterogeneous, inaccessible medium.<n>We introduce the methodology, called ROMNet, and test it with numerical simulations.<n>We compare the performance of ROMNet with the direct ROM-based inversion and with two representative deep learning approaches to FWI.
  arXiv  Detail & Related papers  (2026-08-25T21:13:39Z)
• WaiT for the Signal: Simple Frequency-Aware Flow-Matching [60.56691023057048]
  We introduce WaiT, a Wavelet-aware image Transformer that decomposes generation into coarse and fine bands.<n>On ImageNet 512x512, WaiT achieves a pixel-space FID of 1.43, reducing sampling compute by up to 50%.<n>Our formulation outperforms even the strongest latent-space models on texture fidelity, and scales seamlessly to high-resolution OpenImages and to video generation.
  arXiv  Detail & Related papers  (2026-07-30T18:26:19Z)
• WaveZip: Wavelet-Driven Space-Time Decoupling for Video Token Condensation [69.37452950816122]
  WaveZip is a joint signal-frequency-domain framework for efficient video inference.<n> experiments on long video understanding benchmarks demonstrate that WaveZip retains 99.6% of the full performance.
  arXiv  Detail & Related papers  (2026-07-25T16:05:22Z)
• ShipNet: A Geometric Deep Learning Surrogate for Real-Time Ship Hydrodynamics [0.0]
  ShipNet is a geometric deep-learning surrogate that predicts both hull-surface pressure distributions and far-field free-surface wave patterns directly from hull geometry and speed.<n>Inference requires approximately 0.15s per case, yielding over a 550x speedup relative to the potential-flow solver on conventional hardware.
  arXiv  Detail & Related papers  (2026-06-13T15:38:24Z)
• Data-Driven Forecasting of three-Component Seismograms Using Transformer Architectures [43.8784307709823]
  We introduce textscSeismoGPT, a transformer-based autoregressive model designed to forecast three-component seismic waveforms directly in the time domain.<n> Evaluation is performed on synthetic seismograms spanning source depths of 5--100,km, epicentral distances of 10--90$circ$, and magnitudes $3 leq M_w leq 7$.
  arXiv  Detail & Related papers  (2026-06-01T21:38:03Z)
• GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splatting [71.12303582606019]
  Continuous Video Super-Resolution (C-STVSR) aims to simultaneously enhance the spatial and frame rate of videos by arbitrary scale factors.<n>We propose GS-STVSR, an ultra-efficient C-STVSR framework based on 2D Gaussianting (2D-GS)<n>We show that GS-STVSR achieves state-of-the-art quality across all benchmarks.
  arXiv  Detail & Related papers  (2026-04-20T10:11:05Z)
• SpecFuse: A Spectral-Temporal Fusion Predictive Control Framework for UAV Landing on Oscillating Marine Platforms [6.921143850808118]
  We propose a novel spectral fusion framework that integrates frequency-domain wave time-temporal wave decomposition.<n>It refines predictions real time via IMU data without relying on complex calibration.<n>It achieves a 3.2 cm prediction error, 4.46 cm landing deviation, 98.7% / 87.5% success rates (2,000 / real-world), and 82 ms latency on embedded hardware, outperforming state-of-the-art methods by 44%-48% in accuracy.
  arXiv  Detail & Related papers  (2026-02-17T15:03:05Z)
• Event-based high temporal resolution measurement of shock wave motion field [16.853658330080428]
  Accurate measurement of shock wave motion parameters with high resolution is essential for applications such as power field testing and damage assessment.<n>To address these challenges, a novel framework is proposed that utilizes multiple event cameras to estimate the asymmetry of shock waves.<n>The experimental results demonstrate that our method achieves high-precision measurement of the shock wave motion field with both high spatial and temporal resolution.
  arXiv  Detail & Related papers  (2025-12-27T05:37:18Z)
• Timely Parameter Updating in Over-the-Air Federated Learning [45.5660377179285]
  We propose Freshness Freshness-mAgnItude awaRe top-k (FAIR-k), an algorithm that selects, in each communication round, the most impactful subset of gradients to be updated over the air.<n>We show that FAIR-k promotes fresh (and fair) parameter updates and enhances communication efficiency by enabling an extended period of local training without significantly affecting overall training efficiency.
  arXiv  Detail & Related papers  (2025-12-22T07:18:13Z)
• Hi-WaveTST: A Hybrid High-Frequency Wavelet-Transformer for Time-Series Classification [0.0]
  We propose Hi-WaveTST, a novel Hybrid architecture that augments the original temporal patch with a learnable, High-Frequency wavelet feature stream.<n>Our model achieves a mean accuracy of 93.38 percent plus-minus 0.0043, significantly outperforming the SOTA PatchTST baseline (92.59 percent plus-minus 0.0039)<n>A comprehensive ablation study proves that every component of our design-the hybrid architecture, the deep high-frequency wavelet decomposition, and the learnable GeM pooling-is essential for this state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-11-03T05:55:31Z)
• Wavelet-Space Representations for Neural Super-Resolution in Rendering Pipelines [0.0]
  We introduce a formulation that predicts stationary wavelet coefficients rather than directly regressing RGB values.<n>Wavelet-domain neural super-resolution provides a principled and efficient path toward higher-quality real-time rendering.
  arXiv  Detail & Related papers  (2025-08-22T01:01:44Z)
• FLEX: A Backbone for Diffusion-Based Modeling of Spatio-temporal Physical Systems [51.15230303652732]
  FLEX (F Low EXpert) is a backbone architecture for generative modeling of-temporal physical systems.<n>It reduces the variance of the velocity field in the diffusion model, which helps stabilize training.<n>It achieves accurate predictions for super-resolution and forecasting tasks using as few features as two reverse diffusion steps.
  arXiv  Detail & Related papers  (2025-05-23T00:07:59Z)
• Accelerating High-Fidelity Waveform Generation via Adversarial Flow Matching Optimization [37.35829410807451]
  This paper introduces PeriodWave-Turbo, a high-fidelity and high-efficient waveform generation model via adversarial flow matching optimization. It only requires 1,000 steps of fine-tuning to achieve state-of-the-art performance across various objective metrics. By scaling up the backbone of PeriodWave from 29M to 70M parameters for improved generalization, PeriodWave-Turbo achieves unprecedented performance.
  arXiv  Detail & Related papers  (2024-08-15T08:34:00Z)
• Machine learning for phase-resolved reconstruction of nonlinear ocean wave surface elevations from sparse remote sensing data [37.69303106863453]
  We propose a novel approach for phase-resolved wave surface reconstruction using neural networks. Our approach utilizes synthetic yet highly realistic training data on uniform one-dimensional grids.
  arXiv  Detail & Related papers  (2023-05-18T12:30:26Z)
• Reinforcement Learning with Latent Flow [78.74671595139613]
  Flow of Latents for Reinforcement Learning (Flare) is a network architecture for RL that explicitly encodes temporal information through latent vector differences. We show that Flare recovers optimal performance in state-based RL without explicit access to the state velocity. We also show that Flare achieves state-of-the-art performance on pixel-based challenging continuous control tasks within the DeepMind control benchmark suite.
  arXiv  Detail & Related papers  (2021-01-06T03:50:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.