Do Masked Autoencoders Improve Downhole Prediction? An Empirical Study on Real Well Drilling Data

• URL: http://arxiv.org/abs/2604.20909v1
• Date: Tue, 21 Apr 2026 22:46:42 GMT
• Title: Do Masked Autoencoders Improve Downhole Prediction? An Empirical Study on Real Well Drilling Data
• Abstract summary: Masked autoencoder (MAE) pretraining is evaluated for downhole drilling metric prediction.<n>Best MAE configuration reduces test mean absolute error by 19.8% relative to the supervised GRU baseline.
• Score: 41.99844472131922
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Downhole drilling telemetry presents a fundamental labeling asymmetry: surface sensor data are generated continuously at 1~Hz, while labeled downhole measurements are costly, intermittent, and scarce. Current machine learning approaches for downhole metric prediction universally adopt fully supervised training from scratch, which is poorly suited to this data regime. We present the first empirical evaluation of masked autoencoder (MAE) pretraining for downhole drilling metric prediction. Using two publicly available Utah FORGE geothermal wells comprising approximately 3.5 million timesteps of multivariate drilling telemetry, we conduct a systematic full-factorial design space search across 72 MAE configurations and compare them against supervised LSTM and GRU baselines on the task of predicting Total Mud Volume. Results show that the best MAE configuration reduces test mean absolute error by 19.8\% relative to the supervised GRU baseline, while trailing the supervised LSTM baseline by 6.4\%. Analysis of design dimensions reveals that latent space width is the dominant architectural choice (Pearson $r = -0.59$ with test MAE), while masking ratio has negligible effect, an unexpected finding attributed to high temporal redundancy in 1~Hz drilling data. These results establish MAE pretraining as a viable paradigm for drilling analytics and identify the conditions under which it is most beneficial.

Related papers

• Assessing the Potential of Masked Autoencoder Foundation Models in Predicting Downhole Metrics from Surface Drilling Data [41.99844472131922]
  Oil and gas drilling operations generate extensive time-series data from surface sensors.<n>Real-time prediction of critical downhole metrics remains challenging due to the scarcity of labelled downhole measurements.<n>This research reviews thirteen papers published between 2015 and 2025 to assess the potential of Masked Autoencoder Foundation Models.
  arXiv  Detail & Related papers  (2026-04-16T15:47:16Z)
• SpecTM: Spectral Targeted Masking for Trustworthy Foundation Models [0.0]
  SpecTM is a physics-informed masking design that encourages the reconstruction of targeted bands from cross-spectral context.<n>It achieves R2 = 0.695 (current week) and R2 = 0.620 (8-day-ahead) predictions surpassing all baseline models by (+34% (0.51 Ridge) and +99% (SVR 0.31)<n>It outperforms strong baselines with 2.2x superior label efficiency under extreme scarcity.
  arXiv  Detail & Related papers  (2026-03-23T15:26:51Z)
• Echo State Networks for Time Series Forecasting: Hyperparameter Sweep and Benchmarking [51.56484100374058]
  We evaluate whether a fully automatic, purely feedback-driven ESN can serve as a competitive alternative to widely used statistical forecasting methods.<n>Forecast accuracy is measured using MASE and sMAPE and benchmarked against simple benchmarks like drift and seasonal naive and statistical models.
  arXiv  Detail & Related papers  (2026-02-03T16:01:22Z)
• OASIS-DC: Generalizable Depth Completion via Output-level Alignment of Sparse-Integrated Monocular Pseudo Depth [1.4896509623302834]
  Recent foundation models excel at zero-shot depth estimation, yet their outputs are inherently relative rather than metric.<n>We leverage the fact that relative depth preserves global layout and boundaries, by calibrating it with sparse range measurements.<n>We design a refinement network that follows the prior where reliable and deviates where necessary, enabling accurate metric predictions from very few labeled samples.
  arXiv  Detail & Related papers  (2026-02-01T14:57:33Z)
• Agentic World Modeling for 6G: Near-Real-Time Generative State-Space Reasoning [70.56067503630486]
  We argue that sixth-generation (6G) intelligence is not fluent token prediction but calibrated the capacity to imagine and choose.<n>We show that WM-MS3M cuts mean absolute error (MAE) by 1.69% versus MS3M with 32% fewer parameters and similar latency, and achieves 35-80% lower root mean squared error (RMSE) than attention/hybrid baselines with 2.3-4.1x faster inference.
  arXiv  Detail & Related papers  (2025-11-04T17:22:22Z)
• Revisiting Multivariate Time Series Forecasting with Missing Values [65.30332997607141]
  Missing values are common in real-world time series.<n>Current approaches have developed an imputation-then-prediction framework that uses imputation modules to fill in missing values, followed by forecasting on the imputed data.<n>This framework overlooks a critical issue: there is no ground truth for the missing values, making the imputation process susceptible to errors that can degrade prediction accuracy.<n>We introduce Consistency-Regularized Information Bottleneck (CRIB), a novel framework built on the Information Bottleneck principle.
  arXiv  Detail & Related papers  (2025-09-27T20:57:48Z)
• Prognostics and Health Management of Wafer Chemical-Mechanical Polishing System using Autoencoder [0.552480439325792]
  The Prognostics and Health Management Data Challenge (PHM) 2016 tracks the health state of components of a semiconductor wafer polishing process.<n>The ultimate goal is to develop an ability to predict the measurement on the wafer surface wear through monitoring the components health state.<n>Applying a data driven approach such as deep learning to the PHM dataset is non-trivial.<n>We propose using the autoencoder based clustering whereby the feature space trained is found to be more suitable for performing regression.
  arXiv  Detail & Related papers  (2025-03-03T04:48:34Z)
• Applied Bayesian Structural Health Monitoring: inclinometer data anomaly detection and forecasting [0.0]
  Inclinometer probes are devices that can be used to measure deformations within earthwork slopes. This paper demonstrates a novel application of Bayesian techniques to real-world inclinometer data.
  arXiv  Detail & Related papers  (2023-07-01T11:28:43Z)
• Data-driven and machine-learning based prediction of wave propagation behavior in dam-break flood [11.416877401689735]
  We show that a machine learning model that is well-trained on a minimal amount of data, can help predict the long-term dynamic behavior of a one-dimensional dam-break flood with satisfactory accuracy. We demonstrate a good prediction ability of the RC-ESN model, which ahead predicts wave propagation behavior 286 time-steps in the dam-break flood with a root mean square error (RMSE) smaller than 0.01.
  arXiv  Detail & Related papers  (2022-09-19T02:58:31Z)
• Unsupervised Scale-consistent Depth Learning from Video [131.3074342883371]
  We propose a monocular depth estimator SC-Depth, which requires only unlabelled videos for training. Thanks to the capability of scale-consistent prediction, we show that our monocular-trained deep networks are readily integrated into the ORB-SLAM2 system. The proposed hybrid Pseudo-RGBD SLAM shows compelling results in KITTI, and it generalizes well to the KAIST dataset without additional training.
  arXiv  Detail & Related papers  (2021-05-25T02:17:56Z)
• Surface Warping Incorporating Machine Learning Assisted Domain Likelihood Estimation: A New Paradigm in Mine Geology Modelling and Automation [68.8204255655161]
  A Bayesian warping technique has been proposed to reshape modeled surfaces based on geochemical and spatial constraints imposed by newly acquired blasthole data. This paper focuses on incorporating machine learning in this warping framework to make the likelihood generalizable. Its foundation is laid by a Bayesian computation in which the geological domain likelihood given the chemistry, p(g|c) plays a similar role to p(y(c)|g.
  arXiv  Detail & Related papers  (2021-02-15T10:37:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.