LithoFormer: A Robust Framework for Stratigraphic Inference via Transformers

• URL: http://arxiv.org/abs/2607.22804v1
• Date: Fri, 24 Jul 2026 15:33:03 GMT
• Title: LithoFormer: A Robust Framework for Stratigraphic Inference via Transformers
• Abstract summary: We introduce LithoFormer, a robust framework for stratigraphic inference using a Seq2Seq transformer model.<n>LithiumFormer ingests entire multivariate well logs in a single pass.<n>It demonstrates a 90% reduction in median boundary error and eliminates stratigraphic order violations.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Accurate geological characterization of subsurface reservoirs from well log data is essential to support projects such as carbon capture and storage (CCS), geothermal development, and extraction of natural resources. Existing automated techniques for geological characterization primarily use sliding-window classification, which limits their ability to understand broader geological contexts, often leading to misaligned formation layers. To overcome these limitations, we introduce LithoFormer, a robust framework for stratigraphic inference using a Seq2Seq transformer model that ingests entire multivariate well logs in a single pass. The framework utilizes a channel-independent PatchTST backbone enhanced with rotary positional embeddings (RoPE) to capture long-range geological dependencies across entire multivariate well logs. A decoupled multi-task head is employed to jointly predict geological zonation and precise boundary probabilities, while a geology-informed loss function enforces physical constraints such as the Law of Superposition. Validated and deployed on three real-world datasets, LithoFormer demonstrates a 90% reduction in median boundary error and eliminates stratigraphic order violations compared to traditional sliding-window baselines. It also achieves a 80% reduction in manual expert labor and eliminates stratigraphic inconsistencies, providing a scalable and reliable solution for large-scale subsurface modeling.

Related papers

• Attention-Guided Flow-Matching for Sparse 3D Geological Generation [7.734651455015875]
  3D-GeoFlow is the first Attention-Guided Continuous Flow Matching framework tailored for sparse multimodal geological modeling.<n>By reformulating discrete categorical generation as a simulation-free, continuous vector field regression, our model establishes stable, deterministic optimal transport paths.<n>To validate our framework, we curated a large-scale multimodal dataset comprising 2,200 procedurally generated 3D geological cases.
  arXiv  Detail & Related papers  (2026-04-07T07:02:53Z)
• Cross-Scenario Deraining Adaptation with Unpaired Data: Superpixel Structural Priors and Multi-Stage Pseudo-Rain Synthesis [48.809049043865905]
  Image deraining plays a pivotal role in low-level computer vision.<n>Deep learning paradigms often suffer from severe performance degradation when generalized to unseen Out-of-Distribution scenarios.<n>This paper proposes a pioneering cross-scenario deraining adaptation framework.
  arXiv  Detail & Related papers  (2026-03-23T07:38:55Z)
• GIAT: A Geologically-Informed Attention Transformer for Lithology Identification [6.315199366662337]
  Geologically-Informed Attention Transformer (GIAT) is a novel framework that fuses data-driven geological priors with the Transformer's attention mechanism.<n>GIAT achieves state-of-the-art performance with an accuracy of up to 95.4%, significantly outperforming existing models.
  arXiv  Detail & Related papers  (2026-03-10T04:02:57Z)
• Fluxamba: Topology-Aware Anisotropic State Space Models for Geological Lineament Segmentation in Multi-Source Remote Sensing [6.815807403335458]
  We propose a lightweight architecture that introduces a topology-aware feature rectification framework.<n>F Fluxamba achieves a real-time inference speed of over 24 FPS with only 3.4M parameters and 6.3G FLOPs.
  arXiv  Detail & Related papers  (2026-01-24T03:55:21Z)
• History Matching under Uncertainty of Geological Scenarios with Implicit Geological Realism Control with Generative Deep Learning and Graph Convolutions [0.10923877073891446]
  The graph-based variational autoencoder represents an architecture that can handle the uncertainty of different geological scenarios.<n>We offer in-depth analysis of the latent space using tools such as PCA, t-SNE, and TDA to illustrate its structure.
  arXiv  Detail & Related papers  (2025-07-14T12:14:17Z)
• Knowledge-guided Complex Diffusion Model for PolSAR Image Classification in Contourlet Domain [58.46450049579116]
  We propose a knowledge-guided complex diffusion model for PolSAR image classification in the Contourlet domain.<n> Specifically, the Contourlet transform is first applied to decompose the data into low- and high-frequency subbands.<n>A knowledge-guided complex diffusion network is then designed to model the statistical properties of the low-frequency components.
  arXiv  Detail & Related papers  (2025-07-08T04:50:28Z)
• SDF-TopoNet: A Two-Stage Framework for Tubular Structure Segmentation via SDF Pre-training and Topology-Aware Fine-Tuning [2.3436632098950456]
  Key challenge is ensuring topological correctness while maintaining computational efficiency.<n>We propose textbfSDF-TopoNet, an improved topology-aware segmentation framework.<n>We show that SDF-TopoNet outperforms existing methods in both topological accuracy and quantitative segmentation metrics.
  arXiv  Detail & Related papers  (2025-03-14T23:54:38Z)
• Topograph: An efficient Graph-Based Framework for Strictly Topology Preserving Image Segmentation [78.54656076915565]
  Topological correctness plays a critical role in many image segmentation tasks.<n>Most networks are trained using pixel-wise loss functions, such as Dice, neglecting topological accuracy.<n>We propose a novel, graph-based framework for topologically accurate image segmentation.
  arXiv  Detail & Related papers  (2024-11-05T16:20:14Z)
• ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models [70.45441031021291]
  Large Vision-Language Models (LVLMs) can understand the world comprehensively by integrating rich information from different modalities. LVLMs are often problematic due to their massive computational/energy costs and carbon consumption. We propose Efficient Coarse-to-Fine LayerWise Pruning (ECoFLaP), a two-stage coarse-to-fine weight pruning approach for LVLMs.
  arXiv  Detail & Related papers  (2023-10-04T17:34:00Z)
• DETR Doesn't Need Multi-Scale or Locality Design [69.56292005230185]
  This paper presents an improved DETR detector that maintains a "plain" nature. It uses a single-scale feature map and global cross-attention calculations without specific locality constraints. We show that two simple technologies are surprisingly effective within a plain design to compensate for the lack of multi-scale feature maps and locality constraints.
  arXiv  Detail & Related papers  (2023-08-03T17:59:04Z)
• Real-time high-resolution CO$_2$ geological storage prediction using nested Fourier neural operators [58.728312684306545]
  Carbon capture and storage (CCS) plays an essential role in global decarbonization. Scaling up CCS deployment requires accurate and high-resolution modeling of the storage reservoir pressure buildup and the gaseous plume migration. We introduce Nested Fourier Neural Operator (FNO), a machine-learning framework for high-resolution dynamic 3D CO2 storage modeling at a basin scale.
  arXiv  Detail & Related papers  (2022-10-31T04:04:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.