Geological Inference from Textual Data using Word Embeddings

• URL: http://arxiv.org/abs/2504.07490v1
• Date: Thu, 10 Apr 2025 06:46:38 GMT
• Title: Geological Inference from Textual Data using Word Embeddings
• Abstract summary: This research explores the use of Natural Language Processing (NLP) techniques to locate geological resources.<n>By using word embeddings trained with the GloVe model, we extract semantic relationships between target keywords and a corpus of geological texts.<n>For benchmarking, we calculate the proximity between the ten cities most semantically related to the target keyword and identified mine locations.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This research explores the use of Natural Language Processing (NLP) techniques to locate geological resources, with a specific focus on industrial minerals. By using word embeddings trained with the GloVe model, we extract semantic relationships between target keywords and a corpus of geological texts. The text is filtered to retain only words with geographical significance, such as city names, which are then ranked by their cosine similarity to the target keyword. Dimensional reduction techniques, including Principal Component Analysis (PCA), Autoencoder, Variational Autoencoder (VAE), and VAE with Long Short-Term Memory (VAE-LSTM), are applied to enhance feature extraction and improve the accuracy of semantic relations. For benchmarking, we calculate the proximity between the ten cities most semantically related to the target keyword and identified mine locations using the haversine equation. The results demonstrate that combining NLP with dimensional reduction techniques provides meaningful insights into the spatial distribution of natural resources. Although the result shows to be in the same region as the supposed location, the accuracy has room for improvement.

Related papers

• Location-Aware Language Models via Secondary Embeddings [4.784071359791487]
  We propose a lightweight, model-agnostic approach for injecting geo-spatial awareness into pretrained embeddings.<n>Our method augments input representations with structured geographic signals by combining location names with their corresponding latitude and longitude.<n> Experimental results demonstrate substantial improvements in geo-spatial alignment while maintaining comparable performance on standard NLP benchmarks.
  arXiv  Detail & Related papers  (2026-08-31T22:48:37Z)
• Tessellating The Earth [16.078192224421084]
  Tessellating the Earth (TTE) is a location encoder built from learnable Spherical Voronoi partitions.<n>TTE sets a new state of the art for location encoders across a suite of geospatial classification and regression tasks.
  arXiv  Detail & Related papers  (2026-06-25T19:58:13Z)
• Evaluating the impact of word embeddings on similarity scoring in practical information retrieval [0.5872014229110214]
  Vector Space Modelling (VSM) and neural word embeddings play a crucial role in modern machine learning and Natural Language Processing pipelines.<n>This paper evaluates an alternative approach to measuring query statement similarity that moves away from the common similarity measure of centroids of neural word embeddings.
  arXiv  Detail & Related papers  (2026-02-05T14:57:38Z)
• SegDesicNet: Lightweight Semantic Segmentation in Remote Sensing with Geo-Coordinate Embeddings for Domain Adaptation [0.5461938536945723]
  We propose a novel unsupervised domain adaptation technique for remote sensing semantic segmentation.<n>Our proposed SegDesicNet module regresses the GRID positional encoding of the geo coordinates projected over the unit sphere to obtain the domain loss.<n>Our algorithm seeks to reduce the modeling disparity between artificial neural networks and human comprehension of the physical world.
  arXiv  Detail & Related papers  (2025-03-11T11:01:18Z)
• Into the Unknown: Generating Geospatial Descriptions for New Environments [18.736071151303726]
  Rendezvous task requires reasoning over allocentric spatial relationships. Using opensource descriptions paired with coordinates (e.g., Wikipedia) provides training data but suffers from limited spatially-oriented text. We propose a large-scale augmentation method for generating high-quality synthetic data for new environments.
  arXiv  Detail & Related papers  (2024-06-28T14:56:21Z)
• LGDE: Local Graph-based Dictionary Expansion [0.923607423080658]
  Local Graph-based Dictionary Expansion (LGDE) is a method for data-driven discovery of the semantic neighbourhood of words.<n>We show that LGDE enriches the list of keywords with improved performance relative to methods based on direct word similarities or co-occurrences.<n>Our empirical results and expert user assessment indicate that LGDE expands the seed dictionary with more useful keywords due to the manifold-learning-based similarity network.
  arXiv  Detail & Related papers  (2024-05-13T14:07:15Z)
• Geo-Encoder: A Chunk-Argument Bi-Encoder Framework for Chinese Geographic Re-Ranking [61.60169764507917]
  Chinese geographic re-ranking task aims to find the most relevant addresses among retrieved candidates. We propose an innovative framework, namely Geo-Encoder, to more effectively integrate Chinese geographical semantics into re-ranking pipelines.
  arXiv  Detail & Related papers  (2023-09-04T13:44:50Z)
• GeoGLUE: A GeoGraphic Language Understanding Evaluation Benchmark [56.08664336835741]
  We propose a GeoGraphic Language Understanding Evaluation benchmark, named GeoGLUE. We collect data from open-released geographic resources and introduce six natural language understanding tasks. We pro vide evaluation experiments and analysis of general baselines, indicating the effectiveness and significance of the GeoGLUE benchmark.
  arXiv  Detail & Related papers  (2023-05-11T03:21:56Z)
• SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation [25.52363878314735]
  SpaBERT provides a general-purpose geo-entity representation based on neighboring entities in geospatial data. SpaBERT is pretrained with masked language modeling and masked entity prediction tasks. We apply SpaBERT to two downstream tasks: geo-entity typing and geo-entity linking.
  arXiv  Detail & Related papers  (2022-10-21T19:42:32Z)
• Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitution [124.99894592871385]
  We present a large-scale comparative study of lexical substitution methods employing both old and most recent language models. We show that already competitive results achieved by SOTA LMs/MLMs can be further substantially improved if information about the target word is injected properly.
  arXiv  Detail & Related papers  (2022-06-07T16:16:19Z)
• An Empirical Study on Leveraging Position Embeddings for Target-oriented Opinion Words Extraction [13.765146062545048]
  Target-oriented opinion words extraction (TOWE) is a new subtask of target-oriented sentiment analysis. We show that BiLSTM-based models can effectively encode position information into word representations. We also adapt a graph convolutional network (GCN) to enhance word representations by incorporating syntactic information.
  arXiv  Detail & Related papers  (2021-09-02T22:49:45Z)
• Seed Words Based Data Selection for Language Model Adaptation [11.59717828860318]
  We present an approach for automatically selecting sentences, from a text corpus, that match, both semantically and morphologically, a glossary of terms furnished by the user. The vocabulary of the baseline model is expanded and tailored, reducing the resulting OOV rate. Results using different metrics (OOV rate, WER, precision and recall) show the effectiveness of the proposed techniques.
  arXiv  Detail & Related papers  (2021-07-20T12:08:27Z)
• Accelerating Text Mining Using Domain-Specific Stop Word Lists [57.76576681191192]
  We present a novel approach for the automatic extraction of domain-specific words called the hyperplane-based approach. The hyperplane-based approach can significantly reduce text dimensionality by eliminating irrelevant features. Results indicate that the hyperplane-based approach can reduce the dimensionality of the corpus by 90% and outperforms mutual information.
  arXiv  Detail & Related papers  (2020-11-18T17:42:32Z)
• SIRI: Spatial Relation Induced Network For Spatial Description Resolution [64.38872296406211]
  We propose a novel relationship induced (SIRI) network for language-guided localization. We show that our method is around 24% better than the state-of-the-art method in terms of accuracy, measured by an 80-pixel radius. Our method also generalizes well on our proposed extended dataset collected using the same settings as Touchdown.
  arXiv  Detail & Related papers  (2020-10-27T14:04:05Z)
• A Comparative Study on Structural and Semantic Properties of Sentence Embeddings [77.34726150561087]
  We propose a set of experiments using a widely-used large-scale data set for relation extraction. We show that different embedding spaces have different degrees of strength for the structural and semantic properties. These results provide useful information for developing embedding-based relation extraction methods.
  arXiv  Detail & Related papers  (2020-09-23T15:45:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.