Predicting the Geolocation of Tweets Using transformer models on Customized Data

• URL: http://arxiv.org/abs/2303.07865v6
• Date: Sat, 02 Nov 2024 16:56:36 GMT
• Title: Predicting the Geolocation of Tweets Using transformer models on Customized Data
• Authors: Kateryna Lutsai, Christoph H. Lampert,
• Abstract summary: This research is aimed to solve the tweet/user geolocation prediction task. The suggested approach implements neural networks for natural language processing to estimate the location. The scope of proposed models has been finetuned on a Twitter dataset.
• Score: 17.55660062746406
• License:
• Abstract: This research is aimed to solve the tweet/user geolocation prediction task and provide a flexible methodology for the geotagging of textual big data. The suggested approach implements neural networks for natural language processing (NLP) to estimate the location as coordinate pairs (longitude, latitude) and two-dimensional Gaussian Mixture Models (GMMs). The scope of proposed models has been finetuned on a Twitter dataset using pretrained Bidirectional Encoder Representations from Transformers (BERT) as base models. Performance metrics show a median error of fewer than 30 km on a worldwide-level, and fewer than 15 km on the US-level datasets for the models trained and evaluated on text features of tweets' content and metadata context. Our source code and data are available at https://github.com/K4TEL/geo-twitter.git

Related papers

• Learning Defect Prediction from Unrealistic Data [57.53586547895278]
  Pretrained models of code have become popular choices for code understanding and generation tasks. Such models tend to be large and require commensurate volumes of training data. It has become popular to train models with far larger but less realistic datasets, such as functions with artificially injected bugs. Models trained on such data tend to only perform well on similar data, while underperforming on real world programs.
  arXiv  Detail & Related papers  (2023-11-02T01:51:43Z)
• GeoLLM: Extracting Geospatial Knowledge from Large Language Models [49.20315582673223]
  We present GeoLLM, a novel method that can effectively extract geospatial knowledge from large language models. We demonstrate the utility of our approach across multiple tasks of central interest to the international community, including the measurement of population density and economic livelihoods. Our experiments reveal that LLMs are remarkably sample-efficient, rich in geospatial information, and robust across the globe.
  arXiv  Detail & Related papers  (2023-10-10T00:03:23Z)
• Context-Based Tweet Engagement Prediction [0.0]
  This thesis investigates how well context alone may be used to predict tweet engagement likelihood. We employed the Spark engine on TU Wien's Little Big Data Cluster to create scalable data preprocessing, feature engineering, feature selection, and machine learning pipelines. We also found that factors such as the prediction algorithm, training dataset size, training dataset sampling method, and feature selection significantly affect the results.
  arXiv  Detail & Related papers  (2023-09-28T08:36:57Z)
• Heterogenous Ensemble of Models for Molecular Property Prediction [55.91865861896012]
  We propose a method for considering different modalities on molecules. We ensemble these models with a HuberRegressor. This yields a winning solution to the 2textsuperscriptnd edition of the OGB Large-Scale Challenge (2022)
  arXiv  Detail & Related papers  (2022-11-20T17:25:26Z)
• Hyperbolic Vision Transformers: Combining Improvements in Metric Learning [116.13290702262248]
  We propose a new hyperbolic-based model for metric learning. At the core of our method is a vision transformer with output embeddings mapped to hyperbolic space. We evaluate the proposed model with six different formulations on four datasets.
  arXiv  Detail & Related papers  (2022-03-21T09:48:23Z)
• Regressing Location on Text for Probabilistic Geocoding [0.0]
  We present an end-to-end probabilistic model for geocoding text data. We compare the model-based solution, called ELECTRo-map, to the current state-of-the-art open source system for geocoding texts for event data.
  arXiv  Detail & Related papers  (2021-06-30T20:04:55Z)
• UnibucKernel: Geolocating Swiss-German Jodels Using Ensemble Learning [15.877673959068455]
  We focus on the second subtask, which is based on a data set formed of approximately 30 thousand Swiss German Jodels. The dialect identification task is about accurately predicting the latitude and longitude of test samples. We frame the task as a double regression problem, employing an XGBoost meta-learner with the combined power of a variety of machine learning approaches.
  arXiv  Detail & Related papers  (2021-02-18T14:26:00Z)
• Combining Deep Learning and String Kernels for the Localization of Swiss German Tweets [28.497747521078647]
  We address the second subtask, which targets a data set composed of nearly 30 thousand Swiss German Jodels. We frame the task as a double regression problem, employing a variety of machine learning approaches to predict both latitude and longitude. Our empirical results indicate that the handcrafted model based on string kernels outperforms the deep learning approaches.
  arXiv  Detail & Related papers  (2020-10-07T19:16:45Z)
• $n$-Reference Transfer Learning for Saliency Prediction [73.17061116358036]
  We propose a few-shot transfer learning paradigm for saliency prediction. The proposed framework is gradient-based and model-agnostic. The results show that the proposed framework achieves a significant performance improvement.
  arXiv  Detail & Related papers  (2020-07-09T23:20:44Z)
• Localized convolutional neural networks for geospatial wind forecasting [0.0]
  Convolutional Neural Networks (CNN) possess positive qualities when it comes to many spatial data. In this work, we propose localized convolutional neural networks that enable CNNs to learn local features in addition to the global ones. They can be added to any convolutional layers, easily end-to-end trained, introduce minimal additional complexity, and let CNNs retain most of their benefits to the extent that they are needed.
  arXiv  Detail & Related papers  (2020-05-12T17:14:49Z)
• Parameter Space Factorization for Zero-Shot Learning across Tasks and Languages [112.65994041398481]
  We propose a Bayesian generative model for the space of neural parameters. We infer the posteriors over such latent variables based on data from seen task-language combinations. Our model yields comparable or better results than state-of-the-art, zero-shot cross-lingual transfer methods.
  arXiv  Detail & Related papers  (2020-01-30T16:58:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.