Social Media and Artificial Intelligence for Sustainable Cities and Societies: A Water Quality Analysis Use-case

• URL: http://arxiv.org/abs/2404.14977v1
• Date: Tue, 23 Apr 2024 12:33:14 GMT
• Title: Social Media and Artificial Intelligence for Sustainable Cities and Societies: A Water Quality Analysis Use-case
• Abstract summary: We propose a Natural Language Processing (NLP) framework to automatically collect and analyze water-related posts from social media. For text classification, we propose a merit-fusion-based framework incorporating several Large Language Models (LLMs) In topic modeling, we employed the BERTopic library to discover the hidden topic patterns in the water-related tweets.
• Score: 2.263152338732333
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper focuses on a very important societal challenge of water quality analysis. Being one of the key factors in the economic and social development of society, the provision of water and ensuring its quality has always remained one of the top priorities of public authorities. To ensure the quality of water, different methods for monitoring and assessing the water networks, such as offline and online surveys, are used. However, these surveys have several limitations, such as the limited number of participants and low frequency due to the labor involved in conducting such surveys. In this paper, we propose a Natural Language Processing (NLP) framework to automatically collect and analyze water-related posts from social media for data-driven decisions. The proposed framework is composed of two components, namely (i) text classification, and (ii) topic modeling. For text classification, we propose a merit-fusion-based framework incorporating several Large Language Models (LLMs) where different weight selection and optimization methods are employed to assign weights to the LLMs. In topic modeling, we employed the BERTopic library to discover the hidden topic patterns in the water-related tweets. We also analyzed relevant tweets originating from different regions and countries to explore global, regional, and country-specific issues and water-related concerns. We also collected and manually annotated a large-scale dataset, which is expected to facilitate future research on the topic.

Related papers

• Multimodal QUD: Inquisitive Questions from Scientific Figures [63.41049609329304]
  We generate inquisitive questions that reach the depth of questions humans generate when engaging with scientific papers.<n>We extend the linguistic theory of Questions Under Discussion (QUD) from being text-only to multimodal.<n>We show that fine-tuning a VLM on MQUD shifts the model from generating generic low-level visual questions to content-specific grounding.
  arXiv  Detail & Related papers  (2026-04-26T14:25:23Z)
• OceanPile: A Large-Scale Multimodal Ocean Corpus for Foundation Models [57.19693589926157]
  OceanPile is a large-scale multimodal corpus designed for ocean foundation models.<n>It comprises three key components: OceanCorpus, OceanInstruction, and OceanBenchmark.<n>All datasets are publicly released to advance the field of marine artificial intelligence.
  arXiv  Detail & Related papers  (2026-04-25T14:53:37Z)
• Identifying Trustworthiness Challenges in Deep Learning Models for Continental-Scale Water Quality Prediction [64.4881275941927]
  We present the first comprehensive evaluation of trustworthiness in a continental-scale multi-task LSTM model. Our investigation uncovers systematic patterns of model performance disparities linked to basin characteristics. This work serves as a timely call to action for advancing trustworthy data-driven methods for water resources management.
  arXiv  Detail & Related papers  (2025-03-13T01:50:50Z)
• AIWR: Aerial Image Water Resource Dataset for Segmentation Analysis [0.0]
  This dataset includes 800 aerial images focused on natural and artificial water bodies in northeastern Thailand. It includes ground truth annotations validated by experts in remote sensing. The objective of the proposed dataset is to explore advanced AI-driven methods for water body segmentation.
  arXiv  Detail & Related papers  (2024-11-04T04:45:45Z)
• A Survey of Small Language Models [104.80308007044634]
  Small Language Models (SLMs) have become increasingly important due to their efficiency and performance to perform various language tasks with minimal computational resources. We present a comprehensive survey on SLMs, focusing on their architectures, training techniques, and model compression techniques.
  arXiv  Detail & Related papers  (2024-10-25T23:52:28Z)
• SEN12-WATER: A New Dataset for Hydrological Applications and its Benchmarking [40.996860106131244]
  Climate and increasing droughts pose significant challenges to water resource management around the world. We present a new dataset, SEN12-WATER, along with a benchmark using a end-to-end Deep Learning framework for proactive drought-related analysis.
  arXiv  Detail & Related papers  (2024-09-25T16:50:59Z)
• Examining Long-Context Large Language Models for Environmental Review Document Comprehension [10.299869088789363]
  Long context and retrieval-augmented generation (RAG) are two such methods that have recently gained popularity. In this work, we examine the benefits of both of these techniques by utilizing question answering (QA) task in a niche domain. We construct the NEPAQuAD1.0 benchmark to evaluate the performance of five long-context LLMs.
  arXiv  Detail & Related papers  (2024-07-10T02:33:09Z)
• Analyzing Human Questioning Behavior and Causal Curiosity through Natural Queries [91.70689724416698]
  We present NatQuest, a collection of 13,500 naturally occurring questions from three diverse sources. Our analysis reveals a significant presence of causal questions (up to 42%) within the dataset.
  arXiv  Detail & Related papers  (2024-05-30T17:55:28Z)
• A Comprehensive Survey on Underwater Image Enhancement Based on Deep Learning [51.7818820745221]
  Underwater image enhancement (UIE) presents a significant challenge within computer vision research. Despite the development of numerous UIE algorithms, a thorough and systematic review is still absent.
  arXiv  Detail & Related papers  (2024-05-30T04:46:40Z)
• QuaLLM: An LLM-based Framework to Extract Quantitative Insights from Online Forums [10.684484559041284]
  This study introduces QuaLLM, a novel framework to analyze and extract quantitative insights from text data on online forums. We applied this framework to analyze over one million comments from two Reddit's rideshare worker communities.
  arXiv  Detail & Related papers  (2024-05-08T18:20:03Z)
• Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Models [52.24001776263608]
  This comprehensive survey delves into the recent strides in HS moderation. We highlight the burgeoning role of large language models (LLMs) and large multimodal models (LMMs) We identify existing gaps in research, particularly in the context of underrepresented languages and cultures.
  arXiv  Detail & Related papers  (2024-01-30T03:51:44Z)
• FREE: The Foundational Semantic Recognition for Modeling Environmental Ecosystems [56.0640340392818]
  We introduce a framework, FREE, that enables the use of varying features and available information to train a universal model.<n>The core idea is to map available environmental data into a text space and then convert the traditional predictive modeling task in environmental science to a semantic recognition problem.<n>Our evaluation on two societally important real-world applications, stream water temperature prediction and crop yield prediction, demonstrates the superiority of FREE over multiple baselines.
  arXiv  Detail & Related papers  (2023-11-17T00:53:09Z)
• Bias and Fairness in Large Language Models: A Survey [73.87651986156006]
  We present a comprehensive survey of bias evaluation and mitigation techniques for large language models (LLMs) We first consolidate, formalize, and expand notions of social bias and fairness in natural language processing. We then unify the literature by proposing three intuitive, two for bias evaluation, and one for mitigation.
  arXiv  Detail & Related papers  (2023-09-02T00:32:55Z)
• Stable Bias: Analyzing Societal Representations in Diffusion Models [72.27121528451528]
  We propose a new method for exploring the social biases in Text-to-Image (TTI) systems. Our approach relies on characterizing the variation in generated images triggered by enumerating gender and ethnicity markers in the prompts. We leverage this method to analyze images generated by 3 popular TTI systems and find that while all of their outputs show correlations with US labor demographics, they also consistently under-represent marginalized identities to different extents.
  arXiv  Detail & Related papers  (2023-03-20T19:32:49Z)
• Mining Explainable Predictive Features for Water Quality Management [2.1629199031479396]
  This paper develops a process for collecting data for features that represent a variety of variables over a spatial region. An analysis of the performance of the features is undertaken using the models and Shapley values. Evaluations are performed using several machine learning algorithms and water quality data from the Dublin Grand Canal basin.
  arXiv  Detail & Related papers  (2022-12-08T17:18:50Z)
• Water Goes Where? A Water Resource Allocation Method Based on Multi-Objective Decision-Making [7.558392810342939]
  We study the problem of allocation scheme for Glen Canyon Dam and Hoover Dam in the Colorado River Basin. Taking into consideration of various factors, we build models to achieve optimal scheduling.
  arXiv  Detail & Related papers  (2022-08-03T09:37:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.