Deep Learning for Climate Action: Computer Vision Analysis of Visual Narratives on X

• URL: http://arxiv.org/abs/2503.09361v1
• Date: Wed, 12 Mar 2025 13:03:49 GMT
• Title: Deep Learning for Climate Action: Computer Vision Analysis of Visual Narratives on X
• Authors: Katharina Prasse, Marcel Kleinmann, Inken Adam, Kerstin Beckersjuergen, Andreas Edte, Jona Frroku, Timotheus Gumpp, Steffen Jung, Isaac Bravo, Stefanie Walter, Margret Keuper,
• Abstract summary: We analyze a dataset of climate change-related tweets from X (formerly Twitter) shared in 2019, containing 730k tweets along with the shared images.<n>Our approach integrates statistical analysis, image classification, object detection, and sentiment analysis to explore visual narratives in climate discourse.<n>Our findings reveal key themes in climate communication, highlight sentiment divergence between images and text, and underscore the strengths and limitations of foundation models in analyzing social media imagery.
• Score: 10.72175732685513
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Climate change is one of the most pressing challenges of the 21st century, sparking widespread discourse across social media platforms. Activists, policymakers, and researchers seek to understand public sentiment and narratives while access to social media data has become increasingly restricted in the post-API era. In this study, we analyze a dataset of climate change-related tweets from X (formerly Twitter) shared in 2019, containing 730k tweets along with the shared images. Our approach integrates statistical analysis, image classification, object detection, and sentiment analysis to explore visual narratives in climate discourse. Additionally, we introduce a graphical user interface (GUI) to facilitate interactive data exploration. Our findings reveal key themes in climate communication, highlight sentiment divergence between images and text, and underscore the strengths and limitations of foundation models in analyzing social media imagery. By releasing our code and tools, we aim to support future research on the intersection of climate change, social media, and computer vision.

Related papers

• Understanding Opinions Towards Climate Change on Social Media [2.31449645503075]
  We aim to understand how real world events influence the opinions of individuals towards climate change related topics on social media. We extracted and analyzed a dataset of 13.6 millions tweets sent by 3.6 million users from 2006 to 2019. Our work acts as a first step towards understanding the evolution of pro-climate change communities around COP events.
  arXiv  Detail & Related papers  (2023-12-02T20:02:34Z)
• ClimateNLP: Analyzing Public Sentiment Towards Climate Change Using Natural Language Processing [0.0]
  This paper employs natural language processing (NLP) techniques to analyze climate change discourse and quantify the sentiment of climate change-related tweets. The objective is to discern the sentiment individuals express and uncover patterns in public opinion concerning climate change.
  arXiv  Detail & Related papers  (2023-10-12T07:48:50Z)
• EDSA-Ensemble: an Event Detection Sentiment Analysis Ensemble Architecture [63.85863519876587]
  Using Sentiment Analysis to understand the polarity of each message belonging to an event, as well as the entire event, can help to better understand the general and individual feelings of significant trends and the dynamics on online social networks. We propose a new ensemble architecture, EDSA-Ensemble, that uses Event Detection and Sentiment Analysis to improve the detection of the polarity for current events from Social Media.
  arXiv  Detail & Related papers  (2023-01-30T11:56:08Z)
• Self-supervised Hypergraph Representation Learning for Sociological Analysis [52.514283292498405]
  We propose a fundamental methodology to support the further fusion of data mining techniques and sociological behavioral criteria. First, we propose an effective hypergraph awareness and a fast line graph construction framework. Second, we propose a novel hypergraph-based neural network to learn social influence flowing from users to users.
  arXiv  Detail & Related papers  (2022-12-22T01:20:29Z)
• Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey [71.43956423427397]
  We aim to identify the nonverbal cues and computational methodologies resulting in effective performance. This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings. Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
  arXiv  Detail & Related papers  (2022-07-20T13:37:57Z)
• Trend and Thoughts: Understanding Climate Change Concern using Machine Learning and Social Media Data [3.7384509727711923]
  We constructed a massive climate change Twitter dataset and conducted comprehensive analysis using machine learning. By conducting topic modeling and natural language processing, we show the relationship between the number of tweets about climate change and major climate events. Our dataset was published on Kaggle and can be used in further research.
  arXiv  Detail & Related papers  (2021-11-06T19:59:03Z)
• Exploiting Scene Graphs for Human-Object Interaction Detection [81.49184987430333]
  Human-Object Interaction (HOI) detection is a fundamental visual task aiming at localizing and recognizing interactions between humans and objects. We propose a novel method to exploit this information, through the scene graph, for the Human-Object Interaction (SG2HOI) detection task. Our method, SG2HOI, incorporates the SG information in two ways: (1) we embed a scene graph into a global context clue, serving as the scene-specific environmental context; and (2) we build a relation-aware message-passing module to gather relationships from objects' neighborhood and transfer them into interactions.
  arXiv  Detail & Related papers  (2021-08-19T09:40:50Z)
• Enhancing Social Relation Inference with Concise Interaction Graph and Discriminative Scene Representation [56.25878966006678]
  We propose an approach of textbfPRactical textbfInference in textbfSocial rtextbfElation (PRISE) It concisely learns interactive features of persons and discriminative features of holistic scenes. PRISE achieves 6.8$%$ improvement for domain classification in PIPA dataset.
  arXiv  Detail & Related papers  (2021-07-30T04:20:13Z)
• Affective Image Content Analysis: Two Decades Review and New Perspectives [132.889649256384]
  We will comprehensively review the development of affective image content analysis (AICA) in the recent two decades. We will focus on the state-of-the-art methods with respect to three main challenges -- the affective gap, perception subjectivity, and label noise and absence. We discuss some challenges and promising research directions in the future, such as image content and context understanding, group emotion clustering, and viewer-image interaction.
  arXiv  Detail & Related papers  (2021-06-30T15:20:56Z)
• Computational Emotion Analysis From Images: Recent Advances and Future Directions [79.05003998727103]
  In this chapter, we aim to introduce image emotion analysis (IEA) from a computational perspective. We begin with commonly used emotion representation models from psychology. We then define the key computational problems that the researchers have been trying to solve.
  arXiv  Detail & Related papers  (2021-03-19T13:33:34Z)
• ClimaText: A Dataset for Climate Change Topic Detection [2.9767565026354186]
  We introduce textscClimaText, a dataset for sentence-based climate change topic detection. We find that popular keyword-based models are not adequate for such a complex and evolving task. Our analysis reveals a great potential for improvement in several directions.
  arXiv  Detail & Related papers  (2020-12-01T13:42:37Z)
• Visual Sentiment Analysis from Disaster Images in Social Media [11.075683976162766]
  This article focuses on visual sentiment analysis in a societal important domain, namely disaster analysis in social media. We propose a deep visual sentiment analyzer for disaster related images, covering different aspects of visual sentiment analysis. We believe the proposed system can contribute toward more livable communities by helping different stakeholders.
  arXiv  Detail & Related papers  (2020-09-04T11:29:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.