Urban Crowdsensing using Social Media: An Empirical Study on Transformer and Recurrent Neural Networks

• URL: http://arxiv.org/abs/2012.03057v1
• Date: Sat, 5 Dec 2020 15:36:50 GMT
• Title: Urban Crowdsensing using Social Media: An Empirical Study on Transformer and Recurrent Neural Networks
• Authors: Jerome Heng, Junhua Liu and Kwan Hui Lim
• Abstract summary: We utilize publicly available social media datasets and use them as the basis for two urban sensing problems. One main contribution of this work is our collected dataset from Twitter and Flickr. We demonstrate the usefulness of this dataset with two preliminary supervised learning approaches.
• Score: 0.7090165638014329
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: An important aspect of urban planning is understanding crowd levels at various locations, which typically require the use of physical sensors. Such sensors are potentially costly and time consuming to implement on a large scale. To address this issue, we utilize publicly available social media datasets and use them as the basis for two urban sensing problems, namely event detection and crowd level prediction. One main contribution of this work is our collected dataset from Twitter and Flickr, alongside ground truth events. We demonstrate the usefulness of this dataset with two preliminary supervised learning approaches: firstly, a series of neural network models to determine if a social media post is related to an event and secondly a regression model using social media post counts to predict actual crowd levels. We discuss preliminary results from these tasks and highlight some challenges.

Related papers

• Social-LLM: Modeling User Behavior at Scale using Language Models and Social Network Data [13.660150473547766]
  We introduce a novel approach tailored for modeling social network data in user detection tasks. Our method integrates localized social network interactions with the capabilities of large language models. We conduct a thorough evaluation of our method across seven real-world social network datasets.
  arXiv  Detail & Related papers  (2023-12-31T05:13:13Z)
• CrisisMatch: Semi-Supervised Few-Shot Learning for Fine-Grained Disaster Tweet Classification [51.58605842457186]
  We present a fine-grained disaster tweet classification model under the semi-supervised, few-shot learning setting. Our model, CrisisMatch, effectively classifies tweets into fine-grained classes of interest using few labeled data and large amounts of unlabeled data.
  arXiv  Detail & Related papers  (2023-10-23T07:01:09Z)
• Organized Event Participant Prediction Enhanced by Social Media Retweeting Data [8.675064911866201]
  We propose to utilize social media retweeting activity data to enhance the learning of event participant prediction models. We conduct comprehensive experiments in two scenarios with real-world data.
  arXiv  Detail & Related papers  (2023-10-02T04:26:07Z)
• EDSA-Ensemble: an Event Detection Sentiment Analysis Ensemble Architecture [63.85863519876587]
  Using Sentiment Analysis to understand the polarity of each message belonging to an event, as well as the entire event, can help to better understand the general and individual feelings of significant trends and the dynamics on online social networks. We propose a new ensemble architecture, EDSA-Ensemble, that uses Event Detection and Sentiment Analysis to improve the detection of the polarity for current events from Social Media.
  arXiv  Detail & Related papers  (2023-01-30T11:56:08Z)
• Evidential Temporal-aware Graph-based Social Event Detection via Dempster-Shafer Theory [76.4580340399321]
  We propose ETGNN, a novel Evidential Temporal-aware Graph Neural Network. We construct view-specific graphs whose nodes are the texts and edges are determined by several types of shared elements respectively. Considering the view-specific uncertainty, the representations of all views are converted into mass functions through evidential deep learning (EDL) neural networks.
  arXiv  Detail & Related papers  (2022-05-24T16:22:40Z)
• HumAID: Human-Annotated Disaster Incidents Data from Twitter with Deep Learning Benchmarks [5.937482215664902]
  Social media content is often too noisy for direct use in any application. It is important to filter, categorize, and concisely summarize the available content to facilitate effective consumption and decision-making. We present a new large-scale dataset with 77K human-labeled tweets, sampled from a pool of 24 million tweets across 19 disaster events.
  arXiv  Detail & Related papers  (2021-04-07T12:29:36Z)
• Human Trajectory Forecasting in Crowds: A Deep Learning Perspective [89.4600982169]
  We present an in-depth analysis of existing deep learning-based methods for modelling social interactions. We propose two knowledge-based data-driven methods to effectively capture these social interactions. We develop a large scale interaction-centric benchmark TrajNet++, a significant yet missing component in the field of human trajectory forecasting.
  arXiv  Detail & Related papers  (2020-07-07T17:19:56Z)
• Over-crowdedness Alert! Forecasting the Future Crowd Distribution [87.12694319017346]
  We formulate a novel crowd analysis problem, in which we aim to predict the crowd distribution in the near future given sequential frames of a crowd video without any identity annotations. To solve this problem, we propose a global-residual two-stream recurrent network, which leverages the consecutive crowd video frames as inputs and their corresponding density maps as auxiliary information.
  arXiv  Detail & Related papers  (2020-06-09T08:59:54Z)
• Predicting event attendance exploring social influence [0.5134435281973136]
  We propose to model the social influence of friends on event attendance. We consider non-geotagged posts besides structures of social groups to infer users' attendance. The performance evaluation is conducted using two large music festivals datasets.
  arXiv  Detail & Related papers  (2020-02-16T20:03:29Z)
• I Know Where You Are Coming From: On the Impact of Social Media Sources on AI Model Performance [79.05613148641018]
  We will study the performance of different machine learning models when being learned on multi-modal data from different social networks. Our initial experimental results reveal that social network choice impacts the performance.
  arXiv  Detail & Related papers  (2020-02-05T11:10:44Z)
• Understanding Crowd Behaviors in a Social Event by Passive WiFi Sensing and Data Mining [21.343209622186606]
  We propose a comprehensive data analysis framework to extract three types of patterns related to crowd behaviors in a large social event. First, trajectories of the mobile devices are extracted from probe requests to reveal the spatial patterns of the crowds' movement. Next, k-means and k-shape clustering algorithms are applied to extract temporal patterns visiting the crowds by days and locations.
  arXiv  Detail & Related papers  (2020-02-05T03:36:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.