Flood severity mapping from Volunteered Geographic Information by
interpreting water level from images containing people: a case study of
Hurricane Harvey
- URL: http://arxiv.org/abs/2006.11802v2
- Date: Wed, 30 Sep 2020 16:11:42 GMT
- Title: Flood severity mapping from Volunteered Geographic Information by
interpreting water level from images containing people: a case study of
Hurricane Harvey
- Authors: Yu Feng, Claus Brenner, Monika Sester
- Abstract summary: Social media, as a new data source, can provide real-time information for flood monitoring.
Recent research focused on the extraction of flood-related posts by analyzing images in addition to texts.
We propose a novel three-step process to extract and map flood severity information.
- Score: 6.655087292045269
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: With increasing urbanization, in recent years there has been a growing
interest and need in monitoring and analyzing urban flood events. Social media,
as a new data source, can provide real-time information for flood monitoring.
The social media posts with locations are often referred to as Volunteered
Geographic Information (VGI), which can reveal the spatial pattern of such
events. Since more images are shared on social media than ever before, recent
research focused on the extraction of flood-related posts by analyzing images
in addition to texts. Apart from merely classifying posts as flood relevant or
not, more detailed information, e.g. the flood severity, can also be extracted
based on image interpretation. However, it has been less tackled and has not
yet been applied for flood severity mapping.
In this paper, we propose a novel three-step process to extract and map flood
severity information. First, flood relevant images are retrieved with the help
of pre-trained convolutional neural networks as feature extractors. Second, the
images containing people are further classified into four severity levels by
observing the relationship between body parts and their partial inundation,
i.e. images are classified according to the water level with respect to
different body parts, namely ankle, knee, hip, and chest. Lastly, locations of
the Tweets are used for generating a map of estimated flood extent and
severity. This process was applied to an image dataset collected during
Hurricane Harvey in 2017, as a proof of concept. The results show that VGI can
be used as a supplement to remote sensing observations for flood extent mapping
and is beneficial, especially for urban areas, where the infrastructure is
often occluding water. Based on the extracted water level information, an
integrated overview of flood severity can be provided for the early stages of
emergency response.
Related papers
- Automated Floodwater Depth Estimation Using Large Multimodal Model for
Rapid Flood Mapping [0.0]
This paper presents an automated and fast approach for estimating floodwater depth from on-site flood photos.
A pre-trained large multimodal model, GPT-4 Vision, was used specifically for estimating floodwater.
Results show that the proposed approach can rapidly provide a consistent and reliable estimation of floodwater depth from flood photos.
arXiv Detail & Related papers (2024-02-26T16:02:15Z) - Leveraging Citizen Science for Flood Extent Detection using Machine
Learning Benchmark Dataset [0.9029386959445269]
We create a labeled known water body extent and flooded area extents during known flooding events covering about 36,000 sq. kilometers of regions within mainland U.S and Bangladesh.
We also leveraged citizen science by open-sourcing the dataset and hosting an open competition based on the dataset to rapidly prototype flood extent detection using community generated models.
We believe the dataset adds to already existing datasets based on Sentinel-1C SAR data and leads to more robust modeling of flood extents.
arXiv Detail & Related papers (2023-11-15T18:49:29Z) - Unpaired Overwater Image Defogging Using Prior Map Guided CycleGAN [60.257791714663725]
We propose a Prior map Guided CycleGAN (PG-CycleGAN) for defogging of images with overwater scenes.
The proposed method outperforms the state-of-the-art supervised, semi-supervised, and unsupervised defogging approaches.
arXiv Detail & Related papers (2022-12-23T03:00:28Z) - Crowdsourced-based Deep Convolutional Networks for Urban Flood Depth
Mapping [1.6244541005112747]
In this paper, a deep convolutional network is used to determine flood depth with high spatial resolution by analyzing crowdsourced images of submerged traffic signs.
Testing the model on photos from a recent flood in the U.S. and Canada yields a mean absolute error of 6.978 in., which is on par with previous studies.
arXiv Detail & Related papers (2022-09-06T18:16:12Z) - There is a Time and Place for Reasoning Beyond the Image [63.96498435923328]
Images often more significant than only the pixels to human eyes, as we can infer, associate, and reason with contextual information from other sources to establish a more complete picture.
We introduce TARA: a dataset with 16k images with their associated news, time and location automatically extracted from New York Times (NYT), and an additional 61k examples as distant supervision from WIT.
We show that there exists a 70% gap between a state-of-the-art joint model and human performance, which is slightly filled by our proposed model that uses segment-wise reasoning, motivating higher-level vision-language joint models that
arXiv Detail & Related papers (2022-03-01T21:52:08Z) - Feasibility study of urban flood mapping using traffic signs for route
optimization [9.973554387848257]
Water events are the most frequent and costliest climate disasters around the world.
In the U.S., an estimated 127 million people who live in coastal areas are at risk of substantial home damage from hurricanes or flooding.
arXiv Detail & Related papers (2021-09-24T02:13:23Z) - Underwater Image Restoration via Contrastive Learning and a Real-world
Dataset [59.35766392100753]
We present a novel method for underwater image restoration based on unsupervised image-to-image translation framework.
Our proposed method leveraged contrastive learning and generative adversarial networks to maximize the mutual information between raw and restored images.
arXiv Detail & Related papers (2021-06-20T16:06:26Z) - CAMERAS: Enhanced Resolution And Sanity preserving Class Activation
Mapping for image saliency [61.40511574314069]
Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input.
We propose CAMERAS, a technique to compute high-fidelity backpropagation saliency maps without requiring any external priors.
arXiv Detail & Related papers (2021-06-20T08:20:56Z) - Generating Physically-Consistent Satellite Imagery for Climate Visualizations [53.61991820941501]
We train a generative adversarial network to create synthetic satellite imagery of future flooding and reforestation events.
A pure deep learning-based model can generate flood visualizations but hallucinates floods at locations that were not susceptible to flooding.
We publish our code and dataset for segmentation guided image-to-image translation in Earth observation.
arXiv Detail & Related papers (2021-04-10T15:00:15Z) - Physics-informed GANs for Coastal Flood Visualization [65.54626149826066]
We create a deep learning pipeline that generates visual satellite images of current and future coastal flooding.
By evaluating the imagery relative to physics-based flood maps, we find that our proposed framework outperforms baseline models in both physical-consistency and photorealism.
While this work focused on the visualization of coastal floods, we envision the creation of a global visualization of how climate change will shape our earth.
arXiv Detail & Related papers (2020-10-16T02:15:34Z) - Water level prediction from social media images with a multi-task
ranking approach [0.0]
We introduce a computer vision system that estimates water depth from social media images taken during flooding events.
We propose a multi-task learning approach, where a model is trained using both a regression and a pairwise ranking loss.
We show that the proposed multi-task approach can predict the water level from a single, crowd-sourced image with 11 cm root mean square error.
arXiv Detail & Related papers (2020-07-14T00:51:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.