Flood Analytics Information System (FAIS) Version 4.00 Manual
- URL: http://arxiv.org/abs/2112.01375v1
- Date: Tue, 30 Nov 2021 15:46:38 GMT
- Title: Flood Analytics Information System (FAIS) Version 4.00 Manual
- Authors: Vidya Samadi
- Abstract summary: This project was the first attempt to use big data analytics approaches and machine learning along with Natural Language Processing (NLP) of tweets for flood risk assessment and decision making.
Multiple Python packages were developed and integrated within the Flood Analytics Information System (FAIS)
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This project was the first attempt to use big data analytics approaches and
machine learning along with Natural Language Processing (NLP) of tweets for
flood risk assessment and decision making. Multiple Python packages were
developed and integrated within the Flood Analytics Information System (FAIS).
FAIS workflow includes the use of IoTs-APIs and various machine learning
approaches for transmitting, processing, and loading big data through which the
application gathers information from various data servers and replicates it to
a data warehouse (IBM database service). Users are allowed to directly stream
and download flood related images/videos from the US Geological Survey (USGS)
and Department of Transportation (DOT) and save the data on a local storage.
The outcome of the river measurement, imagery, and tabular data is displayed on
a web based remote dashboard and the information can be plotted in real-time.
FAIS proved to be a robust and user-friendly tool for flood data analysis at
regional scale that could help stakeholders for rapid assessment of flood
situation and damages. FAIS also provides flood frequency analysis (FFA) to
estimate flood quantiles including the associated uncertainties that combine
the elements of observational analysis, stochastic probability distribution and
design return periods. FAIS is publicly available and deployed on the
Clemson-IBM cloud service.
Related papers
- Enabling Advanced Land Cover Analytics: An Integrated Data Extraction Pipeline for Predictive Modeling with the Dynamic World Dataset [1.3757956340051605]
We present a flexible and efficient end to end pipeline for working with the Dynamic World dataset.
This includes a pre-processing and representation framework which tackles noise removal, efficient extraction of large amounts of data, and re-representation of LULC data.
To demonstrate the power of our pipeline, we use it to extract data for an urbanization prediction problem and build a suite of machine learning models with excellent performance.
arXiv Detail & Related papers (2024-10-11T16:13:01Z) - Downstream-Pretext Domain Knowledge Traceback for Active Learning [138.02530777915362]
We propose a downstream-pretext domain knowledge traceback (DOKT) method that traces the data interactions of downstream knowledge and pre-training guidance.
DOKT consists of a traceback diversity indicator and a domain-based uncertainty estimator.
Experiments conducted on ten datasets show that our model outperforms other state-of-the-art methods.
arXiv Detail & Related papers (2024-07-20T01:34:13Z) - Leveraging Citizen Science for Flood Extent Detection using Machine
Learning Benchmark Dataset [0.9029386959445269]
We create a labeled known water body extent and flooded area extents during known flooding events covering about 36,000 sq. kilometers of regions within mainland U.S and Bangladesh.
We also leveraged citizen science by open-sourcing the dataset and hosting an open competition based on the dataset to rapidly prototype flood extent detection using community generated models.
We believe the dataset adds to already existing datasets based on Sentinel-1C SAR data and leads to more robust modeling of flood extents.
arXiv Detail & Related papers (2023-11-15T18:49:29Z) - Pathway: a fast and flexible unified stream data processing framework
for analytical and Machine Learning applications [7.850979932441607]
Pathway is a new unified data processing framework that can run workloads on both bounded and unbounded data streams.
We describe the system and present benchmarking results which demonstrate its capabilities in both batch and streaming contexts.
arXiv Detail & Related papers (2023-07-12T08:27:37Z) - LargeST: A Benchmark Dataset for Large-Scale Traffic Forecasting [65.71129509623587]
Road traffic forecasting plays a critical role in smart city initiatives and has experienced significant advancements thanks to the power of deep learning.
However, the promising results achieved on current public datasets may not be applicable to practical scenarios.
We introduce the LargeST benchmark dataset, which includes a total of 8,600 sensors in California with a 5-year time coverage.
arXiv Detail & Related papers (2023-06-14T05:48:36Z) - An IoT Cloud and Big Data Architecture for the Maintenance of Home
Appliances [0.0722732388409495]
This work introduces a distributed and scalable platform architecture that can be deployed for efficient big data collection and analytics.
The proposed system was tested with a case study for Predictive Maintenance of Home Appliances.
The experimental results demonstrated that the presented system could be advantageous for tackling real-world IoT scenarios in a cost-effective and local approach.
arXiv Detail & Related papers (2022-10-25T13:25:00Z) - Semantic Segmentation of Vegetation in Remote Sensing Imagery Using Deep
Learning [77.34726150561087]
We propose an approach for creating a multi-modal and large-temporal dataset comprised of publicly available Remote Sensing data.
We use Convolutional Neural Networks (CNN) models that are capable of separating different classes of vegetation.
arXiv Detail & Related papers (2022-09-28T18:51:59Z) - TRoVE: Transforming Road Scene Datasets into Photorealistic Virtual
Environments [84.6017003787244]
This work proposes a synthetic data generation pipeline to address the difficulties and domain-gaps present in simulated datasets.
We show that using annotations and visual cues from existing datasets, we can facilitate automated multi-modal data generation.
arXiv Detail & Related papers (2022-08-16T20:46:08Z) - Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision
Datasets from 3D Scans [103.92680099373567]
This paper introduces a pipeline to parametrically sample and render multi-task vision datasets from comprehensive 3D scans from the real world.
Changing the sampling parameters allows one to "steer" the generated datasets to emphasize specific information.
Common architectures trained on a generated starter dataset reached state-of-the-art performance on multiple common vision tasks and benchmarks.
arXiv Detail & Related papers (2021-10-11T04:21:46Z) - Vessel and Port Efficiency Metrics through Validated AIS data [0.0]
We propose a machine learning-based data-driven methodology to detect and correct erroneous AIS data.
We also propose a metric that can be used by vessel operators and ports to express numerically their business and environmental efficiency.
arXiv Detail & Related papers (2021-04-30T19:51:51Z) - PyODDS: An End-to-end Outlier Detection System with Automated Machine
Learning [55.32009000204512]
We present PyODDS, an automated end-to-end Python system for Outlier Detection with Database Support.
Specifically, we define the search space in the outlier detection pipeline, and produce a search strategy within the given search space.
It also provides unified interfaces and visualizations for users with or without data science or machine learning background.
arXiv Detail & Related papers (2020-03-12T03:30:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.