Event Prediction in the Big Data Era: A Systematic Survey
- URL: http://arxiv.org/abs/2007.09815v3
- Date: Tue, 4 Aug 2020 23:59:11 GMT
- Title: Event Prediction in the Big Data Era: A Systematic Survey
- Authors: Liang Zhao
- Abstract summary: Event prediction is becoming a viable option in the big data era.
This paper aims to provide a systematic and comprehensive survey of the technologies, applications, and evaluations of event prediction.
- Score: 7.3810864598379755
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Events are occurrences in specific locations, time, and semantics that
nontrivially impact either our society or the nature, such as civil unrest,
system failures, and epidemics. It is highly desirable to be able to anticipate
the occurrence of such events in advance in order to reduce the potential
social upheaval and damage caused. Event prediction, which has traditionally
been prohibitively challenging, is now becoming a viable option in the big data
era and is thus experiencing rapid growth. There is a large amount of existing
work that focuses on addressing the challenges involved, including
heterogeneous multi-faceted outputs, complex dependencies, and streaming data
feeds. Most existing event prediction methods were initially designed to deal
with specific application domains, though the techniques and evaluation
procedures utilized are usually generalizable across different domains.
However, it is imperative yet difficult to cross-reference the techniques
across different domains, given the absence of a comprehensive literature
survey for event prediction. This paper aims to provide a systematic and
comprehensive survey of the technologies, applications, and evaluations of
event prediction in the big data era. First, systematic categorization and
summary of existing techniques are presented, which facilitate domain experts'
searches for suitable techniques and help model developers consolidate their
research at the frontiers. Then, comprehensive categorization and summary of
major application domains are provided. Evaluation metrics and procedures are
summarized and standardized to unify the understanding of model performance
among stakeholders, model developers, and domain experts in various application
domains. Finally, open problems and future directions for this promising and
important domain are elucidated and discussed.
Related papers
- OpenEP: Open-Ended Future Event Prediction [57.63525290892786]
We introduce OpenEP (an Open-Ended Future Event Prediction task), which generates flexible and diverse predictions aligned with real-world scenarios.
For question construction, we pose questions from seven perspectives, including location, time, event development, event outcome, event impact, event response, and other.
For outcome construction, we collect free-form text containing the outcomes as ground truth to provide semantically complete and detail-enriched outcomes.
arXiv Detail & Related papers (2024-08-13T02:35:54Z) - Online Model-based Anomaly Detection in Multivariate Time Series: Taxonomy, Survey, Research Challenges and Future Directions [0.017476232824732776]
Time-series anomaly detection plays an important role in engineering processes.
This survey introduces a novel taxonomy where a distinction between online and offline, and training and inference is made.
It presents the most popular data sets and evaluation metrics used in the literature, as well as a detailed analysis.
arXiv Detail & Related papers (2024-08-07T13:01:10Z) - A Comprehensive Library for Benchmarking Multi-class Visual Anomaly Detection [52.228708947607636]
This paper introduces a comprehensive visual anomaly detection benchmark, ADer, which is a modular framework for new methods.
The benchmark includes multiple datasets from industrial and medical domains, implementing fifteen state-of-the-art methods and nine comprehensive metrics.
We objectively reveal the strengths and weaknesses of different methods and provide insights into the challenges and future directions of multi-class visual anomaly detection.
arXiv Detail & Related papers (2024-06-05T13:40:07Z) - Information Cascade Prediction under Public Emergencies: A Survey [14.675738714779099]
This paper offers a systematic classification and summary of information cascade modeling, prediction, and application.
We aim to help researchers identify cutting-edge research and comprehend models and methods of information cascade prediction under public emergencies.
arXiv Detail & Related papers (2024-03-28T03:46:56Z) - Large Models for Time Series and Spatio-Temporal Data: A Survey and
Outlook [95.32949323258251]
Temporal data, notably time series andtemporal-temporal data, are prevalent in real-world applications.
Recent advances in large language and other foundational models have spurred increased use in time series andtemporal data mining.
arXiv Detail & Related papers (2023-10-16T09:06:00Z) - Performative Time-Series Forecasting [71.18553214204978]
We formalize performative time-series forecasting (PeTS) from a machine-learning perspective.
We propose a novel approach, Feature Performative-Shifting (FPS), which leverages the concept of delayed response to anticipate distribution shifts.
We conduct comprehensive experiments using multiple time-series models on COVID-19 and traffic forecasting tasks.
arXiv Detail & Related papers (2023-10-09T18:34:29Z) - A Comprehensive Survey on Rare Event Prediction [1.6385815610837167]
Rare event prediction involves identifying and forecasting events with a low probability using machine learning (ML) and data analysis.
This paper aims to identify gaps in the current literature and highlight the challenges of predicting rare events.
arXiv Detail & Related papers (2023-09-20T14:36:57Z) - A Survey on Event Prediction Methods from a Systems Perspective:
Bringing Together Disparate Research Areas [0.0]
Event prediction aims to support the user in deciding on actions that change future events towards a desired state.
The diversity of application domains results in a diverse range of methods that are scattered across various research areas.
To facilitate knowledge sharing on account of a comprehensive classification, integration, and assessment of event prediction methods, we combine and take a systems perspective.
arXiv Detail & Related papers (2023-02-08T12:21:02Z) - Data-Centric Epidemic Forecasting: A Survey [56.99209141838794]
This survey delves into various data-driven methodological and practical advancements.
We enumerate the large number of epidemiological datasets and novel data streams that are relevant to epidemic forecasting.
We also discuss experiences and challenges that arise in real-world deployment of these forecasting systems.
arXiv Detail & Related papers (2022-07-19T16:15:11Z) - On Exposing the Challenging Long Tail in Future Prediction of Traffic
Actors [38.782472905505124]
Most critical scenarios are less frequent and more complex than the uncriticalones.
In this paper, we address specifically the challenging scenarios at the long tail of the dataset distribution.
We show on four public datasets that this leads to improved performance on the challenging scenarios while the overall performance stays stable.
arXiv Detail & Related papers (2021-03-23T11:56:15Z) - Through the Data Management Lens: Experimental Analysis and Evaluation
of Fair Classification [75.49600684537117]
Data management research is showing an increasing presence and interest in topics related to data and algorithmic fairness.
We contribute a broad analysis of 13 fair classification approaches and additional variants, over their correctness, fairness, efficiency, scalability, and stability.
Our analysis highlights novel insights on the impact of different metrics and high-level approach characteristics on different aspects of performance.
arXiv Detail & Related papers (2021-01-18T22:55:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.