Efficient Data Management for Intelligent Urban Mobility Systems
- URL: http://arxiv.org/abs/2101.09261v1
- Date: Fri, 22 Jan 2021 18:28:04 GMT
- Title: Efficient Data Management for Intelligent Urban Mobility Systems
- Authors: Michael Wilbur, Philip Pugliese, Aron Laszka, Abhishek Dubey
- Abstract summary: We present an integrated data management and processing framework for intelligent urban mobility systems.
We discuss the available data sources and outline our cloud-centric data management and stream processing architecture.
- Score: 6.808852580156539
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Modern intelligent urban mobility applications are underpinned by
large-scale, multivariate, spatiotemporal data streams. Working with this data
presents unique challenges of data management, processing and presentation that
is often overlooked by researchers. Therefore, in this work we present an
integrated data management and processing framework for intelligent urban
mobility systems currently in use by our partner transit agencies. We discuss
the available data sources and outline our cloud-centric data management and
stream processing architecture built upon open-source publish-subscribe and
NoSQL data stores. We then describe our data-integrity monitoring methods. We
then present a set of visualization dashboards designed for our transit agency
partners. Lastly, we discuss how these tools are currently being used for
AI-driven urban mobility applications that use these tools.
Related papers
- Enhancing Pavement Sensor Data Acquisition for AI-Driven Transportation Research [1.22995445255292]
This paper presents comprehensive guidelines for managing transportation sensor data.
It covers both archived static data and real-time data streams.
The proposals were applied to INDOT's real-world case studies involving the I-65 and I-69 Greenfield districts.
arXiv Detail & Related papers (2025-02-20T03:37:46Z) - Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows? [73.81908518992161]
We introduce Spider2-V, the first multimodal agent benchmark focusing on professional data science and engineering.
Spider2-V features real-world tasks in authentic computer environments and incorporating 20 enterprise-level professional applications.
These tasks evaluate the ability of a multimodal agent to perform data-related tasks by writing code and managing the GUI in enterprise data software systems.
arXiv Detail & Related papers (2024-07-15T17:54:37Z) - Data Management For Training Large Language Models: A Survey [64.18200694790787]
Data plays a fundamental role in training Large Language Models (LLMs)
This survey aims to provide a comprehensive overview of current research in data management within both the pretraining and supervised fine-tuning stages of LLMs.
arXiv Detail & Related papers (2023-12-04T07:42:16Z) - Modeling Data Analytics Architecture for Smart Cities Data-Driven
Applications using DAT [1.8945921149936187]
This article shares our experiences in developing a Data Analytics Architecture (DAA) using model-driven engineering for Data-Driven Smart Cities applications utilizing DAT.
DAA uses model-driven engineering for Data-Driven Smart Cities applications utilizing DAT.
arXiv Detail & Related papers (2023-07-17T21:52:57Z) - DAT: Data Architecture Modeling Tool for Data-Driven Applications [1.6037279419318131]
Data Architecture (DA) focuses on describing, collecting, storing, processing, and analyzing the data to meet business needs.
We present the DAT, a model-driven engineering tool enabling data architects, data engineers, and other stakeholders to describe how data flows through the system.
arXiv Detail & Related papers (2023-06-21T11:24:59Z) - Intelligent Traffic Monitoring with Hybrid AI [78.65479854534858]
We introduce HANS, a neuro-symbolic architecture for multi-modal context understanding.
We show how HANS addresses the challenges associated with traffic monitoring while being able to integrate with a wide range of reasoning methods.
arXiv Detail & Related papers (2022-08-31T17:47:22Z) - TRoVE: Transforming Road Scene Datasets into Photorealistic Virtual
Environments [84.6017003787244]
This work proposes a synthetic data generation pipeline to address the difficulties and domain-gaps present in simulated datasets.
We show that using annotations and visual cues from existing datasets, we can facilitate automated multi-modal data generation.
arXiv Detail & Related papers (2022-08-16T20:46:08Z) - Nemo: Guiding and Contextualizing Weak Supervision for Interactive Data
Programming [77.38174112525168]
We present Nemo, an end-to-end interactive Supervision system that improves overall productivity of WS learning pipeline by an average 20% (and up to 47% in one task) compared to the prevailing WS supervision approach.
arXiv Detail & Related papers (2022-03-02T19:57:32Z) - AI in Smart Cities: Challenges and approaches to enable road vehicle
automation and smart traffic control [56.73750387509709]
SCC ideates on a data-centered society aiming at improving efficiency by automating and optimizing activities and utilities.
This paper describes AI perspectives in SCC and gives an overview of AI-based technologies used in traffic to enable road vehicle automation and smart traffic control.
arXiv Detail & Related papers (2021-04-07T14:31:08Z) - Artificial Intelligence (AI)-Centric Management of Resources in Modern
Distributed Computing Systems [22.550075095184514]
Cloud Data Centres (DCS) are large scale, complex, heterogeneous, and distributed across multiple networks and geographical boundaries.
The Internet of Things (IoT)-driven applications are producing a huge amount of data that requires real-time processing and fast response.
Existing Resource Management Systems (RMS) rely on either static or solutions inadequate for such composite and dynamic systems.
arXiv Detail & Related papers (2020-06-09T06:54:07Z) - From Data to Actions in Intelligent Transportation Systems: a
Prescription of Functional Requirements for Model Actionability [10.27718355111707]
This work aims to describe how data, coming from diverse ITS sources, can be used to learn and adapt data-driven models for efficiently operating ITS assets, systems and processes.
Grounded in this described data modeling pipeline for ITS, wedefine the characteristics, engineering requisites and intrinsic challenges to its three compounding stages, namely, data fusion, adaptive learning and model evaluation.
arXiv Detail & Related papers (2020-02-06T12:02:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.