A Survey on the Applications of Frontier AI, Foundation Models, and
Large Language Models to Intelligent Transportation Systems
- URL: http://arxiv.org/abs/2401.06831v1
- Date: Fri, 12 Jan 2024 10:29:48 GMT
- Title: A Survey on the Applications of Frontier AI, Foundation Models, and
Large Language Models to Intelligent Transportation Systems
- Authors: Mohamed R. Shoaib, Heba M. Emara, Jun Zhao
- Abstract summary: This survey paper explores the transformative influence of frontier AI, foundation models, and Large Language Models (LLMs) in the realm of Intelligent Transportation Systems (ITS)
It emphasizes their integral role in advancing transportation intelligence, optimizing traffic management, and contributing to the realization of smart cities.
- Score: 8.017557640367938
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This survey paper explores the transformative influence of frontier AI,
foundation models, and Large Language Models (LLMs) in the realm of Intelligent
Transportation Systems (ITS), emphasizing their integral role in advancing
transportation intelligence, optimizing traffic management, and contributing to
the realization of smart cities. Frontier AI refers to the forefront of AI
technology, encompassing the latest advancements, innovations, and experimental
techniques in the field, especially AI foundation models and LLMs. Foundation
models, like GPT-4, are large, general-purpose AI models that provide a base
for a wide range of applications. They are characterized by their versatility
and scalability. LLMs are obtained from finetuning foundation models with a
specific focus on processing and generating natural language. They excel in
tasks like language understanding, text generation, translation, and
summarization. By leveraging vast textual data, including traffic reports and
social media interactions, LLMs extract critical insights, fostering the
evolution of ITS. The survey navigates the dynamic synergy between LLMs and
ITS, delving into applications in traffic management, integration into
autonomous vehicles, and their role in shaping smart cities. It provides
insights into ongoing research, innovations, and emerging trends, aiming to
inspire collaboration at the intersection of language, intelligence, and
mobility for safer, more efficient, and sustainable transportation systems. The
paper further surveys interactions between LLMs and various aspects of ITS,
exploring roles in traffic management, facilitating autonomous vehicles, and
contributing to smart city development, while addressing challenges brought by
frontier AI and foundation models. This paper offers valuable inspiration for
future research and innovation in the transformative domain of intelligent
transportation.
Related papers
- GenAI-powered Multi-Agent Paradigm for Smart Urban Mobility: Opportunities and Challenges for Integrating Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) with Intelligent Transportation Systems [10.310791311301962]
This paper explores the transformative potential of large language models (LLMs) and emerging Retrieval-Augmented Generation (RAG) technologies.
We propose a conceptual framework aimed at developing multi-agent systems capable of intelligently and conversationally delivering smart mobility services.
arXiv Detail & Related papers (2024-08-31T16:14:42Z) - Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey [14.73689900685646]
Reinforcement Learning (RL) is a potent tool for sequential decision-making and has achieved performance surpassing human capabilities.
As the extension of RL in the multi-agent system domain, multi-agent RL (MARL) not only need to learn the control policy but also requires consideration regarding interactions with all other agents in the environment.
Simulators are crucial to obtain realistic data, which is the fundamentals of RL.
arXiv Detail & Related papers (2024-08-19T03:31:20Z) - A Comprehensive Review of Multimodal Large Language Models: Performance and Challenges Across Different Tasks [74.52259252807191]
Multimodal Large Language Models (MLLMs) address the complexities of real-world applications far beyond the capabilities of single-modality systems.
This paper systematically sorts out the applications of MLLM in multimodal tasks such as natural language, vision, and audio.
arXiv Detail & Related papers (2024-08-02T15:14:53Z) - Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI [129.08019405056262]
Embodied Artificial Intelligence (Embodied AI) is crucial for achieving Artificial Intelligence (AGI)
MLMs andWMs have attracted significant attention due to their remarkable perception, interaction, and reasoning capabilities.
In this survey, we give a comprehensive exploration of the latest advancements in Embodied AI.
arXiv Detail & Related papers (2024-07-09T14:14:47Z) - An Interactive Agent Foundation Model [49.77861810045509]
We propose an Interactive Agent Foundation Model that uses a novel multi-task agent training paradigm for training AI agents.
Our training paradigm unifies diverse pre-training strategies, including visual masked auto-encoders, language modeling, and next-action prediction.
We demonstrate the performance of our framework across three separate domains -- Robotics, Gaming AI, and Healthcare.
arXiv Detail & Related papers (2024-02-08T18:58:02Z) - The Role of LLMs in Sustainable Smart Cities: Applications, Challenges,
and Future Directions [12.457812474103449]
This paper explores the substantial potential and applications of Deep Learning (DL), Federated Learning (FL), Internet of Things (IoT), Natural Language Processing (NLP), and large language models (LLMs) in optimizing processes within smart cities.
We aim to spotlight the vast potential of these technologies as foundational elements that technically strengthen the realization and advancement of smart cities.
arXiv Detail & Related papers (2024-02-07T05:22:10Z) - Forging Vision Foundation Models for Autonomous Driving: Challenges,
Methodologies, and Opportunities [59.02391344178202]
Vision foundation models (VFMs) serve as potent building blocks for a wide range of AI applications.
The scarcity of comprehensive training data, the need for multi-sensor integration, and the diverse task-specific architectures pose significant obstacles to the development of VFMs.
This paper delves into the critical challenge of forging VFMs tailored specifically for autonomous driving, while also outlining future directions.
arXiv Detail & Related papers (2024-01-16T01:57:24Z) - A Survey of Generative AI for Intelligent Transportation Systems: Road Transportation Perspective [7.770651543578893]
We introduce the principles of different generative AI techniques.
We classify tasks in ITS into four types: traffic perception, traffic prediction, traffic simulation, and traffic decision-making.
We illustrate how generative AI techniques addresses key issues in these four different types of tasks.
arXiv Detail & Related papers (2023-12-13T16:13:23Z) - LLM4Drive: A Survey of Large Language Models for Autonomous Driving [62.10344445241105]
Large language models (LLMs) have demonstrated abilities including understanding context, logical reasoning, and generating answers.
In this paper, we systematically review a research line about textitLarge Language Models for Autonomous Driving (LLM4AD).
arXiv Detail & Related papers (2023-11-02T07:23:33Z) - Vision Paper: Causal Inference for Interpretable and Robust Machine
Learning in Mobility Analysis [71.2468615993246]
Building intelligent transportation systems requires an intricate combination of artificial intelligence and mobility analysis.
The past few years have seen rapid development in transportation applications using advanced deep neural networks.
This vision paper emphasizes research challenges in deep learning-based mobility analysis that require interpretability and robustness.
arXiv Detail & Related papers (2022-10-18T17:28:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.