Continual Learning for Smart City: A Survey

• URL: http://arxiv.org/abs/2404.00983v1
• Date: Mon, 1 Apr 2024 07:59:29 GMT
• Title: Continual Learning for Smart City: A Survey
• Authors: Li Yang, Zhipeng Luo, Shiming Zhang, Fei Teng, Tianrui Li,
• Abstract summary: Continual learning (CL) is a novel machine learning paradigm that constantly updates models to adapt to changing environments. Our survey provides a comprehensive review of continual learning methods that are widely used in smart city development.
• Score: 20.248023419047847
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: With the digitization of modern cities, large data volumes and powerful computational resources facilitate the rapid update of intelligent models deployed in smart cities. Continual learning (CL) is a novel machine learning paradigm that constantly updates models to adapt to changing environments, where the learning tasks, data, and distributions can vary over time. Our survey provides a comprehensive review of continual learning methods that are widely used in smart city development. The content consists of three parts: 1) Methodology-wise. We categorize a large number of basic CL methods and advanced CL frameworks in combination with other learning paradigms including graph learning, spatial-temporal learning, multi-modal learning, and federated learning. 2) Application-wise. We present numerous CL applications covering transportation, environment, public health, safety, networks, and associated datasets related to urban computing. 3) Challenges. We discuss current problems and challenges and envision several promising research directions. We believe this survey can help relevant researchers quickly familiarize themselves with the current state of continual learning research used in smart city development and direct them to future research trends.

Related papers

• Recent Advances of Multimodal Continual Learning: A Comprehensive Survey [64.82070119713207]
  We present the first comprehensive survey on multimodal continual learning methods. We categorize existing MMCL methods into four categories, i.e., regularization-based, architecture-based, replay-based, and prompt-based. We discuss several promising future directions for investigation and development.
  arXiv  Detail & Related papers  (2024-10-07T13:10:40Z)
• Towards Lifelong Learning of Large Language Models: A Survey [20.0936011355535]
  This survey delves into the sophisticated landscape of lifelong learning, categorizing strategies into two primary groups: Internal Knowledge and External Knowledge. This study aims to enhance the adaptability, reliability, and overall performance of large language models in real-world applications.
  arXiv  Detail & Related papers  (2024-06-10T15:46:25Z)
• Cross-Data Knowledge Graph Construction for LLM-enabled Educational Question-Answering System: A Case Study at HCMUT [2.8000537365271367]
  Large language models (LLMs) have emerged as a vibrant research topic. LLMs face challenges in remembering events, incorporating new information, and addressing domain-specific issues or hallucinations. This article proposes a method for automatically constructing a Knowledge Graph from multiple data sources.
  arXiv  Detail & Related papers  (2024-04-14T16:34:31Z)
• A Survey of Route Recommendations: Methods, Applications, and Opportunities [20.248023419047847]
  This survey offers a comprehensive review of route recommendation work based on urban computing. We categorize a large volume of traditional machine learning and modern deep learning methods. We present numerous novel applications related to route commendation within urban computing scenarios.
  arXiv  Detail & Related papers  (2024-03-01T05:04:00Z)
• Deep Learning for Cross-Domain Data Fusion in Urban Computing: Taxonomy, Advances, and Outlook [28.103555959143645]
  We propose the first survey that systematically reviews the latest advancements in deep learning-based data fusion methods tailored for urban computing. We classify the methodology into four primary categories: feature-based, alignment-based, contrast-based, and generation-based fusion methods. We further categorize multi-modal urban applications into seven types: urban planning, transportation, economy, public safety, society, environment, and energy.
  arXiv  Detail & Related papers  (2024-02-29T16:56:23Z)
• Generative Multi-Modal Knowledge Retrieval with Large Language Models [75.70313858231833]
  We propose an innovative end-to-end generative framework for multi-modal knowledge retrieval. Our framework takes advantage of the fact that large language models (LLMs) can effectively serve as virtual knowledge bases. We demonstrate significant improvements ranging from 3.0% to 14.6% across all evaluation metrics when compared to strong baselines.
  arXiv  Detail & Related papers  (2024-01-16T08:44:29Z)
• LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning [64.55001982176226]
  LIBERO is a novel benchmark of lifelong learning for robot manipulation. We focus on how to efficiently transfer declarative knowledge, procedural knowledge, or the mixture of both. We develop an extendible procedural generation pipeline that can in principle generate infinitely many tasks.
  arXiv  Detail & Related papers  (2023-06-05T23:32:26Z)
• Fully Online Meta-Learning Without Task Boundaries [80.09124768759564]
  We study how meta-learning can be applied to tackle online problems of this nature. We propose a Fully Online Meta-Learning (FOML) algorithm, which does not require any ground truth knowledge about the task boundaries. Our experiments show that FOML was able to learn new tasks faster than the state-of-the-art online learning methods.
  arXiv  Detail & Related papers  (2022-02-01T07:51:24Z)
• Curriculum Learning: A Survey [65.31516318260759]
  Curriculum learning strategies have been successfully employed in all areas of machine learning. We construct a taxonomy of curriculum learning approaches by hand, considering various classification criteria. We build a hierarchical tree of curriculum learning methods using an agglomerative clustering algorithm.
  arXiv  Detail & Related papers  (2021-01-25T20:08:32Z)
• Curriculum Learning for Reinforcement Learning Domains: A Framework and Survey [53.73359052511171]
  Reinforcement learning (RL) is a popular paradigm for addressing sequential decision tasks in which the agent has only limited environmental feedback. We present a framework for curriculum learning (CL) in RL, and use it to survey and classify existing CL methods in terms of their assumptions, capabilities, and goals.
  arXiv  Detail & Related papers  (2020-03-10T20:41:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.