A Cross-City Federated Transfer Learning Framework: A Case Study on Urban Region Profiling

• URL: http://arxiv.org/abs/2206.00007v1
• Date: Tue, 31 May 2022 12:41:01 GMT
• Title: A Cross-City Federated Transfer Learning Framework: A Case Study on Urban Region Profiling
• Authors: Gaode Chen, Yijun Su, Xinghua Zhang, Anmin Hu, Guochun Chen, Siyuan Feng, Ji Xiang, Junbo Zhang, Yu Zheng
• Abstract summary: We propose a novel Cross-city Federated Transfer Learning framework (CcFTL) to cope with the data insufficiency and privacy problems. CcFTL transfers the relational knowledge from multiple rich-data source cities to the target city. We take the urban region profiling as an application of smart cities and evaluate the proposed method with a real-world study.
• Score: 24.103961649276584
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Data insufficiency problem (i.e., data missing and label scarcity issues) caused by inadequate services and infrastructures or unbalanced development levels of cities has seriously affected the urban computing tasks in real scenarios. Prior transfer learning methods inspire an elegant solution to the data insufficiency, but are only concerned with one kind of insufficiency issue and fail to fully explore these two issues existing in the real world. In addition, cross-city transfer in existing methods overlooks the inter-city data privacy which is a public concern in practical application. To address the above challenging problems, we propose a novel Cross-city Federated Transfer Learning framework (CcFTL) to cope with the data insufficiency and privacy problems. Concretely, CcFTL transfers the relational knowledge from multiple rich-data source cities to the target city. Besides, the model parameters specific to the target task are firstly trained on the source data and then fine-tuned to the target city by parameter transfer. With our adaptation of federated training and homomorphic encryption settings, CcFTL can effectively deal with the data privacy problem among cities. We take the urban region profiling as an application of smart cities and evaluate the proposed method with a real-world study. The experiments demonstrate the notable superiority of our framework over several competitive state-of-the-art models.

Related papers

• Federated Large Language Models: Current Progress and Future Directions [63.68614548512534]
  This paper surveys Federated learning for LLMs (FedLLM), highlighting recent advances and future directions. We focus on two key aspects: fine-tuning and prompt learning in a federated setting, discussing existing work and associated research challenges.
  arXiv  Detail & Related papers  (2024-09-24T04:14:33Z)
• Harnessing LLMs for Cross-City OD Flow Prediction [5.6685153523382015]
  We introduce a new method for cross-city Origin-Destination (OD) flow prediction using Large Language Models (LLMs) Our approach leverages the advanced semantic understanding and contextual learning capabilities of LLMs to bridge the gap between cities with different characteristics. Our novel framework involves four major components: collecting OD training datasets from a source city, instruction-tuning the LLMs, predicting destination POIs in a target city, and identifying the locations that best match the predicted destination POIs.
  arXiv  Detail & Related papers  (2024-09-05T23:04:28Z)
• Urban Mobility Assessment Using LLMs [19.591156495742922]
  This work proposes an innovative AI-based approach for synthesizing travel surveys by prompting large language models (LLMs) Our study evaluates the effectiveness of this approach across various U.S. metropolitan areas by comparing the results against existing survey data at different levels.
  arXiv  Detail & Related papers  (2024-08-22T19:17:33Z)
• Personalized Wireless Federated Learning for Large Language Models [75.22457544349668]
  Large Language Models (LLMs) have revolutionized natural language processing tasks. Their deployment in wireless networks still face challenges, i.e., a lack of privacy and security protection mechanisms. We introduce two personalized wireless federated fine-tuning methods with low communication overhead.
  arXiv  Detail & Related papers  (2024-04-20T02:30:21Z)
• COLA: Cross-city Mobility Transformer for Human Trajectory Simulation [44.157114416533915]
  We develop a Cross-city mObiLity trAnsformer (COLA) with a dedicated model-agnostic transfer framework. COLA divides the Transformer into the private modules for city-specific characteristics and the shared modules for city-universal mobility patterns. Our implemented cross-city baselines have demonstrated its superiority and effectiveness.
  arXiv  Detail & Related papers  (2024-03-04T07:45:29Z)
• Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models [26.517572366783384]
  Recent emergence of foundation models such as ChatGPT marks a revolutionary shift in the fields of machine learning and artificial intelligence. Despite growing interest in Urban Foundation Models, this burgeoning field faces challenges such as a lack of clear definitions, systematic reviews, and universalizable solutions. We propose a data-centric taxonomy that categorizes current UFM-related works, based on urban data modalities and types.
  arXiv  Detail & Related papers  (2024-01-30T04:48:16Z)
• Cross-City Matters: A Multimodal Remote Sensing Benchmark Dataset for Cross-City Semantic Segmentation using High-Resolution Domain Adaptation Networks [82.82866901799565]
  We build a new set of multimodal remote sensing benchmark datasets (including hyperspectral, multispectral, SAR) for the study purpose of the cross-city semantic segmentation task. Beyond the single city, we propose a high-resolution domain adaptation network, HighDAN, to promote the AI model's generalization ability from the multi-city environments. HighDAN is capable of retaining the spatially topological structure of the studied urban scene well in a parallel high-to-low resolution fusion fashion.
  arXiv  Detail & Related papers  (2023-09-26T23:55:39Z)
• Spatio-Temporal Graph Few-Shot Learning with Cross-City Knowledge Transfer [58.6106391721944]
  Cross-city knowledge has shown its promise, where the model learned from data-sufficient cities is leveraged to benefit the learning process of data-scarce cities. We propose a model-agnostic few-shot learning framework for S-temporal graph called ST-GFSL. We conduct comprehensive experiments on four traffic speed prediction benchmarks and the results demonstrate the effectiveness of ST-GFSL compared with state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-05-27T12:46:52Z)
• One-shot Transfer Learning for Population Mapping [10.530184452907902]
  We propose a novel one-shot transfer learning framework PSRNet to transfer spatial-temporal knowledge across cities. Experiments on real-life datasets of 4 cities demonstrate that PSRNet has significant advantages over 8 state-of-the-art baselines.
  arXiv  Detail & Related papers  (2021-08-13T13:19:09Z)
• Methodological Foundation of a Numerical Taxonomy of Urban Form [62.997667081978825]
  We present a method for numerical taxonomy of urban form derived from biological systematics. We derive homogeneous urban tissue types and, by determining overall morphological similarity between them, generate a hierarchical classification of urban form. After framing and presenting the method, we test it on two cities - Prague and Amsterdam.
  arXiv  Detail & Related papers  (2021-04-30T12:47:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.