Mobility-Aware Federated Learning: Multi-Armed Bandit Based Selection in Vehicular Network

• URL: http://arxiv.org/abs/2410.10451v2
• Date: Tue, 15 Oct 2024 03:16:09 GMT
• Title: Mobility-Aware Federated Learning: Multi-Armed Bandit Based Selection in Vehicular Network
• Authors: Haoyu Tu, Lin Chen, Zuguang Li, Xiaopei Chen, Wen Wu,
• Abstract summary: We design a mobility-aware vehicular federated learning (MAVFL) scheme in which vehicles drive through a road segment to perform FL. We conduct the convergence analysis to indicate the influence of vehicle mobility on training loss. We propose a multi-armed bandit-based vehicle selection algorithm to minimize the utility function considering training loss and delay.
• Score: 6.2413189928023085
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we study a vehicle selection problem for federated learning (FL) over vehicular networks. Specifically, we design a mobility-aware vehicular federated learning (MAVFL) scheme in which vehicles drive through a road segment to perform FL. Some vehicles may drive out of the segment which leads to unsuccessful training. In the proposed scheme, the real-time successful training participation ratio is utilized to implement vehicle selection. We conduct the convergence analysis to indicate the influence of vehicle mobility on training loss. Furthermore, we propose a multi-armed bandit-based vehicle selection algorithm to minimize the utility function considering training loss and delay. The simulation results show that compared with baselines, the proposed algorithm can achieve better training performance with approximately 28\% faster convergence.

Related papers

• Dynamic Scheduling for Vehicle-to-Vehicle Communications Enhanced Federated Learning [14.942677904783759]
  vehicular federated learning (VFL) has been applied to edge training for connected vehicles. We formulate an optimization problem to optimize the VFL training performance. We propose a V2V-enhanced dynamic scheduling algorithm to solve it.
  arXiv  Detail & Related papers  (2024-06-25T11:15:53Z)
• Adaptive and Parallel Split Federated Learning in Vehicular Edge Computing [6.004901615052089]
  Vehicular edge intelligence (VEI) is a promising paradigm for enabling future intelligent transportation systems. Federated learning (FL) is one of the fundamental technologies facilitating collaborative model training locally and aggregation. We develop an Adaptive Split Federated Learning scheme for Vehicular Edge Computing (ASFV)
  arXiv  Detail & Related papers  (2024-05-29T02:34:38Z)
• Shared learning of powertrain control policies for vehicle fleets [3.9325957466009203]
  Deep reinforcement learning (DRL) aims at on-the-field learning of powertrain control policies that optimize fuel economy and other performance metrics. We present a novel framework for shared learning among a fleet of vehicles through the use of a distilled group policy. We find a fleet average improvement of 8.5 percent in fuel economy compared to the baseline.
  arXiv  Detail & Related papers  (2024-04-27T13:01:05Z)
• Communication Resources Constrained Hierarchical Federated Learning for End-to-End Autonomous Driving [67.78611905156808]
  This paper proposes an optimization-based Communication Resource Constrained Hierarchical Federated Learning framework. Results show that the proposed CRCHFL both accelerates the convergence rate and enhances the generalization of federated learning autonomous driving model.
  arXiv  Detail & Related papers  (2023-06-28T12:44:59Z)
• Rethinking Closed-loop Training for Autonomous Driving [82.61418945804544]
  We present the first empirical study which analyzes the effects of different training benchmark designs on the success of learning agents. We propose trajectory value learning (TRAVL), an RL-based driving agent that performs planning with multistep look-ahead. Our experiments show that TRAVL can learn much faster and produce safer maneuvers compared to all the baselines.
  arXiv  Detail & Related papers  (2023-06-27T17:58:39Z)
• FastRLAP: A System for Learning High-Speed Driving via Deep RL and Autonomous Practicing [71.76084256567599]
  We present a system that enables an autonomous small-scale RC car to drive aggressively from visual observations using reinforcement learning (RL) Our system, FastRLAP (faster lap), trains autonomously in the real world, without human interventions, and without requiring any simulation or expert demonstrations. The resulting policies exhibit emergent aggressive driving skills, such as timing braking and acceleration around turns and avoiding areas which impede the robot's motion, approaching the performance of a human driver using a similar first-person interface over the course of training.
  arXiv  Detail & Related papers  (2023-04-19T17:33:47Z)
• MOB-FL: Mobility-Aware Federated Learning for Intelligent Connected Vehicles [21.615151912285835]
  We consider a base station coordinating nearby ICVs to train a neural network in a collaborative yet distributed manner. Due to the mobility of vehicles, the connections between the base station and ICVs are short-lived. We propose an accelerated FL-ICV framework, by optimizing the duration of each training round and the number of local iterations.
  arXiv  Detail & Related papers  (2022-12-07T08:53:53Z)
• Federated Deep Learning Meets Autonomous Vehicle Perception: Design and Verification [168.67190934250868]
  Federated learning empowered connected autonomous vehicle (FLCAV) has been proposed. FLCAV preserves privacy while reducing communication and annotation costs. It is challenging to determine the network resources and road sensor poses for multi-stage training.
  arXiv  Detail & Related papers  (2022-06-03T23:55:45Z)
• Mobility, Communication and Computation Aware Federated Learning for Internet of Vehicles [29.476152044104005]
  We propose a novel online FL platform that uses on-road vehicles as learning agents. Thanks to the advanced features of modern vehicles, the on-board sensors can collect data as vehicles travel along their trajectories. On-board processors can train machine learning models using the collected data.
  arXiv  Detail & Related papers  (2022-05-17T19:14:38Z)
• Real-world Ride-hailing Vehicle Repositioning using Deep Reinforcement Learning [52.2663102239029]
  We present a new practical framework based on deep reinforcement learning and decision-time planning for real-world vehicle on idle-hailing platforms. Our approach learns ride-based state-value function using a batch training algorithm with deep value. We benchmark our algorithm with baselines in a ride-hailing simulation environment to demonstrate its superiority in improving income efficiency.
  arXiv  Detail & Related papers  (2021-03-08T05:34:05Z)
• Vehicular Cooperative Perception Through Action Branching and Federated Reinforcement Learning [101.64598586454571]
  A novel framework is proposed to allow reinforcement learning-based vehicular association, resource block (RB) allocation, and content selection of cooperative perception messages (CPMs) A federated RL approach is introduced in order to speed up the training process across vehicles. Results show that federated RL improves the training process, where better policies can be achieved within the same amount of time compared to the non-federated approach.
  arXiv  Detail & Related papers  (2020-12-07T02:09:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.