Vision-Assisted Foundation Model for Solving Multi-Task Vehicle Routing Problems

• URL: http://arxiv.org/abs/2606.10431v1
• Date: Tue, 09 Jun 2026 05:15:25 GMT
• Title: Vision-Assisted Foundation Model for Solving Multi-Task Vehicle Routing Problems
• Abstract summary: Multi-task vehicle routing problems play a critical role in enhancing efficiency across various industries and service sectors.<n>Existing solvers solely utilize a graph-based modality, limiting their ability to address variants with multiple constraints.<n>We propose a vision-assisted foundation model (VaFM) to address these challenges.
• Score: 68.42726166302654
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multi-task vehicle routing problems play a critical role in enhancing efficiency across various industries and service sectors. These problems consist of multiple variants that optimize routing costs while meeting diverse customer constraints. Existing multi-task VRP solvers solely utilize a graph-based modality, limiting their ability to address variants with multiple constraints. As a format to represent complex semantics, vision modality shows great potential for encoding diverse VRP constraints. This motivates us to learn patch-level semantics from the vision images, and then integrate them into a graph-based model to solve various VRP variants simultaneously. However, directly applying this approach to multi-task VRPs presents three challenges: 1) existing VRP images lack constraint representations, which are essential for multi-task VRPs, 2) the fixed receptive field of individual patches cannot effectively accommodate varying requirements across tasks, and 3) imbalanced pixel distribution among constraints may cause the model to overlook constraints with fewer pixels. In this paper, we propose a vision-assisted foundation model (VaFM) to address these challenges. In the vision modality, input images tailored to all constraints are encoded by a convolutional neural network. The obtained patch embeddings are fused with graph-based nodes to generate solutions, with an auxiliary task designed to address the pixel-imbalanced issue. The performance of VaFM is evaluated across 16 different VRP variants. The experimental results demonstrate the superiority of VaFM over state-of-the-art methods, especially for variants with complex constraints.

Related papers

• Improving Cross-Problem Vehicle Routing with Locally Augmented Preferences and Representation Disentanglement [0.0]
  Multi-task vehicle routing problem (VRP) solvers seek to handle multiple VRP variants within a single unified model.<n>We propose a novel training algorithm that applies a local search refinement pass to the best decoded tour before forming preference pairs.<n>Second, a Progressive Layered Extraction (PLE) encoder routes each encoder layer through one shared expert and a set of task-specific experts via a gating mechanism.
  arXiv  Detail & Related papers  (2026-08-25T17:44:23Z)
• FiLMMeD: Feature-wise Linear Modulation for Cross-Problem Multi-Depot Vehicle Routing [0.0]
  We present a novel unified neural-based model for 24 different MDVRP variants.<n>FiLMMeD consistently outperforms state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-04-30T16:48:13Z)
• MuRF: Unlocking the Multi-Scale Potential of Vision Foundation Models [34.365616310655575]
  Multi-Resolution Fusion (MuRF) is a simple yet universally effective strategy to harness this synergy at inference time.<n>MuRF constructs a unified representation by processing an image at multiple resolutions through a frozen VFM.<n>We empirically validate this by applying MuRF to a broad spectrum of critical computer vision tasks across multiple distinct VFM families.
  arXiv  Detail & Related papers  (2026-03-26T17:59:58Z)
• Multi-Agent DRL for V2X Resource Allocation: Disentangling Challenges and Benchmarking Solutions [51.22818149833102]
  Multi-agent reinforcement learning (MARL) has emerged as a promising approach for radio resource allocation in vehicle-to-everything (C-V2X) networks.<n>However, the multifaceted challenges inherent to MARL are often intertwined, making it difficult to understand their individual impact on performance in vehicular environments.<n>We bridge this gap by formulating C-V2X RRA as a sequence of multi-agent interference games with progressively increasing complexity.
  arXiv  Detail & Related papers  (2026-02-18T14:46:56Z)
• ViCO: A Training Strategy towards Semantic Aware Dynamic High-Resolution [71.69364653858447]
  Existing Multimodal Large Language Models (MLLMs) suffer from increased inference costs due to the additional vision tokens introduced by image inputs.<n>We propose Visual Consistency Learning (ViCO), a novel training algorithm that enables the model to represent images of varying complexities using different numbers of vision tokens.<n> Experimental results demonstrate that our method can reduce the number of vision tokens by up to 50% while maintaining the model's perception, reasoning, and OCR capabilities.
  arXiv  Detail & Related papers  (2025-10-14T17:58:10Z)
• Hypercomplex Prompt-aware Multimodal Recommendation [6.862998546677475]
  We propose HPMRec, a novel Hypercomplex Prompt-aware Multimodal Recommendation framework.<n>We show that HPMRec achieves state-of-the-art recommendation performance in experiments on four public datasets.
  arXiv  Detail & Related papers  (2025-08-14T15:36:00Z)
• SHIELD: Multi-task Multi-distribution Vehicle Routing Solver with Sparsity and Hierarchy [26.708590440636527]
  We introduce SHIELD, a novel model that leverages both sparsity and hierarchy principles.<n>We develop a context-based clustering layer that exploits the presence of hierarchical structures in the problems to produce better local representations.<n>Our results demonstrate the superiority of our approach over existing methods on 9 real-world maps with 16 VRP variants each.
  arXiv  Detail & Related papers  (2025-06-10T03:55:14Z)
• DiVE: Efficient Multi-View Driving Scenes Generation Based on Video Diffusion Transformer [56.98400572837792]
  DiVE produces high-fidelity, temporally coherent, and cross-view consistent multi-view videos.<n>These innovations collectively achieve a 2.62x speedup with minimal quality degradation.
  arXiv  Detail & Related papers  (2025-04-28T09:20:50Z)
• An Efficient General-Purpose Modular Vision Model via Multi-Task Heterogeneous Training [79.78201886156513]
  We present a model that can perform multiple vision tasks and can be adapted to other downstream tasks efficiently. Our approach achieves comparable results to single-task state-of-the-art models and demonstrates strong generalization on downstream tasks.
  arXiv  Detail & Related papers  (2023-06-29T17:59:57Z)
• Recurrent Multi-view Alignment Network for Unsupervised Surface Registration [79.72086524370819]
  Learning non-rigid registration in an end-to-end manner is challenging due to the inherent high degrees of freedom and the lack of labeled training data. We propose to represent the non-rigid transformation with a point-wise combination of several rigid transformations. We also introduce a differentiable loss function that measures the 3D shape similarity on the projected multi-view 2D depth images.
  arXiv  Detail & Related papers  (2020-11-24T14:22:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.