ADM-Fusion: Adaptive Deep Multi-Sensor Fusion for Robust Ego-Motion Estimation in Diverse Conditions

• URL: http://arxiv.org/abs/2606.25111v2
• Date: Wed, 01 Jul 2026 11:04:27 GMT
• Title: ADM-Fusion: Adaptive Deep Multi-Sensor Fusion for Robust Ego-Motion Estimation in Diverse Conditions
• Abstract summary: We propose an end-to-end deep learning based multi-sensor fusion method designed to adapt to environmental changes and sensor degradation.<n>ADM-Fusion employs an adaptive sensor mixture-of-experts framework with content-aware routing to dynamically assign weights to sensor inputs in real time.<n>Experiments show that ADM-Fusion remains robust under degraded conditions while maintaining competitive performance against existing methods.
• Score: 2.442012266709327
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Robust multi-sensor fusion is essential for reliable autonomy in diverse and degraded environments, where sensor reliability can fluctuate rapidly. Because different modalities fail in distinct ways, effective fusion should adaptively balance complementary cues rather than rely on fixed weighting. This adaptability is particularly important for ego-motion estimation, since accurate updates depend on the consistent integration of complementary sensor information. We propose ADM-Fusion, an end-to-end deep learning based multi-sensor fusion method designed to adapt to environmental changes and sensor degradation. ADM-Fusion employs an adaptive sensor mixture-of-experts framework with content-aware routing to dynamically assign weights to sensor inputs in real time. The system further incorporates separate translation and rotation branches, coupled through a cross-task attention mechanism to preserve task-specific specialization while enabling information sharing. ADM-Fusion is trained on the CARLA-LOC simulated dataset and subsequently fine-tuned on KITTI real-world data, demonstrating effective simulation-to-real transfer. Experiments show that ADM-Fusion remains robust under degraded conditions while maintaining competitive performance against existing methods.

Related papers

• Uncertainty-Aware Adaptive Sensor Fusion for Autonomous Navigation [0.0]
  This work introduces a hybrid deep learning approach integrated with an Unscented Kalman Filter (UKF) to enhance pose estimation accuracy in Visual-Inertial Odometry (VIO) for autonomous navigation.<n>The proposed model employs a Vision Transformer (ViT) network to effectively capture temporal dependencies from inertial measurement unit (IMU) data.<n>A novel uncertainty-aware loss function is proposed to explicitly incorporate prediction uncertainty into the learning process, enabling robust and accurate navigation under noisy, incomplete, or unreliable sensor inputs.
  arXiv  Detail & Related papers  (2026-06-03T20:59:42Z)
• MoASE++: Mixture of Activation Sparsity Experts with Domain-Adaptive On-policy Distillation for Continual Test Time Adaptation [65.068801413044]
  Continual test-time adaptation adapts a source-pretrained model to non-stationary, unlabeled target streams.<n>We introduce MoASE, a mixture-of-experts that disentangles domain-agnostic structure from domain-specific texture.
  arXiv  Detail & Related papers  (2026-05-18T01:52:12Z)
• Function-Space ADMM for Decentralized Federated Learning: A Control Theoretic Perspective [10.517508846742682]
  Decentralized federated learning (FL) is a promising approach for training machine learning models on edge systems where no central server exists.<n>FedF-ADMM exploits the convexity of loss functionals within function space to derive alternating direction method multipliers.<n>Experiments show FedF-ADMM achieves faster and more stable convergence than existing decentralized FL methods.
  arXiv  Detail & Related papers  (2026-05-10T06:11:46Z)
• Towards Dexterous Embodied Manipulation via Deep Multi-Sensory Fusion and Sparse Expert Scaling [6.026400295270904]
  DeMUSE is a framework to integrate RGB, depth, and 6-axis force into a unified serialized stream.<n>AdaMN is employed to recalibrate modality-aware features, mitigating representation imbalance.<n>A Joint denoising objective synchronously synthesizes environmental evolution and action sequences to ensure physical consistency.
  arXiv  Detail & Related papers  (2026-02-23T12:12:51Z)
• DGFusion: Depth-Guided Sensor Fusion for Robust Semantic Perception [57.77346327566903]
  State-of-the-art sensor fusion approaches to semantic perception often treat sensor data uniformly across the spatial extent of the input.<n>We propose a novel depth-guided multimodal fusion method that upgrades condition-aware fusion by integrating depth information.<n>Our method achieves state-of-the-art panoptic and semantic segmentation performance on the challenging MUSES and DELIVER datasets.
  arXiv  Detail & Related papers  (2025-09-11T20:03:00Z)
• CAFuser: Condition-Aware Multimodal Fusion for Robust Semantic Perception of Driving Scenes [56.52618054240197]
  We propose a novel, condition-aware multimodal fusion approach for robust semantic perception of driving scenes.<n>Our method, CAFuser, uses an RGB camera input to classify environmental conditions and generate a Condition Token.<n>Our model significantly improves robustness and accuracy, especially in adverse-condition scenarios.
  arXiv  Detail & Related papers  (2024-10-14T17:56:20Z)
• Modality Prompts for Arbitrary Modality Salient Object Detection [57.610000247519196]
  This paper delves into the task of arbitrary modality salient object detection (AM SOD) It aims to detect salient objects from arbitrary modalities, eg RGB images, RGB-D images, and RGB-D-T images. A novel modality-adaptive Transformer (MAT) will be proposed to investigate two fundamental challenges of AM SOD.
  arXiv  Detail & Related papers  (2024-05-06T11:02:02Z)
• Multi-Point Integrated Sensing and Communication: Fusion Model and Functionality Selection [99.67715229413986]
  This paper presents a multi-point ISAC (MPISAC) system that fuses the outputs from multiple ISAC devices for achieving higher sensing performance. We adopt a fusion model that predicts the fusion accuracy via hypothesis testing and optimal voting analysis.
  arXiv  Detail & Related papers  (2022-08-16T08:09:54Z)
• Learning Selective Sensor Fusion for States Estimation [47.76590539558037]
  We propose SelectFusion, an end-to-end selective sensor fusion module. During prediction, the network is able to assess the reliability of the latent features from different sensor modalities. We extensively evaluate all fusion strategies in both public datasets and on progressively degraded datasets.
  arXiv  Detail & Related papers  (2019-12-30T20:25:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.