Structured prototype regularization for synthetic-to-real driving scene parsing

• URL: http://arxiv.org/abs/2603.16083v1
• Date: Tue, 17 Mar 2026 03:05:28 GMT
• Title: Structured prototype regularization for synthetic-to-real driving scene parsing
• Abstract summary: Driving scene parsing is critical for autonomous vehicles to operate reliably in real-world traffic environments.<n>To reduce the reliance on costly pixel-level annotations, synthetic datasets with automatically generated labels have become a popular alternative.<n>Models trained on synthetic data often perform poorly when applied to real-world scenes due to the synthetic-to-real domain gap.
• Score: 7.087302867255982
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Driving scene parsing is critical for autonomous vehicles to operate reliably in complex real-world traffic environments. To reduce the reliance on costly pixel-level annotations, synthetic datasets with automatically generated labels have become a popular alternative. However, models trained on synthetic data often perform poorly when applied to real-world scenes due to the synthetic-to-real domain gap. Despite the success of unsupervised domain adaptation in narrowing this gap, most existing methods mainly focus on global feature alignment while overlooking the semantic structure of the feature space. As a result, semantic relations among classes are insufficiently modeled, limiting the model's ability to generalize. To address these challenges, this study introduces a novel unsupervised domain adaptation framework that explicitly regularizes semantic feature structures to significantly enhance driving scene parsing performance in real-world scenarios. Specifically, the proposed method enforces inter-class separation and intra-class compactness by leveraging class-specific prototypes, thereby enhancing the discriminability and structural coherence of feature clusters. An entropy-based noise filtering strategy improves the reliability of pseudo labels, while a pixel-level attention mechanism further refines feature alignment. Extensive experiments on representative benchmarks demonstrate that the proposed method consistently outperforms recent state-of-the-art methods. These results underscore the importance of preserving semantic structure for robust synthetic-to-real adaptation in driving scene parsing tasks.

Related papers

• Topology-Aware Neighborhood Learning for Source-Free Cross-Scene Hyperspectral Image Classification [11.354716471312239]
  Domain adaptation has advanced cross-scene hyperspectral image classification, significantly improving discriminative capability in complex scenarios.<n>Conventional domain adaptation methods become impractical, severely restricting their utility in realistic remote sensing scenarios.<n>We propose a topology-aware source-free learning framework to achieve robust and accurate classification without source data.
  arXiv  Detail & Related papers  (2026-08-06T12:40:06Z)
• SciFlow: Semantic Cross Interference for Self-Supervised Optical Flow Domain Generalization [55.19058866002113]
  SciFlow is a network-agnostic, training-based approach to generalize motion estimation across synthetic and open-world domains.<n>Our experiment results show that SciFlow not only significantly enhances model robustness amidst domain variations, but also remarkably enables synthetic-to-real domain generalization without requiring any ground truth in the open world.
  arXiv  Detail & Related papers  (2026-06-27T16:37:51Z)
• Hierarchical Consistency Learning for Test-time Adaptation in Camouflage Perception [50.278200968044665]
  Camouflaged object detection (COD) aims to localize targets that exhibit minimal perceptual differences from backgrounds through physical attributes.<n>Existing methods, constrained by the static train-then-freeze paradigm, suffer from domain rigidity and dependency annotation.<n>We propose the hierarchical consistency learning framework, which integrates test-time adaptation for dynamic representation recalibration.
  arXiv  Detail & Related papers  (2026-05-25T09:57:46Z)
• Steered Generation via Gradient-Based Optimization on Sparse Query Features [1.587869707099313]
  Prototype-Based Sparse Steering is a framework that applies Sparse Autoencoders specifically to query activations.<n>We demonstrate that sparse query representations provide the necessary disentanglement for unified, interpretable control over both logical planning and stylistic nuance.
  arXiv  Detail & Related papers  (2026-05-21T21:13:14Z)
• HEAT: Heterogeneous End-to-End Autonomous Driving via Trajectory-Guided World Models [50.18051979020699]
  End-to-end autonomous driving has emerged as a compelling alternative to traditional modular pipelines.<n>We propose a trajectory-driven learning paradigm that organizes training around planning trajectories.<n>We show that a single unified model can be trained on heterogeneous datasets while maintaining strong performance within each domain.
  arXiv  Detail & Related papers  (2026-05-19T10:12:01Z)
• StepVAR: Structure-Texture Guided Pruning for Visual Autoregressive Models [98.72926158261937]
  We propose a training-free token pruning framework for Visual AutoRegressive models.<n>We employ a lightweight high-pass filter to capture local texture details, while leveraging Principal Component Analysis (PCA) to preserve global structural information.<n>To maintain valid next-scale prediction under sparse tokens, we introduce a nearest neighbor feature propagation strategy.
  arXiv  Detail & Related papers  (2026-03-02T11:35:05Z)
• A Style-Based Profiling Framework for Quantifying the Synthetic-to-Real Gap in Autonomous Driving Datasets [9.788200709163064]
  This paper introduces a profile extraction and discovery framework for characterizing the style profiles underlying both synthetic and real image datasets.<n>Our framework combines Gram matrix-based style extraction with metric learning optimized for intra-class compactness and inter-class separation to extract style embeddings.
  arXiv  Detail & Related papers  (2025-10-11T13:09:41Z)
• Feature-Space Planes Searcher: A Universal Domain Adaptation Framework for Interpretability and Computational Efficiency [7.889121135601528]
  Current unsupervised domain adaptation methods rely on fine-tuning feature extractors.<n>We propose Feature-space Planes Searcher (FPS) as a novel domain adaptation framework.<n>We show that FPS achieves competitive or superior performance to state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-08-26T05:39:21Z)
• Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction [57.19302613163439]
  We introduce neural network reprogrammability as a unifying framework for model adaptation.<n>We present a taxonomy that categorizes such information manipulation approaches across four key dimensions.<n>We also analyze remaining technical challenges and ethical considerations.
  arXiv  Detail & Related papers  (2025-06-05T05:42:27Z)
• StyDeSty: Min-Max Stylization and Destylization for Single Domain Generalization [85.18995948334592]
  Single domain generalization (single DG) aims at learning a robust model generalizable to unseen domains from only one training domain. State-of-the-art approaches have mostly relied on data augmentations, such as adversarial perturbation and style enhancement, to synthesize new data. We propose emphStyDeSty, which explicitly accounts for the alignment of the source and pseudo domains in the process of data augmentation.
  arXiv  Detail & Related papers  (2024-06-01T02:41:34Z)
• On the Real-World Adversarial Robustness of Real-Time Semantic Segmentation Models for Autonomous Driving [59.33715889581687]
  The existence of real-world adversarial examples (commonly in the form of patches) poses a serious threat for the use of deep learning models in safety-critical computer vision tasks. This paper presents an evaluation of the robustness of semantic segmentation models when attacked with different types of adversarial patches. A novel loss function is proposed to improve the capabilities of attackers in inducing a misclassification of pixels.
  arXiv  Detail & Related papers  (2022-01-05T22:33:43Z)
• Adapting Segmentation Networks to New Domains by Disentangling Latent Representations [14.050836886292869]
  Domain adaptation approaches have come into play to transfer knowledge acquired on a label-abundant source domain to a related label-scarce target domain. We propose a novel performance metric to capture the relative efficacy of an adaptation strategy compared to supervised training.
  arXiv  Detail & Related papers  (2021-08-06T09:43:07Z)
• Content Disentanglement for Semantically Consistent Synthetic-to-RealDomain Adaptation in Urban Traffic Scenes [39.38387505091648]
  Synthetic data generation is an appealing approach to generate novel traffic scenarios in autonomous driving. Deep learning techniques trained solely on synthetic data encounter dramatic performance drops when they are tested on real data. We propose a new, unsupervised, end-to-end domain adaptation network architecture that enables semantically consistent domain adaptation between synthetic and real data.
  arXiv  Detail & Related papers  (2021-05-18T17:42:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.