Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Leveraging DINOv3 for Robust Outdoor Scene Understanding in Field Robotics
- URL: http://arxiv.org/abs/2606.18582v1
- Date: Wed, 17 Jun 2026 01:13:22 GMT
- Title: Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Leveraging DINOv3 for Robust Outdoor Scene Understanding in Field Robotics
- Abstract summary: The GOOSE 2D Fine-Grained Semantic Challenge evaluates dense semantic segmentation of off-road imagery.<n>We present the first-place solution to this challenge.
- Score: 8.77371742508379
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: The GOOSE 2D Fine-Grained Semantic Segmentation Challenge at the ICRA 2026 Workshop on Field Robotics evaluates dense semantic segmentation of off-road imagery over a fine-grained taxonomy of 64 classes and 11 evaluated non-void coarse categories. We present the first-place solution to this challenge. Our solution comprises two complementary improvements: (a) a network-level design that combines a self-supervised DINOv3 ViT-L/16 backbone, a ViT-Adapter, and a Mask2Former mask-classification decoder, together with a coarse-category auxiliary loss on the global [CLS] token; and (b) an inference-time aggregation strategy based on multi-scale and horizontal-flip test-time augmentation and an ensemble of the top three checkpoints selected using Codabench scores. Our method achieves an official composite score of 76.57%, consisting of 69.32% fine-class mIoU and 83.81% category-level mIoU, and ranks first on the final phase leaderboard: www.codabench.org/competitions/14257/#/results-tab.
Related papers
- Efficient Visual Pointing for Embodied AI:Agent-Driven Data Synthesis, Cross-Block Attention, and Iterative Correction [55.11480729304395]
We describe our PointArena 2026 solution, which achieves 77.2% overall accuracy and ranks second on the benchmark.<n>The ap proach targets three failure modes. First, agent-driven syn thesis builds large semantic and anchor-relative candidate pools.<n>Second, a determinis tic steerable-data pipeline creates a verified 10,000-sample main set, plus reserve samples, using masks, templates, and path verification.
arXiv Detail & Related papers (2026-06-29T06:39:03Z) - Technical Report for the ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Pretraining-Diverse Ensemble of Foundation Vision Encoders for Robust Outdoor Scene Understanding [43.9978897868123]
The ICRA 2026 GOOSE 2D Fine-Grained Semantic Challenge requires parsing unstructured outdoor scenes from four camera platforms into 56 fine-grained categories.<n>Our approach pairs foundation vision encoders with a Mask2Former decoder, and trains them with a strong recipe.<n>Our submission achieves 75.40% composite mIoU and wins the second place of the challenge.
arXiv Detail & Related papers (2026-06-22T09:57:55Z) - Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Exploring Query-Based Segmentation and Increased Spatial Context for Outdoor Scene Understanding [2.685567215235468]
We present our submission to the GOOSE 2D Fine-Grained Semantic Challenge, organized as part of the Workshop on Field Robotics at ICRA 2026.<n>The challenge combines data from the GOOSE and GOOSE-Ex datasets, annotated using a hierarchical taxonomy of 56 fine-grained classes and 11 broader categories.<n>Our final submission achieves an mIoU of 69.6% on the challenge test set, providing a strong baseline for fine-grained semantic segmentation in outdoor environments.
arXiv Detail & Related papers (2026-06-19T14:13:04Z) - Towards Cross-Platform Generalization: Domain Adaptive 3D Detection with Augmentation and Pseudo-Labeling [58.42010583822351]
This technical report represents the award-winning solution to the Cross-platform 3D Object Detection task in the RoboSense2025 Challenge.<n>Our approach is built upon PVRCNN++, an efficient 3D object detection framework that effectively integrates point-based and voxel-based features.<n>We improve cross-platform generalization by narrowing domain gaps through tailored data augmentation and a self-training strategy with pseudo-labels.
arXiv Detail & Related papers (2026-01-13T03:09:20Z) - DHR: Dual Features-Driven Hierarchical Rebalancing in Inter- and Intra-Class Regions for Weakly-Supervised Semantic Segmentation [7.545489807578403]
Weakly-supervised semantic segmentation (WSS) ensures high-quality segmentation with limited data.
WSS faces challenges related to minor classes since those are overlooked in images with adjacent multiple classes.
We first address this by employing unsupervised and weakly-supervised feature maps instead of conventional methodologies.
arXiv Detail & Related papers (2024-03-30T14:35:31Z) - 3rd Place Solution for PVUW2023 VSS Track: A Large Model for Semantic
Segmentation on VSPW [68.56017675820897]
In this paper, we introduce 3rd place solution for PVUW2023 VSS track.
We have explored various image-level visual backbones and segmentation heads to tackle the problem of video semantic segmentation.
arXiv Detail & Related papers (2023-06-04T07:50:38Z) - 1st Place Solution of The Robust Vision Challenge (RVC) 2022 Semantic
Segmentation Track [67.56316745239629]
This report describes the winning solution to the semantic segmentation task of the Robust Vision Challenge on ECCV 2022.
Our method adopts the FAN-B-Hybrid model as the encoder and uses Segformer as the segmentation framework.
The proposed method could serve as a strong baseline for the multi-domain segmentation task and benefit future works.
arXiv Detail & Related papers (2022-10-23T20:52:22Z) - Unsupervised Semantic Segmentation with Self-supervised Object-centric
Representations [54.32381783582341]
We show that recent advances in self-supervised feature learning enable unsupervised object discovery and semantic segmentation with a performance that matches the state of the field on supervised semantic segmentation 10 years ago.
We propose a methodology based on unsupervised saliency masks and self-supervised feature clustering to kickstart object discovery followed by training a semantic segmentation network on pseudo-labels to bootstrap the system on images with multiple objects.
arXiv Detail & Related papers (2022-07-11T17:28:24Z) - CV 3315 Is All You Need : Semantic Segmentation Competition [14.818852884385015]
This competition focus on Urban-Sense based on the vehicle camera view.
Class highly unbalanced Urban-Sense images dataset challenge the existing solutions.
Deep Conventional neural network-based semantic segmentation methods become flexible solutions applicable to real-world applications.
arXiv Detail & Related papers (2022-06-25T06:27:57Z) - PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation [111.7241018610573]
We present PointGroup, a new end-to-end bottom-up architecture for instance segmentation.
We design a two-branch network to extract point features and predict semantic labels and offsets, for shifting each point towards its respective instance centroid.
A clustering component is followed to utilize both the original and offset-shifted point coordinate sets, taking advantage of their complementary strength.
We conduct extensive experiments on two challenging datasets, ScanNet v2 and S3DIS, on which our method achieves the highest performance, 63.6% and 64.0%, compared to 54.9% and 54.4% achieved by former best
arXiv Detail & Related papers (2020-04-03T16:26:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.