STSeg-Complex Video Object Segmentation: The 1st Solution for 4th PVUW MOSE Challenge

• URL: http://arxiv.org/abs/2504.08306v1
• Date: Fri, 11 Apr 2025 07:15:32 GMT
• Title: STSeg-Complex Video Object Segmentation: The 1st Solution for 4th PVUW MOSE Challenge
• Abstract summary: This report details the STSeg solution proposed by the "imaplus" team.<n>The STSeg solution demonstrates remarkable advantages in handling complex object motions and long-video sequences.<n>It achieved a J&F score of 87.26% on the test set of the 2025 4th PVUW Challenge MOSE Track, securing the 1st place and advancing the technology for video object segmentation in complex scenarios.
• Score: 46.51396150518382
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Segmentation of video objects in complex scenarios is highly challenging, and the MOSE dataset has significantly contributed to the development of this field. This technical report details the STSeg solution proposed by the "imaplus" team.By finetuning SAM2 and the unsupervised model TMO on the MOSE dataset, the STSeg solution demonstrates remarkable advantages in handling complex object motions and long-video sequences. In the inference phase, an Adaptive Pseudo-labels Guided Model Refinement Pipeline is adopted to intelligently select appropriate models for processing each video. Through finetuning the models and employing the Adaptive Pseudo-labels Guided Model Refinement Pipeline in the inference phase, the STSeg solution achieved a J&F score of 87.26% on the test set of the 2025 4th PVUW Challenge MOSE Track, securing the 1st place and advancing the technology for video object segmentation in complex scenarios.

Related papers

• Report of the 8th LSVOS Challenge: Complex and Multimodal Video Object Segmentation [123.08518673784818]
  This report summarizes the 8th Large-scale Video Object (LSVOS) Challenge, held in conjunction with ECCV 2026.<n>The challenge evaluates video segmentation in three complementary settings: complex semi-supervised video object segmentation on MOSEv2, text-guided referring video object segmentation on MeViSv2-Text, and audio-guided referring video object segmentation on MeViSv2-Audio.
  arXiv  Detail & Related papers  (2026-09-05T13:11:38Z)
• YUV20K: A Complexity-Driven Benchmark and Trajectory-Aware Alignment Model for Video Camouflaged Object Detection [30.226415717379066]
  We present YUV20K, a pixel-level annoated complexity-driven VCOD benchmark.<n>We propose a novel framework featuring two key modules: Motion Feature Stabilization (MFS) and Trajectory-Aware Alignment (TAA)<n>Our framework exhibits superior cross-domain generalization and robustness when confronting complextemporal scenarios.
  arXiv  Detail & Related papers  (2026-04-11T01:57:58Z)
• FoundationMotion: Auto-Labeling and Reasoning about Spatial Movement in Videos [109.99404241220039]
  We introduce FoundationMotion, a fully automated data curation pipeline that constructs large-scale motion datasets.<n>Our approach first detects and tracks objects in videos to extract their trajectories, then leverages these trajectories and video frames with Large Language Models.<n>We fine-tune open-source models including NVILA-Video-15B and Qwen2.5-7B, achieving substantial improvements in motion understanding without compromising performance.
  arXiv  Detail & Related papers  (2025-12-11T18:53:15Z)
• PVUW 2025 Challenge Report: Advances in Pixel-level Understanding of Complex Videos in the Wild [164.8093566483583]
  This report provides a comprehensive overview of the 4th Pixel-level Video Understanding in the Wild (PVUW) Challenge, held in conjunction with CVPR 2025. The challenge features two tracks: MOSE, which focuses on complex scene video object segmentation, and MeViS, which targets motion-guided, language-based video segmentation.
  arXiv  Detail & Related papers  (2025-04-15T16:02:47Z)
• MASSeg : 2nd Technical Report for 4th PVUW MOSE Track [4.988774092444048]
  We propose an improved model named MASSeg for complex video object segmentation, and construct an enhanced dataset, MOSE+. During training, we incorporate a combination of inter-frame consistent and inconsistent data augmentation strategies to improve robustness and generalization. MASSeg achieves a J score of 0.8250, F score of 0.9007, and a J&F score of 0.8628 on the MOSE test set.
  arXiv  Detail & Related papers  (2025-04-14T14:15:46Z)
• FVOS for MOSE Track of 4th PVUW Challenge: 3rd Place Solution [2.9149767401557574]
  Video Object PV (VOS) is one of the most fundamental and challenging tasks in computer vision. This paper aims to achieve accurate segmentation of video objects in challenging scenes.
  arXiv  Detail & Related papers  (2025-04-13T10:14:19Z)
• The 1st Solution for 4th PVUW MeViS Challenge: Unleashing the Potential of Large Multimodal Models for Referring Video Segmentation [31.44879457190659]
  We propose a simple and effective inference optimization method to fully unleash the potential of LMMs in referring video segmentation.<n>Our solution achieved 61.98% J&F on the MeViS test set and ranked 1st place in the 4th PVUW Challenge MeViS Track at CVPR 2025.
  arXiv  Detail & Related papers  (2025-04-07T15:24:54Z)
• First Place Solution to the ECCV 2024 BRAVO Challenge: Evaluating Robustness of Vision Foundation Models for Semantic Segmentation [1.8570591025615457]
  We present the first place solution to the ECCV 2024 BRAVO Challenge. A model is trained on Cityscapes and its robustness is evaluated on several out-of-distribution datasets. This approach outperforms more complex existing approaches, and achieves first place in the challenge.
  arXiv  Detail & Related papers  (2024-09-25T16:15:06Z)
• GroupMamba: Efficient Group-Based Visual State Space Model [66.35608254724566]
  State-space models (SSMs) have recently shown promise in capturing long-range dependencies with subquadratic computational complexity.<n>However, purely SSM-based models face critical challenges related to stability and achieving state-of-the-art performance in computer vision tasks.<n>Our paper addresses the challenges of scaling SSM-based models for computer vision, particularly the instability and inefficiency of large model sizes.
  arXiv  Detail & Related papers  (2024-07-18T17:59:58Z)
• Semantic Segmentation on VSPW Dataset through Masked Video Consistency [19.851665554201407]
  We present our solution for the PVUW competition, where we introduce masked video (MVC) based on existing models. MVC enforces consistency between predictions of masked random frames where patches are withheld. Our approach achieves 67% mIoU performance on the VSPW dataset, ranking 2nd in the PVUW2024 VSS track.
  arXiv  Detail & Related papers  (2024-06-07T14:41:24Z)
• Appearance-Based Refinement for Object-Centric Motion Segmentation [85.2426540999329]
  We introduce an appearance-based refinement method that leverages temporal consistency in video streams to correct inaccurate flow-based proposals. Our approach involves a sequence-level selection mechanism that identifies accurate flow-predicted masks as exemplars. Its performance is evaluated on multiple video segmentation benchmarks, including DAVIS, YouTube, SegTrackv2, and FBMS-59.
  arXiv  Detail & Related papers  (2023-12-18T18:59:51Z)
• A Spatial-Temporal Dual-Mode Mixed Flow Network for Panoramic Video Salient Object Detection [5.207048071888257]
  We propose a Spatial-Temporal Dual-Mode Mixed Flow Network (STDMMF-Net) that exploits the spatial flow of panoramic video and the corresponding optical flow for SOD. A large number of subjective and objective experimental results testify that the proposed method demonstrates better detection accuracy than the state-of-the-art (SOTA) methods. The comprehensive performance of the proposed method is better in terms of memory required for model inference, testing time, complexity, and generalization performance.
  arXiv  Detail & Related papers  (2023-10-13T11:25:41Z)
• ZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: Semi-Supervised Video Object Segmentation [62.98078087018469]
  We introduce MSDeAOT, a variant of the AOT framework that incorporates transformers at multiple feature scales. MSDeAOT efficiently propagates object masks from previous frames to the current frame using a feature scale with a stride of 16. We also employ GPM in a more refined feature scale with a stride of 8, leading to improved accuracy in detecting and tracking small objects.
  arXiv  Detail & Related papers  (2023-07-05T03:43:15Z)
• Full-Duplex Strategy for Video Object Segmentation [141.43983376262815]
  Full- Strategy Network (FSNet) is a novel framework for video object segmentation (VOS) Our FSNet performs the crossmodal feature-passing (i.e., transmission and receiving) simultaneously before fusion decoding stage. We show that our FSNet outperforms other state-of-the-arts for both the VOS and video salient object detection tasks.
  arXiv  Detail & Related papers  (2021-08-06T14:50:50Z)
• Understanding Road Layout from Videos as a Whole [82.30800791500869]
  We formulate it as a top-view road attributes prediction problem and our goal is to predict these attributes for each frame both accurately and consistently. We exploit the following three novel aspects: leveraging camera motions in videos, including context cuesand incorporating long-term video information.
  arXiv  Detail & Related papers  (2020-07-02T00:59:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.