Multi-Agent Target-Existence Verification and Learned Mask Geometry Refinement: Winning Report of the MeViS-Text Track at the 8th LSVOS Challenge 2026

• URL: http://arxiv.org/abs/2608.11458v1
• Date: Tue, 11 Aug 2026 21:47:52 GMT
• Title: Multi-Agent Target-Existence Verification and Learned Mask Geometry Refinement: Winning Report of the MeViS-Text Track at the 8th LSVOS Challenge 2026
• Abstract summary: We present the first-place solution to the MeViS-Text track of the 8th Large-scale Video Object (LSVOS) Challenge 2026.<n> referring video object segmentation guided by written motion expressions, including deceptive no-target expressions.<n>Our pipeline, SSUPER, resolves each expression into a visual concept, generates full-video candidate masklets with SAM3.1, and selects target IDs.
• Score: 0.6416429054645992
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present the first-place solution to the MeViS-Text track of the 8th Large-scale Video Object Segmentation (LSVOS) Challenge 2026: referring video object segmentation guided by written motion expressions, including deceptive no-target expressions that match no object in the video and must yield empty masks in every frame. Our pipeline, SSUPER, resolves each expression into a visual concept, generates full-video candidate masklets with SAM~3.1, and selects target IDs. At every reasoning stage, three heterogeneous multimodal large language models independently execute the same stage-specific prompt before a single synthesis pass commits one schema-validated verdict. Although this system rejects every no-target expression in validation, the leaderboard reveals that a substantial share of test no-target cases still slips through. The reason is that hard negatives name a plausible object and fail only under the complete temporal predicate, so when selection and existence are decided together, a category-plausible masklet anchors the verdict. Hence, we decouple existence verification into an independent multi-agent audit of the full predicate (category, count, action, trajectory, event order, and semantic role) that distinguishes absence from temporary invisibility, discounts apparent motion caused by camera movement, and requires contradicting evidence rather than mere uncertainty for a no-target verdict. Without any new segmentation call, this audit recovers most of the residual no-target errors. A training-data-only StyleRefiner then aligns mask geometry with the annotation style of MeViSv2 while preserving every presence decision by construction, showing that once the semantics are fixed, part of the remaining error is stylistic rather than semantic. The complete system reaches a Final score of 0.9081339614 on the official challenge leaderboard.

Related papers

• Report of the 8th LSVOS Challenge: Complex and Multimodal Video Object Segmentation [123.08518673784818]
  This report summarizes the 8th Large-scale Video Object (LSVOS) Challenge, held in conjunction with ECCV 2026.<n>The challenge evaluates video segmentation in three complementary settings: complex semi-supervised video object segmentation on MOSEv2, text-guided referring video object segmentation on MeViSv2-Text, and audio-guided referring video object segmentation on MeViSv2-Audio.
  arXiv  Detail & Related papers  (2026-09-05T13:11:38Z)
• ENEAS: Embedding-guided Neural Ensemble for Adaptive Segmentation [36.94429692322632]
  We present ENEAS, a text-promptable method for instance tracking and semantic discovery.<n>We extend the geometrically robust SeC architecture, previously limited to point interactions, with a text-prompting adapter.<n>The verification layer combines high-speed visual embedding matching with conditional VLM refinement, invoking semantic reasoning only for ambiguous candidates.
  arXiv  Detail & Related papers  (2026-09-03T12:25:26Z)
• Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning [56.17582599802973]
  We introduce the Multi-Instruction Multi-Shot Long-Video Editing (MMLVE) task, which is structured around three core objectives.<n>To tackle these three unique challenges, we introduce an agentic editing framework that leverages the Large Language Models (LLMs) and Vision-Language Models (VLMs)<n>Extensive experiments demonstrate that our MMLVE-Agent outperforms existing closed-source SOTA approaches.
  arXiv  Detail & Related papers  (2026-08-27T08:48:13Z)
• Competitive Memory Readout for Robust Video Object Segmentation: 2nd Place Technical Report for the MOSEv2 Track of the 8th LSVOS Challenge [51.15679610275694]
  We present our solution for the 8th Large-scale Video Object (LSVOS) Challenge at ECCV 2026.<n>The challenge evaluates robust video object segmentation under complex temporal dynamics.<n>Our method builds on SAM3 and focuses on its memory readout.
  arXiv  Detail & Related papers  (2026-08-22T18:09:51Z)
• Better, Stronger, Faster, and Broader: Structured All-Mask Prediction for MLLM-Based Segmentation [10.813064862132379]
  STAMP combines strong referring and reasoning segmentation with preserved multimodal ability and efficient inference.<n>It generates a target list with explicit IDs and optional boxes, binds these IDs to a shared multi-class mask space, and jointly predicts all targets in one non-autoregressive pass.<n>A single unified checkpoint retains STAMP's referring and reasoning capabilities while extending to open-vocabulary semantic, instance-aware, and remote-sensing small-target segmentation.
  arXiv  Detail & Related papers  (2026-08-03T18:42:11Z)
• A Shared Latent for Partially-Labeled Multi-Task Facial Affect Recognition [9.736740880077823]
  We show that partially-labeled multi-task learning is marginalization over a shared affect latent.<n>On s-Aff-Wild2, where only 37% of frames carry all three labels, the classes are severely imbalanced.<n>As each task's source is chosen on the evaluation split, we report the assembled result.
  arXiv  Detail & Related papers  (2026-07-11T04:55:12Z)
• CompassAD: Intent-Driven 3D Affordance Grounding in Functionally Competing Objects [23.801781337960914]
  In real-world scenes, multiple objects may share identical affordances, yet only one is appropriate under the given task context.<n>We formalize Multi-Object Affordance Grounding under Intent-Driven Instructions.<n>We construct CompassAD, the first benchmark centered on implicit intent in confusable multi-object scenes.
  arXiv  Detail & Related papers  (2026-04-02T13:57:01Z)
• The 1st Winner for 5th PVUW MeViS-Text Challenge: Strong MLLMs Meet SAM3 for Referring Video Object Segmentation [65.24213788883016]
  This report presents our winning solution to the 5th PVUW MeViS-Text Challenge.<n>We build a fully training-free pipeline that combines strong multimodal large language models with SAM3.<n>Our method ranks first on the PVUW 2026 MeViS-Text test set, achieving a Final score of 0.909064 and a J&F score of 0.7897026.
  arXiv  Detail & Related papers  (2026-04-01T02:42:30Z)
• More Than Sum of Its Parts: Deciphering Intent Shifts in Multimodal Hate Speech Detection [49.07221734365168]
  Hate speech on social media is critical for securing cyberspace, yet relies heavily on automated detection systems.<n>We characterize semantic intent shifts where modalities interact to construct implicit hate from benign cues or neutralize toxicity through semantic inversion.<n>We propose the Asymmetric Reasoning via Courtroom Agent DEbate framework to effectively decipher these complex cues.
  arXiv  Detail & Related papers  (2026-03-22T15:46:23Z)
• Polysemous Language Gaussian Splatting via Matching-based Mask Lifting [16.769952481766445]
  MUSplat is a training-free framework that abandons feature optimization entirely.<n>Our pipeline generates and lifts multi-granularity 2D masks into 3D, where we estimate a foreground probability for each Gaussian point to form initial object groups.<n>We then optimize the ambiguous boundaries of these initial groups using semantic entropy and geometric opacity.
  arXiv  Detail & Related papers  (2025-09-26T11:38:05Z)
• A Simple yet Powerful Instance-Aware Prompting Framework for Training-free Camouflaged Object Segmentation [6.712332323439369]
  We propose a training-free Camouflaged Object pipeline that explicitly converts a task-generic prompt into fine-grained instance masks.<n>The proposed IAPF significantly surpasses existing state-of-the-art training-free COS methods.
  arXiv  Detail & Related papers  (2025-08-09T09:35:32Z)
• LESS: Label-Efficient and Single-Stage Referring 3D Segmentation [55.06002976797879]
  Referring 3D is a visual-language task that segments all points of the specified object from a 3D point cloud described by a sentence of query. We propose a novel Referring 3D pipeline, Label-Efficient and Single-Stage, dubbed LESS, which is only under the supervision of efficient binary mask. We achieve state-of-the-art performance on ScanRefer dataset by surpassing the previous methods about 3.7% mIoU using only binary labels.
  arXiv  Detail & Related papers  (2024-10-17T07:47:41Z)
• Pluralistic Salient Object Detection [108.74650817891984]
  We introduce pluralistic salient object detection (PSOD), a novel task aimed at generating multiple plausible salient segmentation results for a given input image. We present two new SOD datasets "DUTS-MM" and "DUS-MQ", along with newly designed evaluation metrics.
  arXiv  Detail & Related papers  (2024-09-04T01:38:37Z)
• PartFormer: Awakening Latent Diverse Representation from Vision Transformer for Object Re-Identification [73.64560354556498]
  Vision Transformer (ViT) tends to overfit on most distinct regions of training data, limiting its generalizability and attention to holistic object features. We present PartFormer, an innovative adaptation of ViT designed to overcome the limitations in object Re-ID tasks. Our framework significantly outperforms state-of-the-art by 2.4% mAP scores on the most challenging MSMT17 dataset.
  arXiv  Detail & Related papers  (2024-08-29T16:31:05Z)
• Self-Supervised Scene De-occlusion [186.89979151728636]
  This paper investigates the problem of scene de-occlusion, which aims to recover the underlying occlusion ordering and complete the invisible parts of occluded objects. We make the first attempt to address the problem through a novel and unified framework that recovers hidden scene structures without ordering and amodal annotations as supervisions. Based on PCNet-M and PCNet-C, we devise a novel inference scheme to accomplish scene de-occlusion, via progressive ordering recovery, amodal completion and content completion.
  arXiv  Detail & Related papers  (2020-04-06T16:31:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.