PVUW 2024 Challenge on Complex Video Understanding: Methods and Results

• URL: http://arxiv.org/abs/2406.17005v1
• Date: Mon, 24 Jun 2024 17:38:58 GMT
• Title: PVUW 2024 Challenge on Complex Video Understanding: Methods and Results
• Authors: Henghui Ding, Chang Liu, Yunchao Wei, Nikhila Ravi, Shuting He, Song Bai, Philip Torr, Deshui Miao, Xin Li, Zhenyu He, Yaowei Wang, Ming-Hsuan Yang, Zhensong Xu, Jiangtao Yao, Chengjing Wu, Ting Liu, Luoqi Liu, Xinyu Liu, Jing Zhang, Kexin Zhang, Yuting Yang, Licheng Jiao, Shuyuan Yang, Mingqi Gao, Jingnan Luo, Jinyu Yang, Jungong Han, Feng Zheng, Bin Cao, Yisi Zhang, Xuanxu Lin, Xingjian He, Bo Zhao, Jing Liu, Feiyu Pan, Hao Fang, Xiankai Lu,
• Abstract summary: We add two new tracks, Complex Video Object Track based on MOSE dataset and Motion Expression guided Video track based on MeViS dataset. In the two new tracks, we provide additional videos and annotations that feature challenging elements. These new videos, sentences, and annotations enable us to foster the development of a more comprehensive and robust pixel-level understanding of video scenes.
• Score: 199.5593316907284
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Pixel-level Video Understanding in the Wild Challenge (PVUW) focus on complex video understanding. In this CVPR 2024 workshop, we add two new tracks, Complex Video Object Segmentation Track based on MOSE dataset and Motion Expression guided Video Segmentation track based on MeViS dataset. In the two new tracks, we provide additional videos and annotations that feature challenging elements, such as the disappearance and reappearance of objects, inconspicuous small objects, heavy occlusions, and crowded environments in MOSE. Moreover, we provide a new motion expression guided video segmentation dataset MeViS to study the natural language-guided video understanding in complex environments. These new videos, sentences, and annotations enable us to foster the development of a more comprehensive and robust pixel-level understanding of video scenes in complex environments and realistic scenarios. The MOSE challenge had 140 registered teams in total, 65 teams participated the validation phase and 12 teams made valid submissions in the final challenge phase. The MeViS challenge had 225 registered teams in total, 50 teams participated the validation phase and 5 teams made valid submissions in the final challenge phase.

Related papers

• LSVOS Challenge Report: Large-scale Complex and Long Video Object Segmentation [124.50550604020684]
  This paper introduces the 6th Large-scale Video Object (LSVOS) challenge in conjunction with ECCV 2024 workshop. This year's challenge includes two tasks: Video Object (VOS) and Referring Video Object (RVOS) This year's challenge attracted 129 registered teams from more than 20 institutes across over 8 countries.
  arXiv  Detail & Related papers  (2024-09-09T17:45:45Z)
• 1st Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video Segmentation [81.50620771207329]
  We investigate the effectiveness of static-dominant data and frame sampling on referring video object segmentation (RVOS) Our solution achieves a J&F score of 0.5447 in the competition phase and ranks 1st in the MeViS track of the PVUW Challenge.
  arXiv  Detail & Related papers  (2024-06-11T08:05:26Z)
• NTIRE 2023 Quality Assessment of Video Enhancement Challenge [97.809937484099]
  This paper reports on the NTIRE 2023 Quality Assessment of Video Enhancement Challenge. The challenge is to address a major challenge in the field of video processing, namely, video quality assessment (VQA) for enhanced videos. The challenge has a total of 167 registered participants.
  arXiv  Detail & Related papers  (2023-07-19T02:33:42Z)
• ICDAR 2021 Competition on Scene Video Text Spotting [28.439390836950025]
  Scene video text spotting (SVTS) is a very important research topic because of many real-life applications. This paper includes dataset descriptions, task definitions, evaluation protocols and results summaries of the ICDAR 2021 on SVTS competition.
  arXiv  Detail & Related papers  (2021-07-26T01:25:57Z)
• AIM 2020 Challenge on Video Temporal Super-Resolution [118.46127362093135]
  Second AIM challenge on Video Temporal Super-Resolution (VTSR) This paper reports the second AIM challenge on Video Temporal Super-Resolution (VTSR)
  arXiv  Detail & Related papers  (2020-09-28T00:10:29Z)
• AIM 2019 Challenge on Video Temporal Super-Resolution: Methods and Results [129.15554076593762]
  This paper reviews the first AIM challenge on video temporal super-resolution (frame) From low-frame-rate (15 fps) video sequences, the challenge participants are asked to submit higher-framerate (60 fps) video sequences. We employ the REDS VTSR dataset derived from diverse videos captured in a hand-held camera for training and evaluation purposes.
  arXiv  Detail & Related papers  (2020-05-04T01:51:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.