Motion-guided small MAV detection in complex and non-planar scenes

• URL: http://arxiv.org/abs/2410.10527v1
• Date: Mon, 14 Oct 2024 14:06:41 GMT
• Title: Motion-guided small MAV detection in complex and non-planar scenes
• Authors: Hanqing Guo, Canlun Zheng, Shiyu Zhao,
• Abstract summary: We propose a novel motion-guided MAV detector that can accurately identify small MAVs in complex and non-planar scenes. Our proposed method can effectively and efficiently detect extremely small MAVs from dynamic and complex backgrounds.
• Score: 10.15211816323658
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: In recent years, there has been a growing interest in the visual detection of micro aerial vehicles (MAVs) due to its importance in numerous applications. However, the existing methods based on either appearance or motion features encounter difficulties when the background is complex or the MAV is too small. In this paper, we propose a novel motion-guided MAV detector that can accurately identify small MAVs in complex and non-planar scenes. This detector first exploits a motion feature enhancement module to capture the motion features of small MAVs. Then it uses multi-object tracking and trajectory filtering to eliminate false positives caused by motion parallax. Finally, an appearance-based classifier and an appearance-based detector that operates on the cropped regions are used to achieve precise detection results. Our proposed method can effectively and efficiently detect extremely small MAVs from dynamic and complex backgrounds because it aggregates pixel-level motion features and eliminates false positives based on the motion and appearance features of MAVs. Experiments on the ARD-MAV dataset demonstrate that the proposed method could achieve high performance in small MAV detection under challenging conditions and outperform other state-of-the-art methods across various metrics

Related papers

• Effective and Efficient Adversarial Detection for Vision-Language Models via A Single Vector [97.92369017531038]
  We build a new laRge-scale Adervsarial images dataset with Diverse hArmful Responses (RADAR) We then develop a novel iN-time Embedding-based AdveRSarial Image DEtection (NEARSIDE) method, which exploits a single vector that distilled from the hidden states of Visual Language Models (VLMs) to achieve the detection of adversarial images against benign ones in the input.
  arXiv  Detail & Related papers  (2024-10-30T10:33:10Z)
• MM-Tracker: Motion Mamba with Margin Loss for UAV-platform Multiple Object Tracking [12.326023523101806]
  Multiple object tracking (MOT) from unmanned aerial vehicle platforms requires efficient motion modeling. We propose the Motion Mamba Module, which explores both local and global motion features. We also design motion margin loss to effectively improve the detection accuracy of motion blurred objects. Based on the Motion Mamba module and motion margin loss, our proposed MM-Tracker surpasses the state-of-the-art in two widely open-source UAV-MOT datasets.
  arXiv  Detail & Related papers  (2024-07-15T07:13:27Z)
• Visible and Clear: Finding Tiny Objects in Difference Map [50.54061010335082]
  We introduce a self-reconstruction mechanism in the detection model, and discover the strong correlation between it and the tiny objects. Specifically, we impose a reconstruction head in-between the neck of a detector, constructing a difference map of the reconstructed image and the input, which shows high sensitivity to tiny objects. We further develop a Difference Map Guided Feature Enhancement (DGFE) module to make the tiny feature representation more clear.
  arXiv  Detail & Related papers  (2024-05-18T12:22:26Z)
• Motion-adaptive Separable Collaborative Filters for Blind Motion Deblurring [71.60457491155451]
  Eliminating image blur produced by various kinds of motion has been a challenging problem. We propose a novel real-world deblurring filtering model called the Motion-adaptive Separable Collaborative Filter. Our method provides an effective solution for real-world motion blur removal and achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-04-19T19:44:24Z)
• Global-Local MAV Detection under Challenging Conditions based on Appearance and Motion [27.11400452401168]
  We propose a global-local MAV detector that can fuse both motion and appearance features for MAV detection under challenging conditions. A new dataset is created to train and verify the effectiveness of the proposed detector. In particular, this detector can run with near real-time frame rate on NVIDIA Jetson NX Xavier, which demonstrates the usefulness of our approach for real-world applications.
  arXiv  Detail & Related papers  (2023-12-18T08:06:36Z)
• Joint-YODNet: A Light-weight Object Detector for UAVs to Achieve Above 100fps [2.5761958263376745]
  We propose a novel method called JointYODNet for UAVs to detect small objects. Our method revolves around the development of a joint loss function tailored to enhance the detection performance of small objects. The results demonstrate that our proposed joint loss function outperforms existing methods in accurately localizing small objects.
  arXiv  Detail & Related papers  (2023-09-27T16:57:04Z)
• FOLT: Fast Multiple Object Tracking from UAV-captured Videos Based on Optical Flow [27.621524657473945]
  Multiple object tracking (MOT) has been successfully investigated in computer vision. However, MOT for the videos captured by unmanned aerial vehicles (UAV) is still challenging due to small object size, blurred object appearance, and very large and/or irregular motion. We propose FOLT to mitigate these problems and reach fast and accurate MOT in UAV view.
  arXiv  Detail & Related papers  (2023-08-14T15:24:44Z)
• Discovery-and-Selection: Towards Optimal Multiple Instance Learning for Weakly Supervised Object Detection [86.86602297364826]
  We propose a discoveryand-selection approach fused with multiple instance learning (DS-MIL) Our proposed DS-MIL approach can consistently improve the baselines, reporting state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-10-18T07:06:57Z)
• Finding a Needle in a Haystack: Tiny Flying Object Detection in 4K Videos using a Joint Detection-and-Tracking Approach [19.59528430884104]
  We present a neural network model called the Recurrent Correlational Network, where detection and tracking are jointly performed. In experiments with datasets containing images of scenes with small flying objects, such as birds and unmanned aerial vehicles, the proposed method yielded consistent improvements. Our network performs as well as state-of-the-art generic object trackers when it was evaluated as a tracker on a bird image dataset.
  arXiv  Detail & Related papers  (2021-05-18T03:22:03Z)
• Perceiving Traffic from Aerial Images [86.994032967469]
  We propose an object detection method called Butterfly Detector that is tailored to detect objects in aerial images. We evaluate our Butterfly Detector on two publicly available UAV datasets (UAVDT and VisDrone 2019) and show that it outperforms previous state-of-the-art methods while remaining real-time.
  arXiv  Detail & Related papers  (2020-09-16T11:37:43Z)
• TinyVIRAT: Low-resolution Video Action Recognition [70.37277191524755]
  In real-world surveillance environments, the actions in videos are captured at a wide range of resolutions. We introduce a benchmark dataset, TinyVIRAT, which contains natural low-resolution activities. We propose a novel method for recognizing tiny actions in videos which utilizes a progressive generative approach.
  arXiv  Detail & Related papers  (2020-07-14T21:09:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.