The Method of Detecting Flying Birds in Surveillance Video Based on Their Characteristics

• URL: http://arxiv.org/abs/2401.03749v2
• Date: Sat, 13 Apr 2024 05:56:09 GMT
• Title: The Method of Detecting Flying Birds in Surveillance Video Based on Their Characteristics
• Authors: Ziwei Sun, Zexi Hua, Hengchao Li, Yan Li,
• Abstract summary: This paper proposes a Flying Bird Object Detection method in Surveillance Video (FBOD-SV) New feature aggregation module, Correlation Attention Feature Aggregation (Co-Attention-FA) module, is designed to aggregate the features of the flying bird object. Flying Bird Object Detection Network (FBOD-Net) with down-sampling and then up-sampling is designed. SimOTA dynamic label allocation method is applied to One-Category object detection.
• Score: 9.597393200515377
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Aiming at the characteristics of the flying bird object in surveillance video, such as the single frame image feature is not obvious, the size is small in most cases, and asymmetric, this paper proposes a Flying Bird Object Detection method in Surveillance Video (FBOD-SV). Firstly, a new feature aggregation module, the Correlation Attention Feature Aggregation (Co-Attention-FA) module, is designed to aggregate the features of the flying bird object according to the bird object's correlation on multiple consecutive frames of images. Secondly, a Flying Bird Object Detection Network (FBOD-Net) with down-sampling and then up-sampling is designed, which uses a large feature layer that fuses fine spatial information and large receptive field information to detect special multi-scale (mostly small-scale) bird objects. Finally, the SimOTA dynamic label allocation method is applied to One-Category object detection, and the SimOTA-OC dynamic label strategy is proposed to solve the difficult problem of label allocation caused by irregular flying bird objects. In this paper, the algorithm's performance is verified by the experimental data set of the surveillance video of the flying bird object of the traction substation. The experimental results show that the surveillance video flying bird object detection method proposed in this paper effectively improves the detection performance of flying bird objects.

Related papers

• SOOD++: Leveraging Unlabeled Data to Boost Oriented Object Detection [59.868772767818975]
  We propose a simple yet effective Semi-supervised Oriented Object Detection method termed SOOD++. Specifically, we observe that objects from aerial images are usually arbitrary orientations, small scales, and aggregation. Extensive experiments conducted on various multi-oriented object datasets under various labeled settings demonstrate the effectiveness of our method.
  arXiv  Detail & Related papers  (2024-07-01T07:03:51Z)
• Visible and Clear: Finding Tiny Objects in Difference Map [50.54061010335082]
  We introduce a self-reconstruction mechanism in the detection model, and discover the strong correlation between it and the tiny objects. Specifically, we impose a reconstruction head in-between the neck of a detector, constructing a difference map of the reconstructed image and the input, which shows high sensitivity to tiny objects. We further develop a Difference Map Guided Feature Enhancement (DGFE) module to make the tiny feature representation more clear.
  arXiv  Detail & Related papers  (2024-05-18T12:22:26Z)
• Innovative Horizons in Aerial Imagery: LSKNet Meets DiffusionDet for Advanced Object Detection [55.2480439325792]
  We present an in-depth evaluation of an object detection model that integrates the LSKNet backbone with the DiffusionDet head. The proposed model achieves a mean average precision (MAP) of approximately 45.7%, which is a significant improvement. This advancement underscores the effectiveness of the proposed modifications and sets a new benchmark in aerial image analysis.
  arXiv  Detail & Related papers  (2023-11-21T19:49:13Z)
• EarlyBird: Early-Fusion for Multi-View Tracking in the Bird's Eye View [6.093524345727119]
  We show that early-fusion in the Bird's Eye View achieves high accuracy for both detection and tracking. EarlyBird outperforms the state-of-the-art methods and improves the current state-of-the-art on Wildtrack by +4.6 MOTA and +5.6 IDF1.
  arXiv  Detail & Related papers  (2023-10-20T08:27:21Z)
• FOLT: Fast Multiple Object Tracking from UAV-captured Videos Based on Optical Flow [27.621524657473945]
  Multiple object tracking (MOT) has been successfully investigated in computer vision. However, MOT for the videos captured by unmanned aerial vehicles (UAV) is still challenging due to small object size, blurred object appearance, and very large and/or irregular motion. We propose FOLT to mitigate these problems and reach fast and accurate MOT in UAV view.
  arXiv  Detail & Related papers  (2023-08-14T15:24:44Z)
• Flying Bird Object Detection Algorithm in Surveillance Video Based on Motion Information [0.0]
  The size of the object is small (low Signal-to-Noise Ratio (SNR)) in surveillance video. An object tracking algorithm is used to track suspicious flying bird objects and calculate their Motion Range (MR) At the same time, the size of the MR of the suspicious flying bird object is adjusted adaptively according to its speed of movement. A LightWeight U-Shape Net (LW-USN) based on ASt-Cubes is designed to detect flying bird objects.
  arXiv  Detail & Related papers  (2023-01-05T05:32:22Z)
• Finding a Needle in a Haystack: Tiny Flying Object Detection in 4K Videos using a Joint Detection-and-Tracking Approach [19.59528430884104]
  We present a neural network model called the Recurrent Correlational Network, where detection and tracking are jointly performed. In experiments with datasets containing images of scenes with small flying objects, such as birds and unmanned aerial vehicles, the proposed method yielded consistent improvements. Our network performs as well as state-of-the-art generic object trackers when it was evaluated as a tracker on a bird image dataset.
  arXiv  Detail & Related papers  (2021-05-18T03:22:03Z)
• Ensembling object detectors for image and video data analysis [98.26061123111647]
  We propose a method for ensembling the outputs of multiple object detectors for improving detection performance and precision of bounding boxes on image data. We extend it to video data by proposing a two-stage tracking-based scheme for detection refinement.
  arXiv  Detail & Related papers  (2021-02-09T12:38:16Z)
• Perceiving Traffic from Aerial Images [86.994032967469]
  We propose an object detection method called Butterfly Detector that is tailored to detect objects in aerial images. We evaluate our Butterfly Detector on two publicly available UAV datasets (UAVDT and VisDrone 2019) and show that it outperforms previous state-of-the-art methods while remaining real-time.
  arXiv  Detail & Related papers  (2020-09-16T11:37:43Z)
• BirdNet+: End-to-End 3D Object Detection in LiDAR Bird's Eye View [117.44028458220427]
  On-board 3D object detection in autonomous vehicles often relies on geometry information captured by LiDAR devices. We present a fully end-to-end 3D object detection framework that can infer oriented 3D boxes solely from BEV images.
  arXiv  Detail & Related papers  (2020-03-09T15:08:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.