Flying Bird Object Detection Algorithm in Surveillance Video Based on Motion Information

• URL: http://arxiv.org/abs/2301.01917v3
• Date: Sat, 26 Aug 2023 13:49:36 GMT
• Title: Flying Bird Object Detection Algorithm in Surveillance Video Based on Motion Information
• Authors: Ziwei Sun, Zexi Hua, Hengcao Li, Haiyan Zhong
• Abstract summary: The size of the object is small (low Signal-to-Noise Ratio (SNR)) in surveillance video. An object tracking algorithm is used to track suspicious flying bird objects and calculate their Motion Range (MR) At the same time, the size of the MR of the suspicious flying bird object is adjusted adaptively according to its speed of movement. A LightWeight U-Shape Net (LW-USN) based on ASt-Cubes is designed to detect flying bird objects.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: A Flying Bird Object Detection algorithm Based on Motion Information (FBOD-BMI) is proposed to solve the problem that the features of the object are not obvious in a single frame, and the size of the object is small (low Signal-to-Noise Ratio (SNR)) in surveillance video. Firstly, a ConvLSTM-PAN model structure is designed to capture suspicious flying bird objects, in which the Convolutional Long and Short Time Memory (ConvLSTM) network aggregated the Spatio-temporal features of the flying bird object on adjacent multi-frame before the input of the model and the Path Aggregation Network (PAN) located the suspicious flying bird objects. Then, an object tracking algorithm is used to track suspicious flying bird objects and calculate their Motion Range (MR). At the same time, the size of the MR of the suspicious flying bird object is adjusted adaptively according to its speed of movement (specifically, if the bird moves slowly, its MR will be expanded according to the speed of the bird to ensure the environmental information needed to detect the flying bird object). Adaptive Spatio-temporal Cubes (ASt-Cubes) of the flying bird objects are generated to ensure that the SNR of the flying bird objects is improved, and the necessary environmental information is retained adaptively. Finally, a LightWeight U-Shape Net (LW-USN) based on ASt-Cubes is designed to detect flying bird objects, which rejects the false detections of the suspicious flying bird objects and returns the position of the real flying bird objects. The monitoring video including the flying birds is collected in the unattended traction substation as the experimental dataset to verify the performance of the algorithm. The experimental results show that the flying bird object detection method based on motion information proposed in this paper can effectively detect the flying bird object in surveillance video.

Related papers

• FBD-SV-2024: Flying Bird Object Detection Dataset in Surveillance Video [11.776652825866648]
  This dataset comprises 483 video clips, amounting to 28,694 frames in total. Among them, 23,833 frames contain 28,366 instances of flying birds.
  arXiv  Detail & Related papers  (2024-08-31T01:11:57Z)
• Temporally-consistent 3D Reconstruction of Birds [5.787285686300833]
  We propose an approach to reconstruct the 3D pose and shape from monocular videos of a specific breed of seabird - the common murre. We provide a real-world dataset of 10000 frames of video observations on average capture nine birds simultaneously.
  arXiv  Detail & Related papers  (2024-08-24T17:12:36Z)
• A Flying Bird Object Detection Method for Surveillance Video [9.597393200515377]
  This paper proposes a Flying Bird Object Detection method for Surveillance Video (FBOD-SV) The FBOD-SV is validated using experimental datasets of flying bird objects in traction substation surveillance videos. The experimental results show that the FBOD-SV effectively improves the detection performance of flying bird objects in surveillance video.
  arXiv  Detail & Related papers  (2024-01-08T09:20:46Z)
• UAVs and Birds: Enhancing Short-Range Navigation through Budgerigar Flight Studies [2.3884184860468136]
  This study delves into the flight behaviors of Budgerigars (Melopsittacus undulatus) to gain insights into their flight trajectories and movements. Using 3D reconstruction from stereo video camera recordings, we closely examine the velocity and acceleration patterns during three flight motion takeoff, flying and landing. The research aims to bridge the gap between biological principles observed in birds and the application of these insights in developing more efficient and autonomous UAVs.
  arXiv  Detail & Related papers  (2023-12-01T14:02:16Z)
• FOLT: Fast Multiple Object Tracking from UAV-captured Videos Based on Optical Flow [27.621524657473945]
  Multiple object tracking (MOT) has been successfully investigated in computer vision. However, MOT for the videos captured by unmanned aerial vehicles (UAV) is still challenging due to small object size, blurred object appearance, and very large and/or irregular motion. We propose FOLT to mitigate these problems and reach fast and accurate MOT in UAV view.
  arXiv  Detail & Related papers  (2023-08-14T15:24:44Z)
• DORT: Modeling Dynamic Objects in Recurrent for Multi-Camera 3D Object Detection and Tracking [67.34803048690428]
  We propose to model Dynamic Objects in RecurrenT (DORT) to tackle this problem. DORT extracts object-wise local volumes for motion estimation that also alleviates the heavy computational burden. It is flexible and practical that can be plugged into most camera-based 3D object detectors.
  arXiv  Detail & Related papers  (2023-03-29T12:33:55Z)
• Deep object detection for waterbird monitoring using aerial imagery [56.1262568293658]
  In this work, we present a deep learning pipeline that can be used to precisely detect, count, and monitor waterbirds using aerial imagery collected by a commercial drone. By utilizing convolutional neural network-based object detectors, we show that we can detect 16 classes of waterbird species that are commonly found in colonial nesting islands along the Texas coast.
  arXiv  Detail & Related papers  (2022-10-10T17:37:56Z)
• Implicit Motion Handling for Video Camouflaged Object Detection [60.98467179649398]
  We propose a new video camouflaged object detection (VCOD) framework. It can exploit both short-term and long-term temporal consistency to detect camouflaged objects from video frames.
  arXiv  Detail & Related papers  (2022-03-14T17:55:41Z)
• DS-Net: Dynamic Spatiotemporal Network for Video Salient Object Detection [78.04869214450963]
  We propose a novel dynamic temporal-temporal network (DSNet) for more effective fusion of temporal and spatial information. We show that the proposed method achieves superior performance than state-of-the-art algorithms.
  arXiv  Detail & Related papers  (2020-12-09T06:42:30Z)
• Perceiving Traffic from Aerial Images [86.994032967469]
  We propose an object detection method called Butterfly Detector that is tailored to detect objects in aerial images. We evaluate our Butterfly Detector on two publicly available UAV datasets (UAVDT and VisDrone 2019) and show that it outperforms previous state-of-the-art methods while remaining real-time.
  arXiv  Detail & Related papers  (2020-09-16T11:37:43Z)
• BirdNet+: End-to-End 3D Object Detection in LiDAR Bird's Eye View [117.44028458220427]
  On-board 3D object detection in autonomous vehicles often relies on geometry information captured by LiDAR devices. We present a fully end-to-end 3D object detection framework that can infer oriented 3D boxes solely from BEV images.
  arXiv  Detail & Related papers  (2020-03-09T15:08:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.