Spatio-Temporal Feedback Control of Small Target Motion Detection Visual System

• URL: http://arxiv.org/abs/2211.10128v1
• Date: Fri, 18 Nov 2022 10:10:48 GMT
• Title: Spatio-Temporal Feedback Control of Small Target Motion Detection Visual System
• Authors: Hongxin Wang, Zhiyan Zhong, Fang Lei, Xiaohua Jing, Jigen Peng, Shigang Yue
• Abstract summary: This paper develops a visual system withtemporal-temporal feedback to detect small target motion. The proposed visual system is composed of two complementary spatial neuronalworks. Experimental results demonstrate that the system is more competitive than existing methods in detecting small targets.
• Score: 9.03311522244788
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Feedback is crucial to motion perception in animals' visual systems where its spatial and temporal dynamics are often shaped by movement patterns of surrounding environments. However, such spatio-temporal feedback has not been deeply explored in designing neural networks to detect small moving targets that cover only one or a few pixels in image while presenting extremely limited visual features. In this paper, we address small target motion detection problem by developing a visual system with spatio-temporal feedback loop, and further reveal its important roles in suppressing false positive background movement while enhancing network responses to small targets. Specifically, the proposed visual system is composed of two complementary subnetworks. The first subnetwork is designed to extract spatial and temporal motion patterns of cluttered backgrounds by neuronal ensemble coding. The second subnetwork is developed to capture small target motion information and integrate the spatio-temporal feedback signal from the first subnetwork to inhibit background false positives. Experimental results demonstrate that the proposed spatio-temporal feedback visual system is more competitive than existing methods in discriminating small moving targets from complex dynamic environment.

Related papers

• TSOM: Small Object Motion Detection Neural Network Inspired by Avian Visual Circuit [4.640328175695991]
  The Retina-OT-Rt visual circuit is highly sensitive to capturing the motion information of small objects from high altitudes. We propose a novel tectum small object motion detection neural network (TSOM) The TSOM is biologically interpretable and effective in extracting reliable small object motion features from complex high-altitude backgrounds.
  arXiv  Detail & Related papers  (2024-04-01T01:49:08Z)
• LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry [52.131996528655094]
  We present the Long-term Effective Any Point Tracking (LEAP) module. LEAP innovatively combines visual, inter-track, and temporal cues with mindfully selected anchors for dynamic track estimation. Based on these traits, we develop LEAP-VO, a robust visual odometry system adept at handling occlusions and dynamic scenes.
  arXiv  Detail & Related papers  (2024-01-03T18:57:27Z)
• Neural Motion Fields: Encoding Grasp Trajectories as Implicit Value Functions [65.84090965167535]
  We present Neural Motion Fields, a novel object representation which encodes both object point clouds and the relative task trajectories as an implicit value function parameterized by a neural network. This object-centric representation models a continuous distribution over the SE(3) space and allows us to perform grasping reactively by leveraging sampling-based MPC to optimize this value function.
  arXiv  Detail & Related papers  (2022-06-29T18:47:05Z)
• FuNNscope: Visual microscope for interactively exploring the loss landscape of fully connected neural networks [77.34726150561087]
  We show how to explore high-dimensional landscape characteristics of neural networks. We generalize observations on small neural networks to more complex systems. An interactive dashboard opens up a number of possible application networks.
  arXiv  Detail & Related papers  (2022-04-09T16:41:53Z)
• An Attention and Prediction Guided Visual System for Small Target Motion Detection in Complex Natural Environments [7.972704756263765]
  Small target motion detection within complex natural environment is an extremely challenging task for autonomous robots. In this paper, we propose an attention and prediction guided visual system to overcome this limitation. The proposed visual system mainly consists of three subsystems, including an attention module, a STMD-based neural network, and a prediction module.
  arXiv  Detail & Related papers  (2021-04-27T07:42:31Z)
• A Bioinspired Approach-Sensitive Neural Network for Collision Detection in Cluttered and Dynamic Backgrounds [19.93930316898735]
  Rapid accurate and robust detection of looming objects in moving backgrounds is a significant and challenging problem for robotic visual systems. Inspired by the neural circuit elementary vision in the mammalian retina, this paper proposes a bioinspired approach-sensitive neural network (AS) The proposed model is able to not only detect collision accurately and robustly in cluttered and dynamic backgrounds but also extract more collision information like position and direction, for guiding rapid decision making.
  arXiv  Detail & Related papers  (2021-03-01T09:16:18Z)
• A Bioinspired Retinal Neural Network for Accurately Extracting Small-Target Motion Information in Cluttered Backgrounds [19.93930316898735]
  This paper proposes a bioinspired neural network based on a new neuro-based motion filtering and multiform 2-D spatial filtering. It can estimate motion direction accurately via only two signals and respond to small targets of different sizes and velocities. It can also extract the information of motion direction and motion accurately energy and rapidly.
  arXiv  Detail & Related papers  (2021-03-01T08:44:27Z)
• DS-Net: Dynamic Spatiotemporal Network for Video Salient Object Detection [78.04869214450963]
  We propose a novel dynamic temporal-temporal network (DSNet) for more effective fusion of temporal and spatial information. We show that the proposed method achieves superior performance than state-of-the-art algorithms.
  arXiv  Detail & Related papers  (2020-12-09T06:42:30Z)
• Fast Motion Understanding with Spatiotemporal Neural Networks and Dynamic Vision Sensors [99.94079901071163]
  This paper presents a Dynamic Vision Sensor (DVS) based system for reasoning about high speed motion. We consider the case of a robot at rest reacting to a small, fast approaching object at speeds higher than 15m/s. We highlight the results of our system to a toy dart moving at 23.4m/s with a 24.73deg error in $theta$, 18.4mm average discretized radius prediction error, and 25.03% median time to collision prediction error.
  arXiv  Detail & Related papers  (2020-11-18T17:55:07Z)
• Ventral-Dorsal Neural Networks: Object Detection via Selective Attention [51.79577908317031]
  We propose a new framework called Ventral-Dorsal Networks (VDNets) Inspired by the structure of the human visual system, we propose the integration of a "Ventral Network" and a "Dorsal Network" Our experimental results reveal that the proposed method outperforms state-of-the-art object detection approaches.
  arXiv  Detail & Related papers  (2020-05-15T23:57:36Z)
• A Time-Delay Feedback Neural Network for Discriminating Small, Fast-Moving Targets in Complex Dynamic Environments [8.645725394832969]
  Discriminating small moving objects within complex visual environments is a significant challenge for autonomous micro robots. We propose an STMD-based neural network with feedback connection (Feedback STMD), where the network output is temporally delayed, then fed back to the lower layers to mediate neural responses.
  arXiv  Detail & Related papers  (2019-12-29T03:10:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.