Understanding visual attention beehind bee-inspired UAV navigation

• URL: http://arxiv.org/abs/2507.11992v1
• Date: Wed, 16 Jul 2025 07:44:25 GMT
• Title: Understanding visual attention beehind bee-inspired UAV navigation
• Authors: Pranav Rajbhandari, Abhi Veda, Matthew Garratt, Mandayam Srinivasan, Sridhar Ravi,
• Abstract summary: We train a Reinforcement Learning agent to navigate a tunnel with obstacles using only optic flow as sensory input.<n>We find that agents trained in this way pay most attention to regions of discontinuity in optic flow, as well as regions with large optic flow magnitude.<n>This pattern persists across independently trained agents, which suggests that this could be a good strategy for developing a simple explicit control law for physical UAVs.
• Score: 0.7067443325368975
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Bio-inspired design is often used in autonomous UAV navigation due to the capacity of biological systems for flight and obstacle avoidance despite limited sensory and computational capabilities. In particular, honeybees mainly use the sensory input of optic flow, the apparent motion of objects in their visual field, to navigate cluttered environments. In our work, we train a Reinforcement Learning agent to navigate a tunnel with obstacles using only optic flow as sensory input. We inspect the attention patterns of trained agents to determine the regions of optic flow on which they primarily base their motor decisions. We find that agents trained in this way pay most attention to regions of discontinuity in optic flow, as well as regions with large optic flow magnitude. The trained agents appear to navigate a cluttered tunnel by avoiding the obstacles that produce large optic flow, while maintaining a centered position in their environment, which resembles the behavior seen in flying insects. This pattern persists across independently trained agents, which suggests that this could be a good strategy for developing a simple explicit control law for physical UAVs.

Related papers

• DisBeaNet: A Deep Neural Network to augment Unmanned Surface Vessels for maritime situational awareness [0.0]
  This paper will present a novel low-cost vision perception system for detecting and tracking vessels in the maritime environment. A neural network, DisBeaNet, can detect vessels, track, and estimate the vessel's distance and bearing from the monocular camera.
  arXiv  Detail & Related papers  (2024-05-10T00:15:17Z)
• Airship Formations for Animal Motion Capture and Behavior Analysis [4.939986309170004]
  We showcase a system designed to use airship formations to track, follow, and visually record wild horses from multiple angles. In this work, we showcase a system designed to use airship formations to track, follow, and visually record wild horses from multiple angles.
  arXiv  Detail & Related papers  (2024-04-13T12:18:19Z)
• Floor extraction and door detection for visually impaired guidance [78.94595951597344]
  Finding obstacle-free paths in unknown environments is a big navigation issue for visually impaired people and autonomous robots. New devices based on computer vision systems can help impaired people to overcome the difficulties of navigating in unknown environments in safe conditions. In this work it is proposed a combination of sensors and algorithms that can lead to the building of a navigation system for visually impaired people.
  arXiv  Detail & Related papers  (2024-01-30T14:38:43Z)
• Learning Navigational Visual Representations with Semantic Map Supervision [85.91625020847358]
  We propose a navigational-specific visual representation learning method by contrasting the agent's egocentric views and semantic maps. Ego$2$-Map learning transfers the compact and rich information from a map, such as objects, structure and transition, to the agent's egocentric representations for navigation.
  arXiv  Detail & Related papers  (2023-07-23T14:01:05Z)
• Emergence of Maps in the Memories of Blind Navigation Agents [68.41901534985575]
  Animal navigation research posits that organisms build and maintain internal spatial representations, or maps, of their environment. We ask if machines -- specifically, artificial intelligence (AI) navigation agents -- also build implicit (or'mental') maps. Unlike animal navigation, we can judiciously design the agent's perceptual system and control the learning paradigm to nullify alternative navigation mechanisms.
  arXiv  Detail & Related papers  (2023-01-30T20:09:39Z)
• Active Perception Applied To Unmanned Aerial Vehicles Through Deep Reinforcement Learning [0.5161531917413708]
  This work aims to contribute to the active perception of UAVs by tackling the problem of tracking and recognizing water surface structures. We show that our system with classical image processing techniques and a simple Deep Reinforcement Learning (Deep-RL) agent is capable of perceiving the environment and dealing with uncertainties.
  arXiv  Detail & Related papers  (2022-09-13T22:51:34Z)
• Learning Perceptual Locomotion on Uneven Terrains using Sparse Visual Observations [75.60524561611008]
  This work aims to exploit the use of sparse visual observations to achieve perceptual locomotion over a range of commonly seen bumps, ramps, and stairs in human-centred environments. We first formulate the selection of minimal visual input that can represent the uneven surfaces of interest, and propose a learning framework that integrates such exteroceptive and proprioceptive data. We validate the learned policy in tasks that require omnidirectional walking over flat ground and forward locomotion over terrains with obstacles, showing a high success rate.
  arXiv  Detail & Related papers  (2021-09-28T20:25:10Z)
• Emergent behavior and neural dynamics in artificial agents tracking turbulent plumes [1.8065361710947974]
  We use deep reinforcement learning to train recurrent neural network (RNN) agents to locate the source of simulated turbulent plumes. Our analyses suggest an intriguing experimentally testable hypothesis for tracking plumes in changing wind direction.
  arXiv  Detail & Related papers  (2021-09-25T20:57:02Z)
• Deep Learning for Embodied Vision Navigation: A Survey [108.13766213265069]
  "Embodied visual navigation" problem requires an agent to navigate in a 3D environment mainly rely on its first-person observation. This paper attempts to establish an outline of the current works in the field of embodied visual navigation by providing a comprehensive literature survey.
  arXiv  Detail & Related papers  (2021-07-07T12:09:04Z)
• Diagnosing Vision-and-Language Navigation: What Really Matters [61.72935815656582]
  Vision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Recent studies witness a slow-down in the performance improvements in both indoor and outdoor VLN tasks. In this work, we conduct a series of diagnostic experiments to unveil agents' focus during navigation.
  arXiv  Detail & Related papers  (2021-03-30T17:59:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.