Grid Cell Path Integration For Movement-Based Visual Object Recognition

• URL: http://arxiv.org/abs/2102.09076v1
• Date: Wed, 17 Feb 2021 23:52:57 GMT
• Title: Grid Cell Path Integration For Movement-Based Visual Object Recognition
• Authors: Niels Leadholm (1 and 2), Marcus Lewis (1), Subutai Ahmad (1) ((1) Numenta, (2) The University of Oxford)
• Abstract summary: We show how grid cell-based path integration in a cortical network can support reliable recognition of objects given an arbitrary sequence of inputs. Our network (GridCellNet) uses grid cell computations to integrate visual information and make predictions based on movements.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Grid cells enable the brain to model the physical space of the world and navigate effectively via path integration, updating self-position using information from self-movement. Recent proposals suggest that the brain might use similar mechanisms to understand the structure of objects in diverse sensory modalities, including vision. In machine vision, object recognition given a sequence of sensory samples of an image, such as saccades, is a challenging problem when the sequence does not follow a consistent, fixed pattern - yet this is something humans do naturally and effortlessly. We explore how grid cell-based path integration in a cortical network can support reliable recognition of objects given an arbitrary sequence of inputs. Our network (GridCellNet) uses grid cell computations to integrate visual information and make predictions based on movements. We use local Hebbian plasticity rules to learn rapidly from a handful of examples (few-shot learning), and consider the task of recognizing MNIST digits given only a sequence of image feature patches. We compare GridCellNet to k-Nearest Neighbour (k-NN) classifiers as well as recurrent neural networks (RNNs), both of which lack explicit mechanisms for handling arbitrary sequences of input samples. We show that GridCellNet can reliably perform classification, generalizing to both unseen examples and completely novel sequence trajectories. We further show that inference is often successful after sampling a fraction of the input space, enabling the predictive GridCellNet to reconstruct the rest of the image given just a few movements. We propose that dynamically moving agents with active sensors can use grid cell representations not only for navigation, but also for efficient recognition and feature prediction of seen objects.

Related papers

• Linking in Style: Understanding learned features in deep learning models [0.0]
  Convolutional neural networks (CNNs) learn abstract features to perform object classification. We propose an automatic method to visualize and systematically analyze learned features in CNNs.
  arXiv  Detail & Related papers  (2024-09-25T12:28:48Z)
• Hierarchical Graph Interaction Transformer with Dynamic Token Clustering for Camouflaged Object Detection [57.883265488038134]
  We propose a hierarchical graph interaction network termed HGINet for camouflaged object detection. The network is capable of discovering imperceptible objects via effective graph interaction among the hierarchical tokenized features. Our experiments demonstrate the superior performance of HGINet compared to existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-08-27T12:53:25Z)
• Self-Supervised Learning of Representations for Space Generates Multi-Modular Grid Cells [16.208253624969142]
  mammalian lineage has developed striking spatial representations. One important spatial representation is the Nobel-prize winning grid cells. Nobel-prize winning grid cells represent self-location, a local and aperiodic quantity.
  arXiv  Detail & Related papers  (2023-11-04T03:59:37Z)
• Dynamic Graph Message Passing Networks for Visual Recognition [112.49513303433606]
  Modelling long-range dependencies is critical for scene understanding tasks in computer vision. A fully-connected graph is beneficial for such modelling, but its computational overhead is prohibitive. We propose a dynamic graph message passing network, that significantly reduces the computational complexity.
  arXiv  Detail & Related papers  (2022-09-20T14:41:37Z)
• Graph Neural Network for Cell Tracking in Microscopy Videos [0.0]
  We present a novel graph neural network (GNN) approach for cell tracking in microscopy videos. By modeling the entire time-lapse sequence as a direct graph, we extract the entire set of cell trajectories. We exploit a deep metric learning algorithm to extract cell feature vectors that distinguish between instances of different biological cells.
  arXiv  Detail & Related papers  (2022-02-09T21:21:48Z)
• PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learning [109.84770951839289]
  We present PredRNN, a new recurrent network for learning visual dynamics from historical context. We show that our approach obtains highly competitive results on three standard datasets.
  arXiv  Detail & Related papers  (2021-03-17T08:28:30Z)
• Dynamic Graph: Learning Instance-aware Connectivity for Neural Networks [78.65792427542672]
  Dynamic Graph Network (DG-Net) is a complete directed acyclic graph, where the nodes represent convolutional blocks and the edges represent connection paths. Instead of using the same path of the network, DG-Net aggregates features dynamically in each node, which allows the network to have more representation ability.
  arXiv  Detail & Related papers  (2020-10-02T16:50:26Z)
• Understanding the Role of Individual Units in a Deep Neural Network [85.23117441162772]
  We present an analytic framework to systematically identify hidden units within image classification and image generation networks. First, we analyze a convolutional neural network (CNN) trained on scene classification and discover units that match a diverse set of object concepts. Second, we use a similar analytic method to analyze a generative adversarial network (GAN) model trained to generate scenes.
  arXiv  Detail & Related papers  (2020-09-10T17:59:10Z)
• Image segmentation via Cellular Automata [58.86475603234583]
  We design and train a cellular automaton that can successfully segment high-resolution images. Our smallest automaton uses less than 10,000 parameters to solve complex segmentation tasks.
  arXiv  Detail & Related papers  (2020-08-11T19:04:09Z)
• Cell Segmentation and Tracking using CNN-Based Distance Predictions and a Graph-Based Matching Strategy [0.20999222360659608]
  We present a method for the segmentation of touching cells in microscopy images. By using a novel representation of cell borders, inspired by distance maps, our method is capable to utilize not only touching cells but also close cells in the training process. This representation is notably robust to annotation errors and shows promising results for the segmentation of microscopy images containing in the training data underrepresented or not included cell types.
  arXiv  Detail & Related papers  (2020-04-03T11:55:28Z)
• Grid Cells Are Ubiquitous in Neural Networks [0.0]
  Grid cells are believed to play an important role in both spatial and non-spatial cognition tasks. Recent study observed the emergence of grid cells in an LSTM for path integration.
  arXiv  Detail & Related papers  (2020-03-07T01:40:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.