Saliency map using features derived from spiking neural networks of primate visual cortex

• URL: http://arxiv.org/abs/2205.01159v1
• Date: Mon, 2 May 2022 18:52:39 GMT
• Title: Saliency map using features derived from spiking neural networks of primate visual cortex
• Authors: Reza Hojjaty Saeedy, Richard A. Messner
• Abstract summary: We propose a framework inspired by biological vision systems to produce saliency maps of digital images. To model the connectivity between these areas we use the CARLsim library which is a spiking neural network(SNN) simulator. The spikes generated by CARLsim then serve as extracted features and input to our saliency detection algorithm.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: We propose a framework inspired by biological vision systems to produce saliency maps of digital images. Well-known computational models for receptive fields of areas in the visual cortex that are specialized for color and orientation perception are used. To model the connectivity between these areas we use the CARLsim library which is a spiking neural network(SNN) simulator. The spikes generated by CARLsim, then serve as extracted features and input to our saliency detection algorithm. This new method of saliency detection is described and applied to benchmark images.

Related papers

• GNN-LoFI: a Novel Graph Neural Network through Localized Feature-based Histogram Intersection [51.608147732998994]
  Graph neural networks are increasingly becoming the framework of choice for graph-based machine learning. We propose a new graph neural network architecture that substitutes classical message passing with an analysis of the local distribution of node features.
  arXiv  Detail & Related papers  (2024-01-17T13:04:23Z)
• FuNNscope: Visual microscope for interactively exploring the loss landscape of fully connected neural networks [77.34726150561087]
  We show how to explore high-dimensional landscape characteristics of neural networks. We generalize observations on small neural networks to more complex systems. An interactive dashboard opens up a number of possible application networks.
  arXiv  Detail & Related papers  (2022-04-09T16:41:53Z)
• A Deep Neural Framework for Image Caption Generation Using GRU-Based Attention Mechanism [5.855671062331371]
  This study aims to develop a system that uses a pre-trained convolutional neural network (CNN) to extract features from an image, integrates the features with an attention mechanism, and creates captions using a recurrent neural network (RNN) On the MSCOCO dataset, the experimental results achieve competitive performance against state-of-the-art approaches.
  arXiv  Detail & Related papers  (2022-03-03T09:47:59Z)
• Learning Hierarchical Graph Representation for Image Manipulation Detection [50.04902159383709]
  The objective of image manipulation detection is to identify and locate the manipulated regions in the images. Recent approaches mostly adopt the sophisticated Convolutional Neural Networks (CNNs) to capture the tampering artifacts left in the images. We propose a hierarchical Graph Convolutional Network (HGCN-Net), which consists of two parallel branches.
  arXiv  Detail & Related papers  (2022-01-15T01:54:25Z)
• Segmentation of Roads in Satellite Images using specially modified U-Net CNNs [0.0]
  The aim of this paper is to build an image classifier for satellite images of urban scenes that identifies the portions of the images in which a road is located. Unlike conventional computer vision algorithms, convolutional neural networks (CNNs) provide accurate and reliable results on this task.
  arXiv  Detail & Related papers  (2021-09-29T19:08:32Z)
• VisGraphNet: a complex network interpretation of convolutional neural features [6.50413414010073]
  We propose and investigate the use of visibility graphs to model the feature map of a neural network. The work is motivated by an alternative viewpoint provided by these graphs over the original data.
  arXiv  Detail & Related papers  (2021-08-27T20:21:04Z)
• CAMERAS: Enhanced Resolution And Sanity preserving Class Activation Mapping for image saliency [61.40511574314069]
  Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input. We propose CAMERAS, a technique to compute high-fidelity backpropagation saliency maps without requiring any external priors.
  arXiv  Detail & Related papers  (2021-06-20T08:20:56Z)
• Compositional Sketch Search [91.84489055347585]
  We present an algorithm for searching image collections using free-hand sketches. We exploit drawings as a concise and intuitive representation for specifying entire scene compositions.
  arXiv  Detail & Related papers  (2021-06-15T09:38:09Z)
• A new approach to descriptors generation for image retrieval by analyzing activations of deep neural network layers [43.77224853200986]
  We consider the problem of descriptors construction for the task of content-based image retrieval using deep neural networks. It is known that the total number of neurons in the convolutional part of the network is large and the majority of them have little influence on the final classification decision. We propose a novel algorithm that allows us to extract the most significant neuron activations and utilize this information to construct effective descriptors.
  arXiv  Detail & Related papers  (2020-07-13T18:53:10Z)
• Learning Local Complex Features using Randomized Neural Networks for Texture Analysis [0.1474723404975345]
  We present a new approach that combines a learning technique and the Complex Network (CN) theory for texture analysis. This method takes advantage of the representation capacity of CN to model a texture image as a directed network. This neural network has a single hidden layer and uses a fast learning algorithm, which is able to learn local CN patterns for texture characterization.
  arXiv  Detail & Related papers  (2020-07-10T23:18:01Z)
• Ventral-Dorsal Neural Networks: Object Detection via Selective Attention [51.79577908317031]
  We propose a new framework called Ventral-Dorsal Networks (VDNets) Inspired by the structure of the human visual system, we propose the integration of a "Ventral Network" and a "Dorsal Network" Our experimental results reveal that the proposed method outperforms state-of-the-art object detection approaches.
  arXiv  Detail & Related papers  (2020-05-15T23:57:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.