Paleoinspired Vision: From Exploring Colour Vision Evolution to Inspiring Camera Design

• URL: http://arxiv.org/abs/2412.19439v1
• Date: Fri, 27 Dec 2024 04:07:52 GMT
• Title: Paleoinspired Vision: From Exploring Colour Vision Evolution to Inspiring Camera Design
• Authors: Junjie Zhang, Zhimin Zong, Lin Gu, Shenghan Su, Ziteng Cui, Yan Pu, Zirui Chen, Jing Lu, Daisuke Kojima, Tatsuya Harada, Ruogu Fang,
• Abstract summary: We present a model of visual transduction in the retina, introducing a novel opsin layer. We quantify evolutionary pressures by measuring machine vision recognition accuracy on colour images shaped by specific opsins. We develop an evolutionary conservation optimisation algorithm to reconstruct the spectral sensitivity of opsins.
• Score: 44.353407126161514
• License:
• Abstract: The evolution of colour vision is captivating, as it reveals the adaptive strategies of extinct species while simultaneously inspiring innovations in modern imaging technology. In this study, we present a simplified model of visual transduction in the retina, introducing a novel opsin layer. We quantify evolutionary pressures by measuring machine vision recognition accuracy on colour images shaped by specific opsins. Building on this, we develop an evolutionary conservation optimisation algorithm to reconstruct the spectral sensitivity of opsins, enabling mutation-driven adaptations to to more effectively spot fruits or predators. This model condenses millions of years of evolution within seconds on GPU, providing an experimental framework to test long-standing hypotheses in evolutionary biology , such as vision of early mammals, primate trichromacy from gene duplication, retention of colour blindness, blue-shift of fish rod and multiple rod opsins with bioluminescence. Moreover, the model enables speculative explorations of hypothetical species, such as organisms with eyes adapted to the conditions on Mars. Our findings suggest a minimalist yet effective approach to task-specific camera filter design, optimising the spectral response function to meet application-driven demands. The code will be made publicly available upon acceptance.

Related papers

• What if Eye...? Computationally Recreating Vision Evolution [13.841720704094115]
  Vision systems in nature show remarkable diversity, from simple light-sensitive patches to complex camera eyes with lenses. We show how environmental demands drive three fundamental aspects of visual evolution through an artificial evolution framework. Our work introduces a novel paradigm that illuminates evolutionary principles shaping vision by creating targeted single-player games.
  arXiv  Detail & Related papers  (2025-01-25T00:29:24Z)
• A Computational Framework for Modeling Emergence of Color Vision in the Human Brain [9.10623460958915]
  It is a mystery how the brain decodes color vision purely from the optic nerve signals it receives. We introduce a computational framework for modeling this emergence of human color vision by simulating both the eye and the cortex.
  arXiv  Detail & Related papers  (2024-08-29T21:27:06Z)
• Hierarchical Conditioning of Diffusion Models Using Tree-of-Life for Studying Species Evolution [19.899467048643363]
  We introduce Phylo-Diffusion, a framework for conditioning diffusion models with phylogenetic knowledge represented by HIERarchical Embeddings (HIER-Embeds) We also propose two new experiments for perturbing the embedding space of Phylo-Diffusion: trait masking and trait swapping. Our work also opens a new chapter of research in evolutionary biology by using generative models to visualize evolutionary changes directly from images.
  arXiv  Detail & Related papers  (2024-07-31T21:06:14Z)
• Spatial super-resolution in nanosensing with blinking emitters [79.16635054977068]
  We propose a method of spatial resolution enhancement in metrology with blinking fluorescent nanosensors. We believe that blinking fluorescent sensing agents being complemented with the developed image analysis technique could be utilized routinely in the life science sector.
  arXiv  Detail & Related papers  (2024-02-27T10:38:05Z)
• Neural Echos: Depthwise Convolutional Filters Replicate Biological Receptive Fields [56.69755544814834]
  We present evidence suggesting that depthwise convolutional kernels are effectively replicating the biological receptive fields observed in the mammalian retina. We propose a scheme that draws inspiration from the biological receptive fields.
  arXiv  Detail & Related papers  (2024-01-18T18:06:22Z)
• DreamCreature: Crafting Photorealistic Virtual Creatures from Imagination [140.1641573781066]
  We introduce a novel task, Virtual Creatures Generation: Given a set of unlabeled images of the target concepts, we aim to train a T2I model capable of creating new, hybrid concepts. We propose a new method called DreamCreature, which identifies and extracts the underlying sub-concepts. The T2I thus adapts to generate novel concepts with faithful structures and photorealistic appearance.
  arXiv  Detail & Related papers  (2023-11-27T01:24:31Z)
• Discovering Novel Biological Traits From Images Using Phylogeny-Guided Neural Networks [10.372001949268636]
  We present a novel approach for discovering evolutionary traits directly from images without relying on trait labels. Our proposed approach, Phylo-NN, encodes the image of an organism into a sequence of quantized feature vectors. We demonstrate the effectiveness of our approach in producing biologically meaningful results in a number of downstream tasks.
  arXiv  Detail & Related papers  (2023-06-05T20:22:05Z)
• Adapting Brain-Like Neural Networks for Modeling Cortical Visual Prostheses [68.96380145211093]
  Cortical prostheses are devices implanted in the visual cortex that attempt to restore lost vision by electrically stimulating neurons. Currently, the vision provided by these devices is limited, and accurately predicting the visual percepts resulting from stimulation is an open challenge. We propose to address this challenge by utilizing 'brain-like' convolutional neural networks (CNNs), which have emerged as promising models of the visual system.
  arXiv  Detail & Related papers  (2022-09-27T17:33:19Z)
• Modeling the Evolution of Retina Neural Network [0.0]
  retinal circuitry shows many similar structures across a broad array of species. We design a method using genetic algorithm that leads to architectures whose functions are similar to biological retina. We discuss how our framework can come into goal-driven search and sustainable enhancement of neural network models in machine learning.
  arXiv  Detail & Related papers  (2020-11-24T23:57:54Z)
• Fooling the primate brain with minimal, targeted image manipulation [67.78919304747498]
  We propose an array of methods for creating minimal, targeted image perturbations that lead to changes in both neuronal activity and perception as reflected in behavior. Our work shares the same goal with adversarial attack, namely the manipulation of images with minimal, targeted noise that leads ANN models to misclassify the images.
  arXiv  Detail & Related papers  (2020-11-11T08:30:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.