Morphology-Aware Multimodal Representation Learning for Insect Phylogenetic Reconstruction

• URL: http://arxiv.org/abs/2606.22077v1
• Date: Sat, 20 Jun 2026 14:51:39 GMT
• Title: Morphology-Aware Multimodal Representation Learning for Insect Phylogenetic Reconstruction
• Abstract summary: Morphological traits provide important evidence for phylogenetic reconstruction and evolutionary relationship analysis.<n>Recent image-based approaches have introduced deep learning to derive morphological features from specimen images.<n>This study proposes a morphology-aware multimodal alignment framework for insect phylogenetic reconstruction.
• Score: 22.765980617335234
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Morphological traits provide important evidence for phylogenetic reconstruction and evolutionary relationship analysis. Recent image-based approaches have introduced deep learning, particularly convolutional models, to derive morphological features from specimen images, but these methods generally rely on single-modality visual representations and do not explicitly incorporate morphological semantics. This study proposes a morphology-aware multimodal alignment framework for insect phylogenetic reconstruction. The framework combines specimen images with curated morphological descriptions by adapting a vision transformer through parameter-efficient fine-tuning and supervised contrastive learning, followed by image-text alignment in a shared latent space. The learned image embeddings are then used as continuous traits for Bayesian phylogenetic reconstruction. On the public Rove-Tree-11 dataset, comparative and ablation experiments across multiple visual backbones and feature adaptation strategies demonstrate that multimodal alignment improves topological agreement with the reference phylogeny. The results indicate that the proposed framework can derive morphology-aware visual traits for computational phylogenetic reconstruction.

Related papers

• PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Images [51.428093790826814]
  We propose pathology Autorgressive modeling (PathAR) to factorize structure and appearance for modality-label-conditioned pathology generation.<n>PathAR stabilizes morphology under heterogeneous modality-specific appearances and enables spatially aligned image-mask pair generation.
  arXiv  Detail & Related papers  (2026-06-01T01:43:48Z)
• Deep-learning-based pan-phenomic data reveals the explosive evolution of avian visual disparity [8.871465190908003]
  This study uses deep learning techniques to explore avian morphological evolution.<n>We show that the high-dimensional embedding space encodes phenotypic convergence.<n>We also demonstrate that hierarchical semantic structures emerged in the high-dimensional embedding space despite being trained on flat labels.
  arXiv  Detail & Related papers  (2026-02-03T18:32:15Z)
• Causal integration of chemical structures improves representations of microscopy images for morphological profiling [25.027684911103897]
  We introduce a representation learning framework, MICON, that models chemical compounds as treatments that induce counterfactual transformations of cell phenotypes.<n>We demonstrate that incorporating chemical compound information into the learning process provides consistent improvements in our evaluation setting.<n>Our findings point to a new direction for representation learning in morphological profiling, suggesting that methods should explicitly account for the multimodal nature of microscopy screening data.
  arXiv  Detail & Related papers  (2025-04-13T12:27:21Z)
• Neural Echos: Depthwise Convolutional Filters Replicate Biological Receptive Fields [56.69755544814834]
  We present evidence suggesting that depthwise convolutional kernels are effectively replicating the biological receptive fields observed in the mammalian retina. We propose a scheme that draws inspiration from the biological receptive fields.
  arXiv  Detail & Related papers  (2024-01-18T18:06:22Z)
• Bayesian Unsupervised Disentanglement of Anatomy and Geometry for Deep Groupwise Image Registration [59.062085785106234]
  This article presents a general Bayesian learning framework for multi-modal groupwise image registration.<n>We propose a novel hierarchical variational auto-encoding architecture to realise the inference procedure of the latent variables.<n>Experiments were conducted to validate the proposed framework, including four different datasets from cardiac, brain, and abdominal medical images.
  arXiv  Detail & Related papers  (2024-01-04T08:46:39Z)
• Unsupervised ensemble-based phenotyping helps enhance the discoverability of genes related to heart morphology [57.25098075813054]
  We propose a new framework for gene discovery entitled Un Phenotype Ensembles. It builds a redundant yet highly expressive representation by pooling a set of phenotypes learned in an unsupervised manner. These phenotypes are then analyzed via (GWAS), retaining only highly confident and stable associations.
  arXiv  Detail & Related papers  (2023-01-07T18:36:44Z)
• A Multi-parameter Persistence Framework for Mathematical Morphology [2.1485350418225244]
  We look at morphological operations through the lens of persistent homology. persistent homology is a tool at the heart of the field of topological data analysis.
  arXiv  Detail & Related papers  (2021-03-24T06:46:00Z)
• A Novel Bio-Inspired Texture Descriptor based on Biodiversity and Taxonomic Measures [81.08571247838206]
  We propose a novel approach capable of quantifying a complex system of diverse patterns through species diversity and richness and taxonomic distinctiveness. The proposed approach considers each image channel as a species ecosystem and computes species diversity and richness measures as well as taxonomic measures to describe the texture.
  arXiv  Detail & Related papers  (2021-02-13T20:14:14Z)
• Orientation-Disentangled Unsupervised Representation Learning for Computational Pathology [6.468635277309852]
  We propose to extend the Variational Auto-Encoder framework by leveraging the group structure of rotation-equivariant convolutional networks. We show that the trained models efficiently disentangle the inherent orientation information of single-cell images.
  arXiv  Detail & Related papers  (2020-08-26T16:57:45Z)
• Pathological Retinal Region Segmentation From OCT Images Using Geometric Relation Based Augmentation [84.7571086566595]
  We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape. The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
  arXiv  Detail & Related papers  (2020-03-31T11:50:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.