Hierarchy-Guided Multimodal Representation Learning for Taxonomic Inference

• URL: http://arxiv.org/abs/2603.25573v1
• Date: Thu, 26 Mar 2026 15:47:03 GMT
• Title: Hierarchy-Guided Multimodal Representation Learning for Taxonomic Inference
• Abstract summary: We present two end-to-end variants for hierarchy-aware multimodal learning.<n>CLiBD-HiR introduces Hierarchical Information Regularization (HiR) to shape embedding geometry across taxonomic levels.<n>CLiBD-HiR-Fuse trains a lightweight fusion predictor that supports image-only, DNA-only, or joint inference.
• Score: 17.708423679075075
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Accurate biodiversity identification from large-scale field data is a foundational problem with direct impact on ecology, conservation, and environmental monitoring. In practice, the core task is taxonomic prediction - inferring order, family, genus, or species from imperfect inputs such as specimen images, DNA barcodes, or both. Existing multimodal methods often treat taxonomy as a flat label space and therefore fail to encode the hierarchical structure of biological classification, which is critical for robustness under noise and missing modalities. We present two end-to-end variants for hierarchy-aware multimodal learning: CLiBD-HiR, which introduces Hierarchical Information Regularization (HiR) to shape embedding geometry across taxonomic levels, yielding structured and noise-robust representations; and CLiBD-HiR-Fuse, which additionally trains a lightweight fusion predictor that supports image-only, DNA-only, or joint inference and is resilient to modality corruption. Across large-scale biodiversity benchmarks, our approach improves taxonomic classification accuracy by over 14 percent compared to strong multimodal baselines, with particularly large gains under partial and corrupted DNA conditions. These results highlight that explicitly encoding biological hierarchy, together with flexible fusion, is key for practical biodiversity foundation models.

Related papers

• PaSTel: Anchoring Histology in Spatial Transcriptomics via Multi-Scale Hierarchical Bio-Prior Contrastive Pretraining [4.434048652551508]
  PaSTel is a hierarchical multimodal pretraining framework that integrates biological priors at three levels.<n>At the spot level, TF-IDF reweighting is used to identify spatially informative genes; at the functional level, curated KEGG pathways serve as anchors for encoding global biological semantics.<n>At the regional level, spatial clustering aggregates neighboring spots to model meso-scale tissue structure.
  arXiv  Detail & Related papers  (2026-08-14T22:26:17Z)
• ViroBench: Benchmarking Nucleotide Foundation Models on Viral Genomics Tasks [86.89727311669937]
  We introduce ViroBench, the first comprehensive and large-scale benchmark specifically designed for nucleotide foundation models (NFMs)<n>ViroBench evaluates models across two critical dimensions: biological understanding and latent biosecurity risk, covering 18 diverse scenarios within 4 task types.<n>ViroBench provides interpretable, diagnostic evaluations and a reproducible measurement framework for future research on viral nucleotide foundation models.
  arXiv  Detail & Related papers  (2026-05-25T03:31:46Z)
• Online Continual Learning with Dynamic Label Hierarchies [72.33335166136045]
  We introduce a new problem setting, DHOCL, where severity evolve across granularities and each sample provides supervision at a single hierarchical level.<n>In this setting, we find two fundamental issues: (i) partial supervision under mixed granularities provides only point-wise signals over an evolving path-wise hierarchy, which constrains plasticity and undermines cross-level semantic consistency.<n>We propose HALO, which adaptively combines complementary classification heads, regularized by organized learnable hierarchical prototypes, enabling rapid adaptation, hierarchical consistency, and structured knowledge consolidation as the taxonomy evolves.
  arXiv  Detail & Related papers  (2026-05-12T08:20:23Z)
• From Articles to Canopies: Knowledge-Driven Pseudo-Labelling for Tree Species Classification using LLM Experts [0.0]
  This paper presents a biologically informed, semi-supervised deep learning method that integrates multi-sensor Earth observation data with expert, ecological knowledge.<n>The approach relies on biologically inspired pseudo-labelling over a precomputed canopy graph, yielding accurate classification at low training cost.<n> Experiments on a real-world forest dataset demonstrate 5.6% improvement over the best reference method.
  arXiv  Detail & Related papers  (2026-04-17T14:52:02Z)
• BarcodeMamba+: Advancing State-Space Models for Fungal Biodiversity Research [19.401485543915452]
  We introduce a foundation model for fungal barcode classification built on a powerful and efficient state-space model architecture.<n>We demonstrate this is substantially more effective than traditional fully-supervised methods in this data-sparse environment.<n>Our work provides a powerful new tool for genomics-based biodiversity research.
  arXiv  Detail & Related papers  (2025-12-17T19:56:03Z)
• scMRDR: A scalable and flexible framework for unpaired single-cell multi-omics data integration [53.683726781791385]
  We introduce a scalable and flexible generative framework called single-cell Multi-omics Regularized Disentangled Representations (scMRDR) for unpaired multi-omics integration.<n>Our method achieves excellent performance on benchmark datasets in terms of batch correction, modality alignment, and biological signal preservation.
  arXiv  Detail & Related papers  (2025-10-28T21:28:39Z)
• Hyperbolic Multimodal Representation Learning for Biological Taxonomies [23.639218053531962]
  Taxonomic classification in biodiversity research involves organizing biological specimens into structured hierarchies based on evidence.<n>We investigate whether hyperbolic networks can provide a better embedding space for such hierarchical models.<n>Our method embeds multimodal inputs into a shared hyperbolic space using contrastive and a novel stacked entailment-based objective.
  arXiv  Detail & Related papers  (2025-08-22T18:52:50Z)
• BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learning [60.80381372245902]
  We find emergent behaviors in biological vision models via large-scale contrastive vision-language training.<n>We train BioCLIP 2 on TreeOfLife-200M to distinguish different species.<n>We identify emergent properties in the learned embedding space of BioCLIP 2.
  arXiv  Detail & Related papers  (2025-05-29T17:48:20Z)
• CrypticBio: A Large Multimodal Dataset for Visually Confusing Biodiversity [3.73232466691291]
  We present CrypticBio, the largest publicly available dataset of visually confusing species.<n>Criticized from real-world trends in species misidentification among community annotators of iNaturalist, CrypticBio contains 52K unique cryptic groups spanning 67K species.
  arXiv  Detail & Related papers  (2025-05-16T14:35:56Z)
• CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scale [21.995678534789615]
  We use contrastive learning to align images, barcode DNA, and text-based representations of taxonomic labels in a unified embedding space.<n>Our method surpasses previous single-modality approaches in accuracy by over 8% on zero-shot learning tasks.
  arXiv  Detail & Related papers  (2024-05-27T17:57:48Z)
• PhyloGFN: Phylogenetic inference with generative flow networks [57.104166650526416]
  We introduce the framework of generative flow networks (GFlowNets) to tackle two core problems in phylogenetics: parsimony-based and phylogenetic inference. Because GFlowNets are well-suited for sampling complex structures, they are a natural choice for exploring and sampling from the multimodal posterior distribution over tree topologies. We demonstrate that our amortized posterior sampler, PhyloGFN, produces diverse and high-quality evolutionary hypotheses on real benchmark datasets.
  arXiv  Detail & Related papers  (2023-10-12T23:46:08Z)
• G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for Biomarker Identification and Disease Classification [49.53651166356737]
  We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers. We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
  arXiv  Detail & Related papers  (2021-01-27T19:28:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.