Computer vision-based estimation of invertebrate biomass

• URL: http://arxiv.org/abs/2603.06362v1
• Date: Fri, 06 Mar 2026 15:12:40 GMT
• Title: Computer vision-based estimation of invertebrate biomass
• Abstract summary: We present two approaches for dry mass estimation that do not require additional manual effort apart from imaging the specimens.<n>We propose using area and sinking speed as predictors.<n>We show that our methods can estimate specimen dry mass even with complex and visually diverse specimen morphologies.
• Score: 1.9233638471548928
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The ability to estimate invertebrate biomass using only images could help scaling up quantitative biodiversity monitoring efforts. Computer vision-based methods have the potential to omit the manual, time-consuming, and destructive process of dry weighing specimens. We present two approaches for dry mass estimation that do not require additional manual effort apart from imaging the specimens: fitting a linear model with novel predictors, automatically calculated by an imaging device, and training a family of end-to-end deep neural networks for the task, using single-view, multi-view, and metadata-aware architectures. We propose using area and sinking speed as predictors. These can be calculated with BIODISCOVER, which is a dual-camera system that captures image sequences of specimens sinking in an ethanol column. For this study, we collected a large dataset of dry mass measurement and image sequence pairs to train and evaluate models. We show that our methods can estimate specimen dry mass even with complex and visually diverse specimen morphologies. Combined with automatic taxonomic classification, our approach is an accurate method for group-level dry mass estimation, with a median percentage error of 10-20% for individuals. We highlight the importance of choosing appropriate evaluation metrics, and encourage using both percentage errors and absolute errors as metrics, because they measure different properties. We also explore different optimization losses, data augmentation methods, and model architectures for training deep-learning models.

Related papers

• The microscope is the mask: privileged views and labels from a cryo-ET forward model [3.4415392202192137]
  We explore the use of simulated data for training a model for protein annotation in crowded cryo-electron tomography volumes.<n>We leverage the corruptions imposed by the forward model to generate domain-specific augmented paired views of the exact same scene.<n>We show that CARNIVAL outperforms a state-of-the-art model trained using a contrastive objective on simulated data.
  arXiv  Detail & Related papers  (2026-09-03T18:00:18Z)
• WildProp: Visual Estimation of Wildlife Body Proportions at Scale [17.380434618414988]
  We present WildProp, a training-free framework that estimates wildlife body proportion distributions directly from large-scale, unconstrained image repositories.<n>We show that pose-aware retrieval is critical for stable estimation, while robust aggregation mitigates keypoint and pose noise.<n>Our results indicate that carefully curated 2D correspondences over web-scale imagery can provide scalable morphometric proxies for comparative and subgroup analyses.
  arXiv  Detail & Related papers  (2026-06-30T04:38:44Z)
• MaskTerial: A Foundation Model for Automated 2D Material Flake Detection [48.73213960205105]
  We present a deep learning model, called MaskTerial, that uses an instance segmentation network to reliably identify 2D material flakes.<n>The model is extensively pre-trained using a synthetic data generator, that generates realistic microscopy images from unlabeled data.<n>We demonstrate significant improvements over existing techniques in the detection of low-contrast materials such as hexagonal boron nitride.
  arXiv  Detail & Related papers  (2024-12-12T15:01:39Z)
• Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems [80.62854148838359]
  Eye image segmentation is a critical step in eye tracking that has great influence over the final gaze estimate. We use dimensionality-reduction techniques to measure the overlap between the target eye images and synthetic training data. Our methods result in robust, improved performance when tackling the discrepancy between simulation and real-world data samples.
  arXiv  Detail & Related papers  (2024-03-23T22:32:06Z)
• Geometric Data Augmentations to Mitigate Distribution Shifts in Pollen Classification from Microscopic Images [4.545340728210854]
  We leverage the domain knowledge that geometric features are highly important for accurate pollen identification. We introduce two novel geometric image augmentation techniques to significantly narrow the accuracy gap between the model performance on the train and test datasets.
  arXiv  Detail & Related papers  (2023-11-18T10:35:18Z)
• Optimizations of Autoencoders for Analysis and Classification of Microscopic In Situ Hybridization Images [68.8204255655161]
  We propose a deep-learning framework to detect and classify areas of microscopic images with similar levels of gene expression. The data we analyze requires an unsupervised learning model for which we employ a type of Artificial Neural Network - Deep Learning Autoencoders.
  arXiv  Detail & Related papers  (2023-04-19T13:45:28Z)
• Efficient Unsupervised Learning for Plankton Images [12.447149371717]
  Monitoring plankton populations in situ is fundamental to preserve the aquatic ecosystem. The adoption of machine learning algorithms to classify such data may be affected by the significant cost of manual annotation. We propose an efficient unsupervised learning pipeline to provide accurate classification of plankton microorganisms.
  arXiv  Detail & Related papers  (2022-09-14T15:33:16Z)
• Generative models-based data labeling for deep networks regression: application to seed maturity estimation from UAV multispectral images [3.6868861317674524]
  Monitoring seed maturity is an increasing challenge in agriculture due to climate change and more restrictive practices. Traditional methods are based on limited sampling in the field and analysis in laboratory. We propose a method for estimating parsley seed maturity using multispectral UAV imagery, with a new approach for automatic data labeling.
  arXiv  Detail & Related papers  (2022-08-09T09:06:51Z)
• Towards an Automatic Analysis of CHO-K1 Suspension Growth in Microfluidic Single-cell Cultivation [63.94623495501023]
  We propose a novel Machine Learning architecture, which allows us to infuse a neural deep network with human-powered abstraction on the level of data. Specifically, we train a generative model simultaneously on natural and synthetic data, so that it learns a shared representation, from which a target variable, such as the cell count, can be reliably estimated.
  arXiv  Detail & Related papers  (2020-10-20T08:36:51Z)
• Deep Low-Shot Learning for Biological Image Classification and Visualization from Limited Training Samples [52.549928980694695]
  In situ hybridization (ISH) gene expression pattern images from the same developmental stage are compared. labeling training data with precise stages is very time-consuming even for biologists. We propose a deep two-step low-shot learning framework to accurately classify ISH images using limited training images.
  arXiv  Detail & Related papers  (2020-10-20T06:06:06Z)
• Automatic image-based identification and biomass estimation of invertebrates [70.08255822611812]
  Time-consuming sorting and identification of taxa pose strong limitations on how many insect samples can be processed. We propose to replace the standard manual approach of human expert-based sorting and identification with an automatic image-based technology. We use state-of-the-art Resnet-50 and InceptionV3 CNNs for the classification task.
  arXiv  Detail & Related papers  (2020-02-05T21:38:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.