Benchmarking Vision-Language Models for Microscopic Plant Image Understanding

• URL: http://arxiv.org/abs/2606.22497v2
• Date: Wed, 24 Jun 2026 04:57:25 GMT
• Title: Benchmarking Vision-Language Models for Microscopic Plant Image Understanding
• Abstract summary: We present PlantMicro, a benchmark for evaluating vision-language models (VLMs) in microscopic plant imagery.<n>We design a set of complementary tasks that capture different facets of microscopic image understanding.<n>Experiments show that current VLMs struggle with fine-grained recognition and biologically grounded reasoning.
• Score: 34.461133608619015
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Microscopic imaging provides essential visual evidence for studying plant biology and pathology at the cellular and subcellular levels. However, existing benchmarks on vision-language models primarily focus on macroscopic plant imagery, while the microscopic domain remains underexplored. To address this gap, we present PlantMicro, a comprehensive benchmark for evaluating vision-language models (VLMs) in microscopic plant imagery. PlantMicro integrates more than 5,000 images collected across diverse hosts, biological domains, and imaging modalities. Building on this diversity, we design a set of complementary tasks that capture different facets of microscopic image understanding. To support these tasks, we construct over 9,000 VQA pairs that systematically evaluate the capabilities of VLMs. Experiments on PlantMicro show that current VLMs struggle with fine-grained recognition and biologically grounded reasoning. For example, GPT-5 achieves 34.93% accuracy on the pathogen classification task, which is only modestly above the random-guessing baseline. The results highlight a significant gap in current VLMs' ability to comprehend plant microscopic images. PlantMicro provides a standardized foundation for advancing VLMs toward reliable and comprehensive microscopy-level plant understanding.

Related papers

• scMIR: a vision-language foundation model for single-cell light microscopy image representation [9.935076530517575]
  We propose scMIR, a vision-language foundation model for single-cell light microscopy image representation.<n> scMIR combines self-supervised image reconstruction with text-guided cross-modal alignment.<n> scMIR shows a strong generalization ability across various tasks without requiring task-specific fine-tuning.
  arXiv  Detail & Related papers  (2026-07-21T01:59:07Z)
• MMBU: A Massive Multi-modal Biomedical Understanding Benchmark to Probe the Perception Capabilities of Vision-Language Models [83.50100003741628]
  Vision and language models (VLMs) hold immense promise to transform biomedical imaging.<n>We introduce the Massive Multimodal Biomedical Understanding (MMBU) benchmark.<n>It is the largest vision and language benchmark to date, covering 35 submodalities with rich structured metadata.
  arXiv  Detail & Related papers  (2026-06-04T20:24:47Z)
• MAD: Microenvironment-Aware Distillation -- A Pretraining Strategy for Virtual Spatial Omics from Microscopy [6.991792373060689]
  We introduce MAD (microenvironment-aware distillation), a pretraining strategy that learns cell-centric embeddings.<n> MAD achieves state-of-the-art prediction performance on downstream tasks including cell subtyping, transcriptomic prediction, and bioinformatic inference.
  arXiv  Detail & Related papers  (2026-03-11T22:06:20Z)
• From Macro to Micro: Benchmarking Microscopic Spatial Intelligence on Molecules via Vision-Language Models [49.40724953627119]
  This paper introduces the concept of Microscopic Spatial Intelligence (MiSI), the capability to perceive and reason about the spatial relationships of invisible microscopic entities.<n>To assess the potential of Vision-Language Models (VLMs) in this domain, we propose a systematic benchmark framework MiSI-Bench.<n>This framework features over 163,000 question-answer pairs and 587,000 images derived from approximately 4,000 molecular structures.
  arXiv  Detail & Related papers  (2025-12-11T18:00:21Z)
• Disentangled representations of microscopy images [0.9849635250118911]
  This work proposes a Disentangled Representation Learning (DRL) methodology to enhance model interpretability for microscopy image classification.<n>We show how a DRL framework, based on transferring a representation learnt from synthetic data, can provide a good trade-off between accuracy and interpretability in this domain.
  arXiv  Detail & Related papers  (2025-06-25T17:44:37Z)
• Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biology [2.7280901660033643]
  This work explores the scaling properties of weakly supervised classifiers and self-supervised masked autoencoders (MAEs) Our results show that ViT-based MAEs outperform weakly supervised classifiers on a variety of tasks, achieving as much as a 11.5% relative improvement when recalling known biological relationships curated from public databases. We develop a new channel-agnostic MAE architecture (CA-MAE) that allows for inputting images of different numbers and orders of channels at inference time.
  arXiv  Detail & Related papers  (2024-04-16T02:42:06Z)
• DualFocus: Integrating Macro and Micro Perspectives in Multi-modal Large Language Models [85.4852517178828]
  We present DualFocus, a framework for integrating macro and micro perspectives within multi-modal large language models (MLLMs) We demonstrate DualFocus's superiority in balancing detailed examination with holistic insight, significantly reducing hallucination instances in MLLMs.
  arXiv  Detail & Related papers  (2024-02-22T18:26:02Z)
• The TYC Dataset for Understanding Instance-Level Semantics and Motions of Cells in Microstructures [29.29348484938194]
  trapped yeast cell (TYC) dataset is a novel dataset for understanding instance-level semantics and motions of cells in microstructures. TYC offers ten times more instance annotations than the previously largest dataset, including cells and microstructures.
  arXiv  Detail & Related papers  (2023-08-23T13:10:33Z)
• Application of the YOLOv5 Model for the Detection of Microobjects in the Marine Environment [101.18253437732933]
  The efficiency of using the YOLOV5 machine learning model for solving the problem of automatic de-tection and recognition of micro-objects in the marine environment is studied.
  arXiv  Detail & Related papers  (2022-11-28T10:58:50Z)
• Towards an Automatic Analysis of CHO-K1 Suspension Growth in Microfluidic Single-cell Cultivation [63.94623495501023]
  We propose a novel Machine Learning architecture, which allows us to infuse a neural deep network with human-powered abstraction on the level of data. Specifically, we train a generative model simultaneously on natural and synthetic data, so that it learns a shared representation, from which a target variable, such as the cell count, can be reliably estimated.
  arXiv  Detail & Related papers  (2020-10-20T08:36:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.