Self-Supervised Learning of Plant Image Representations

• URL: http://arxiv.org/abs/2604.27538v1
• Date: Thu, 30 Apr 2026 07:41:49 GMT
• Title: Self-Supervised Learning of Plant Image Representations
• Abstract summary: Self-supervised learning offers a scalable alternative to supervised learning.<n>We show that augmentations in SSL pipelines are detrimental in the context of plant images.<n>We identify alternative transformations, including affine and posterization, that are better suited to this domain.
• Score: 3.958317527488534
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Automated plant recognition plays a crucial role in biodiversity monitoring and conservation, yet current approaches rely heavily on supervised learning, which is limited by the availability of expert-labeled data. Self-supervised learning (SSL) offers a scalable alternative, but existing methods and training protocols are largely designed for coarse-grained visual tasks and may not transfer well to fine-grained domains such as plant species recognition. In this work, we investigate SSL for plant image representation learning. We show that commonly used augmentations in SSL pipelines - such as Gaussian blur, grayscale conversion, and solarization - are detrimental in the context of plant images, as they remove subtle discriminative cues essential for fine-grained recognition. We instead identify alternative transformations, including affine and posterization, that are better suited to this domain. We further demonstrate that training SimDINOv2 on the iNaturalist 2021 Plantae subset yields significantly stronger representations than training on ImageNet-1K, highlighting the importance of domain-specific data for SSL. Our findings are consistent across both ViT-Base and ViT-Large architectures. Moreover, our models achieve competitive performance and sometimes outperform strong supervised baselines Pl@ntCLEF and BioCLIP on downstream plant recognition tasks in few-shot settings. Overall, our results highlight the critical importance of domain-adapted augmentation strategies and dataset selection in self-supervised learning, and provide practical guidelines for building scalable models for biodiversity monitoring.

Related papers

• Domain-Specific Self-Supervised Representation Learning for Retinal Fundus Classification [0.0]
  Self-supervised learning has emerged as a promising alternative for learning useful representations from unlabeled data.<n>In this work, we investigate two SSL frameworks, SimSiam and SimCLR, for retinal disease classification from fundus images.<n>We show that tailoring augmentation strategies to the characteristics of retinal images plays a critical role in improving performance.
  arXiv  Detail & Related papers  (2026-08-27T06:44:04Z)
• Scale-Aware Self-Supervised Learning for Segmentation of Small and Sparse Structures [8.202335520689024]
  Self-supervised learning has emerged as a powerful strategy for representation learning under limited annotation regimes.<n>In this work, we propose a scale-aware SSL adaptation that integrates small-window cropping into the augmentation pipeline.<n>We evaluate this approach across two domains with markedly different data modalities: seismic imaging and neuroimaging.
  arXiv  Detail & Related papers  (2026-01-26T15:58:04Z)
• BotaCLIP: Contrastive Learning for Botany-Aware Representation of Earth Observation Data [5.63123057685834]
  BotaCLIP is a lightweight framework for adapting a pre-trained foundation model to inject domain-specific knowledge.<n>We show how BotaCLIP can inject expert knowledge into data-scarce settings, enabling frugal representation learning.
  arXiv  Detail & Related papers  (2025-11-26T09:19:06Z)
• Rethinking Plant Disease Diagnosis: Bridging the Academic-Practical Gap with Vision Transformers and Zero-Shot Learning [2.3536628395905974]
  We investigate whether attention-based architectures and zero-shot learning approaches can bridge the gap between curated academic datasets and real-world agricultural conditions.<n>We evaluate three model categories: Convolutional Neural Networks (CNNs), Vision Transformers, and Contrastive Language-Image Pre-training (CLIP)-based zero-shot models.
  arXiv  Detail & Related papers  (2025-11-24T11:08:01Z)
• A self-supervised framework for learning whole slide representations [52.774822784847565]
  We present Slide Pre-trained Transformers (SPT) for gigapixel-scale self-supervision of whole slide images. We benchmark SPT visual representations on five diagnostic tasks across three biomedical microscopy datasets.
  arXiv  Detail & Related papers  (2024-02-09T05:05:28Z)
• Learned representation-guided diffusion models for large-image generation [58.192263311786824]
  We introduce a novel approach that trains diffusion models conditioned on embeddings from self-supervised learning (SSL) Our diffusion models successfully project these features back to high-quality histopathology and remote sensing images. Augmenting real data by generating variations of real images improves downstream accuracy for patch-level and larger, image-scale classification tasks.
  arXiv  Detail & Related papers  (2023-12-12T14:45:45Z)
• In-Domain Self-Supervised Learning Improves Remote Sensing Image Scene Classification [5.323049242720532]
  Self-supervised learning has emerged as a promising approach for remote sensing image classification. We present a study of different self-supervised pre-training strategies and evaluate their effect across 14 downstream datasets.
  arXiv  Detail & Related papers  (2023-07-04T10:57:52Z)
• Deep face recognition with clustering based domain adaptation [57.29464116557734]
  We propose a new clustering-based domain adaptation method designed for face recognition task in which the source and target domain do not share any classes. Our method effectively learns the discriminative target feature by aligning the feature domain globally, and, at the meantime, distinguishing the target clusters locally.
  arXiv  Detail & Related papers  (2022-05-27T12:29:11Z)
• Domain-Aware Continual Zero-Shot Learning [52.349332188116975]
  Domain-Aware Continual Zero-Shot Learning (DACZSL) is a task to recognize images of unseen categories in continuously changing domains. We propose a Domain-Invariant Network (DIN) to learn factorized features for shifting domains and improved textual representation for unseen classes. Our results show that DIN significantly outperforms existing baselines by over 5% in harmonic accuracy and over 1% in backward transfer.
  arXiv  Detail & Related papers  (2021-12-24T08:17:18Z)
• Improving Self-supervised Learning with Hardness-aware Dynamic Curriculum Learning: An Application to Digital Pathology [2.2742357407157847]
  Self-supervised learning (SSL) has recently shown tremendous potential to learn generic visual representations useful for many image analysis tasks. The existing SSL methods fail to generalize to downstream tasks when the number of labeled training instances is small or if the domain shift between the transfer domains is significant. This paper attempts to improve self-supervised pretrained representations through the lens of curriculum learning.
  arXiv  Detail & Related papers  (2021-08-16T15:44:48Z)
• PGL: Prior-Guided Local Self-supervised Learning for 3D Medical Image Segmentation [87.50205728818601]
  We propose a PriorGuided Local (PGL) self-supervised model that learns the region-wise local consistency in the latent feature space. Our PGL model learns the distinctive representations of local regions, and hence is able to retain structural information.
  arXiv  Detail & Related papers  (2020-11-25T11:03:11Z)
• Deep Low-Shot Learning for Biological Image Classification and Visualization from Limited Training Samples [52.549928980694695]
  In situ hybridization (ISH) gene expression pattern images from the same developmental stage are compared. labeling training data with precise stages is very time-consuming even for biologists. We propose a deep two-step low-shot learning framework to accurately classify ISH images using limited training images.
  arXiv  Detail & Related papers  (2020-10-20T06:06:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.