Multi-Domain Few-Shot Learning and Dataset for Agricultural Applications
- URL: http://arxiv.org/abs/2109.09952v1
- Date: Tue, 21 Sep 2021 04:20:18 GMT
- Title: Multi-Domain Few-Shot Learning and Dataset for Agricultural Applications
- Authors: Sai Vidyaranya Nuthalapati, Anirudh Tunga
- Abstract summary: We propose a method to learn from a few samples to automatically classify different pests, plants, and their diseases.
We learn a feature extractor to generate embeddings and then update the embeddings using Transformers.
We conduct 42 experiments in total to comprehensively analyze the model and it achieves up to 14% and 24% performance gains on few-shot image classification benchmarks.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Automatic classification of pests and plants (both healthy and diseased) is
of paramount importance in agriculture to improve yield. Conventional deep
learning models based on convolutional neural networks require thousands of
labeled examples per category. In this work we propose a method to learn from a
few samples to automatically classify different pests, plants, and their
diseases, using Few-Shot Learning (FSL). We learn a feature extractor to
generate embeddings and then update the embeddings using Transformers. Using
Mahalanobis distance, a class-covariance-based metric, we then calculate the
similarity of the transformed embeddings with the embedding of the image to be
classified. Using our proposed architecture, we conduct extensive experiments
on multiple datasets showing the effectiveness of our proposed model. We
conduct 42 experiments in total to comprehensively analyze the model and it
achieves up to 14% and 24% performance gains on few-shot image classification
benchmarks on two datasets.
We also compile a new FSL dataset containing images of healthy and diseased
plants taken in real-world settings. Using our proposed architecture which has
been shown to outperform several existing FSL architectures in agriculture, we
provide strong baselines on our newly proposed dataset.
Related papers
- A Framework for Fine-Tuning LLMs using Heterogeneous Feedback [69.51729152929413]
We present a framework for fine-tuning large language models (LLMs) using heterogeneous feedback.
First, we combine the heterogeneous feedback data into a single supervision format, compatible with methods like SFT and RLHF.
Next, given this unified feedback dataset, we extract a high-quality and diverse subset to obtain performance increases.
arXiv Detail & Related papers (2024-08-05T23:20:32Z) - Multi-Label Plant Species Classification with Self-Supervised Vision Transformers [0.0]
We present a transfer learning approach using a self-supervised Vision Transformer (DINOv2) for the PlantCLEF 2024 competition.
To address the computational challenges of the large-scale dataset, we employ Spark for distributed data processing.
Our results demonstrate the efficacy of combining transfer learning with advanced data processing techniques for multi-label image classification tasks.
arXiv Detail & Related papers (2024-07-08T18:07:33Z) - Diversified in-domain synthesis with efficient fine-tuning for few-shot
classification [64.86872227580866]
Few-shot image classification aims to learn an image classifier using only a small set of labeled examples per class.
We propose DISEF, a novel approach which addresses the generalization challenge in few-shot learning using synthetic data.
We validate our method in ten different benchmarks, consistently outperforming baselines and establishing a new state-of-the-art for few-shot classification.
arXiv Detail & Related papers (2023-12-05T17:18:09Z) - Inside Out: Transforming Images of Lab-Grown Plants for Machine Learning
Applications in Agriculture [0.0]
We employ a contrastive unpaired translation (CUT) generative adversarial network (GAN) to translate indoor plant images to appear as field images.
While we train our network to translate an image containing only a single plant, we show that our method is easily extendable to produce multiple-plant field images.
We also use our synthetic multi-plant images to train several YoloV5 nano object detection models to perform the task of plant detection.
arXiv Detail & Related papers (2022-11-05T20:51:45Z) - Stacking Ensemble Learning in Deep Domain Adaptation for Ophthalmic
Image Classification [61.656149405657246]
Domain adaptation is effective in image classification tasks where obtaining sufficient label data is challenging.
We propose a novel method, named SELDA, for stacking ensemble learning via extending three domain adaptation methods.
The experimental results using Age-Related Eye Disease Study (AREDS) benchmark ophthalmic dataset demonstrate the effectiveness of the proposed model.
arXiv Detail & Related papers (2022-09-27T14:19:00Z) - CHALLENGER: Training with Attribution Maps [63.736435657236505]
We show that utilizing attribution maps for training neural networks can improve regularization of models and thus increase performance.
In particular, we show that our generic domain-independent approach yields state-of-the-art results in vision, natural language processing and on time series tasks.
arXiv Detail & Related papers (2022-05-30T13:34:46Z) - Investigating classification learning curves for automatically generated
and labelled plant images [0.1338174941551702]
We present a dataset of plant images with representatives of crops and weeds common to the Manitoba prairies at different growth stages.
We determine the learning curve for a classification task on this data with the ResNet architecture.
We investigate how label noise and the reduction of trainable parameters impacts the learning curve on this dataset.
arXiv Detail & Related papers (2022-05-22T23:28:42Z) - Two-View Fine-grained Classification of Plant Species [66.75915278733197]
We propose a novel method based on a two-view leaf image representation and a hierarchical classification strategy for fine-grained recognition of plant species.
A deep metric based on Siamese convolutional neural networks is used to reduce the dependence on a large number of training samples and make the method scalable to new plant species.
arXiv Detail & Related papers (2020-05-18T21:57:47Z) - Adversarial Feature Hallucination Networks for Few-Shot Learning [84.31660118264514]
Adversarial Feature Hallucination Networks (AFHN) is based on conditional Wasserstein Generative Adversarial networks (cWGAN)
Two novel regularizers are incorporated into AFHN to encourage discriminability and diversity of the synthesized features.
arXiv Detail & Related papers (2020-03-30T02:43:16Z) - Scalable learning for bridging the species gap in image-based plant
phenotyping [2.208242292882514]
The traditional paradigm of applying deep learning -- collect, annotate and train on data -- is not applicable to image-based plant phenotyping.
Data costs include growing physical samples, imaging and labelling them.
Model performance is impacted by the species gap between the domain of each plant species.
arXiv Detail & Related papers (2020-03-24T10:26:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.