Enhancing Precision Agriculture with a Hybrid Deep Learning Framework for Multi-Class Plant Disease Classification and Interpretability

• URL: http://arxiv.org/abs/2606.15282v1
• Date: Sat, 13 Jun 2026 12:41:31 GMT
• Title: Enhancing Precision Agriculture with a Hybrid Deep Learning Framework for Multi-Class Plant Disease Classification and Interpretability
• Abstract summary: This study proposes an overall deep learning architecture for multi-class classification of plant diseases from high-resolution leaf imagery.<n>A specially gathered image database with 15,200 training images and 3,800 validation images spanned 38 classes across multiple crops, including tomato, apple, grape etc.<n>For every one of the considered architectures, ResNet-50 led to the highest accuracy of 98.74%, whereas the hybrid ResNet + ViT model achieved a competitive accuracy of 98.58%.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This study proposes an overall deep learning architecture for multi-class classification of plant diseases from high-resolution leaf imagery, with a particular interest in investigating the behavior of ResNet-50 and a hybrid ResNet + Vision Transformer (ViT) design. A specially gathered image database with 15,200 training images and 3,800 validation images spanning 38 classes across multiple crops, including tomato, apple, grape etc. were subjected to preprocessing steps such as resizing, normalization, and data augmentation to enhance model robustness. Multiple architectures, including ResNet-50, MobileNetV2, and EfficientNet-B0, were trained and compared with the hybrid ResNet + ViT model. All models were fine-tuned using the AdamW optimizer and cross-entropy loss, with early stopping applied to prevent overfitting and ensure generalization. Furthermore, interpretability techniques such as Grad-CAM and saliency maps were implemented to indicate disease-relevant regions, while segmentation-based analysis was performed to identify the affected parts of a leaf. For every one of the considered architectures, ResNet-50 led to the highest accuracy of 98.74%, whereas the hybrid ResNet + ViT model achieved a competitive accuracy of 98.58%, showing that the hybrid architectures were effective in capturing both local and overall information. The experimental results showcase the promise of transformer-based models to achieve highly accurate, interpretable, and computationally efficient computer-based multi-class multi-disease classification systems, providing helpful assistance for cultivation management practices as well as for precision farming.

Related papers

• Performance and Interpretability of Convolutional, Transformer, and Hybrid Deep Learning Models in Colorectal Histology Classification [0.0]
  This study evaluated twelve ImageNet-pretrained CNN, transformer, and hybrid architectures using the Kather colorectal histopathology dataset.<n> EVA-02 achieved the highest overall performance (97.1% accuracy, 97.0% F1-score), closely followed by ViT-B/16.
  arXiv  Detail & Related papers  (2026-06-21T18:56:42Z)
• AgriPath: A Systematic Exploration of Architectural Trade-offs for Crop Disease Classification [45.52399819498234]
  This work presents a systematic empirical comparison of three model paradigms for fine-grained crop disease classification.<n>We introduce AgriPath-LF16, a benchmark containing 111k images spanning 16 crops and 41 diseases.<n>CNNs achieve the highest accuracy on lab imagery but degrade under domain shift.<n> Contrastive VLMs provide a robust and parameter-efficient alternative with competitive cross-domain performance.
  arXiv  Detail & Related papers  (2026-03-08T17:28:01Z)
• Multi-objective hybrid knowledge distillation for efficient deep learning in smart agriculture [0.05599792629509228]
  This study proposes a hybrid knowledge distillation framework for developing a lightweight yet high-performance convolutional neural network.<n>The proposed approach designs a customized student model that combines inverted residual blocks with dense connectivity and trains it under the guidance of a ResNet18 teacher network.
  arXiv  Detail & Related papers  (2025-12-23T15:33:55Z)
• Mobile-Friendly Deep Learning for Plant Disease Detection: A Lightweight CNN Benchmark Across 101 Classes of 33 Crops [39.58317527488534]
  Plant diseases are a major threat to food security globally.<n>We have developed a mobile-friendly solution which can accurately classify 101 plant diseases across 33 crops.
  arXiv  Detail & Related papers  (2025-08-14T16:43:27Z)
• Plant Disease Detection through Multimodal Large Language Models and Convolutional Neural Networks [0.5009853409756729]
  This study investigates the effectiveness of combining multimodal Large Language Models (LLMs) with Convolutional Neural Networks (CNNs) for automated plant disease classification using leaf imagery.<n>We evaluate model performance across zero-shot, few-shot, and progressive fine-tuning scenarios.
  arXiv  Detail & Related papers  (2025-04-29T04:31:58Z)
• Multi-view Hybrid Graph Convolutional Network for Volume-to-mesh Reconstruction in Cardiovascular MRI [43.47826598981827]
  We introduce HybridVNet, a novel architecture for direct image-to-mesh extraction.<n>We show it can efficiently handle surface and volumetric meshes by encoding them as graph structures.<n>Our model combines traditional convolutional networks with variational graph generative models, deep supervision and mesh-specific regularisation.
  arXiv  Detail & Related papers  (2023-11-22T21:51:29Z)
• Dual-Activated Lightweight Attention ResNet50 for Automatic Histopathology Breast Cancer Image Classification [0.0]
  This study introduces a novel method for breast cancer classification, the Dual-Activated Lightweight Attention ResNet50 model. It integrates a pre-trained ResNet50 model with a lightweight attention mechanism, embedding an attention module in the fourth layer of ResNet50. The DALAResNet50 method was tested on breast cancer histopathology images from the BreakHis Database across magnification factors of 40X, 100X, 200X, and 400X, achieving accuracies of 98.5%, 98.7%, 97.9%, and 94.3%, respectively.
  arXiv  Detail & Related papers  (2023-08-25T03:08:41Z)
• Breast Ultrasound Tumor Classification Using a Hybrid Multitask CNN-Transformer Network [63.845552349914186]
  Capturing global contextual information plays a critical role in breast ultrasound (BUS) image classification. Vision Transformers have an improved capability of capturing global contextual information but may distort the local image patterns due to the tokenization operations. In this study, we proposed a hybrid multitask deep neural network called Hybrid-MT-ESTAN, designed to perform BUS tumor classification and segmentation.
  arXiv  Detail & Related papers  (2023-08-04T01:19:32Z)
• End-to-end deep learning for directly estimating grape yield from ground-based imagery [53.086864957064876]
  This study demonstrates the application of proximal imaging combined with deep learning for yield estimation in vineyards. Three model architectures were tested: object detection, CNN regression, and transformer models. The study showed the applicability of proximal imaging and deep learning for prediction of grapevine yield on a large scale.
  arXiv  Detail & Related papers  (2022-08-04T01:34:46Z)
• If your data distribution shifts, use self-learning [24.23584770840611]
  Self-learning techniques like entropy and pseudo-labeling are simple and effective at improving performance of a deployed computer vision model under systematic domain shifts. We conduct a wide range of large-scale experiments and show consistent improvements irrespective of the model architecture.
  arXiv  Detail & Related papers  (2021-04-27T01:02:15Z)
• Classification of Seeds using Domain Randomization on Self-Supervised Learning Frameworks [0.0]
  Key bottleneck is the need for an extensive amount of labelled data to train the convolutional neural networks (CNN) The work leverages the concepts of Contrastive Learning and Domain Randomi-zation in order to achieve the same. The use of synthetic images generated from a representational sample crop of real-world images alleviates the need for a large volume of test subjects.
  arXiv  Detail & Related papers  (2021-03-29T12:50:06Z)
• Improving robustness against common corruptions by covariate shift adaptation [29.27289096759534]
  State-of-the-art machine vision models are vulnerable to image corruptions like blurring or compression artefacts. We argue that popular benchmarks to measure model robustness against common corruptions underestimate model robustness in many (but not all) application scenarios.
  arXiv  Detail & Related papers  (2020-06-30T17:01:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.