High performing ensemble of convolutional neural networks for insect pest image detection

• URL: http://arxiv.org/abs/2108.12539v1
• Date: Sat, 28 Aug 2021 00:49:11 GMT
• Title: High performing ensemble of convolutional neural networks for insect pest image detection
• Authors: Loris Nanni, Alessandro Manfe, Gianluca Maguolo, Alessandra Lumini and Sheryl Brahnam
• Abstract summary: Pest infestation is a major cause of crop damage and lost revenues worldwide. We generate ensembles of CNNs based on different topologies. Two new Adam algorithms for deep network optimization are proposed.
• Score: 124.23179560022761
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Pest infestation is a major cause of crop damage and lost revenues worldwide. Automatic identification of invasive insects would greatly speedup the identification of pests and expedite their removal. In this paper, we generate ensembles of CNNs based on different topologies (ResNet50, GoogleNet, ShuffleNet, MobileNetv2, and DenseNet201) altered by random selection from a simple set of data augmentation methods or optimized with different Adam variants for pest identification. Two new Adam algorithms for deep network optimization based on DGrad are proposed that introduce a scaling factor in the learning rate. Sets of the five CNNs that vary in either data augmentation or the type of Adam optimization were trained on both the Deng (SMALL) and the large IP102 pest data sets. Ensembles were compared and evaluated using three performance indicators. The best performing ensemble, which combined the CNNs using the different augmentation methods and the two new Adam variants proposed here, achieved state of the art on both insect data sets: 95.52% on Deng and 73.46% on IP102, a score on Deng that competed with human expert classifications. Additional tests were performed on data sets for medical imagery classification that further validated the robustness and power of the proposed Adam optimization variants. All MATLAB source code is available at https://github.com/LorisNanni/.

Related papers

• Fuzzy Convolution Neural Networks for Tabular Data Classification [0.0]
  Convolutional neural networks (CNNs) have attracted a great deal of attention due to their remarkable performance in various domains. In this paper, we propose a novel framework fuzzy convolution neural network (FCNN) tailored specifically for tabular data.
  arXiv  Detail & Related papers  (2024-06-04T20:33:35Z)
• Fine-grained Recognition with Learnable Semantic Data Augmentation [68.48892326854494]
  Fine-grained image recognition is a longstanding computer vision challenge. We propose diversifying the training data at the feature-level to alleviate the discriminative region loss problem. Our method significantly improves the generalization performance on several popular classification networks.
  arXiv  Detail & Related papers  (2023-09-01T11:15:50Z)
• An Efficient End-to-End Deep Neural Network for Interstitial Lung Disease Recognition and Classification [0.5424799109837065]
  This paper introduces an end-to-end deep convolution neural network (CNN) for classifying ILDs patterns. The proposed model comprises four convolutional layers with different kernel sizes and Rectified Linear Unit (ReLU) activation function. A dataset consisting of 21328 image patches of 128 CT scans with five classes is taken to train and assess the proposed model.
  arXiv  Detail & Related papers  (2022-04-21T06:36:10Z)
• Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization [118.50301177912381]
  We show that Adam can converge to different solutions of the objective with provably different errors, even with weight decay globalization. We show that if convex, and the weight decay regularization is employed, any optimization algorithms including Adam will converge to the same solution.
  arXiv  Detail & Related papers  (2021-08-25T17:58:21Z)
• An Efficient Insect Pest Classification Using Multiple Convolutional Neural Network Based Models [0.3222802562733786]
  Insect pest classification is a difficult task because of various kinds, scales, shapes, complex backgrounds in the field, and high appearance similarity among insect species. We present different convolutional neural network-based models in this work, including attention, feature pyramid, and fine-grained models. The experimental results show that combining these convolutional neural network-based models can better perform than the state-of-the-art methods on these two datasets.
  arXiv  Detail & Related papers  (2021-07-26T12:53:28Z)
• Leveraging Multi-domain, Heterogeneous Data using Deep Multitask Learning for Hate Speech Detection [21.410160004193916]
  We propose a Convolution Neural Network based multi-task learning models (MTLs)footnotecode to leverage information from multiple sources. Empirical analysis performed on three benchmark datasets shows the efficacy of the proposed approach.
  arXiv  Detail & Related papers  (2021-03-23T09:31:01Z)
• Danish Fungi 2020 -- Not Just Another Image Recognition Dataset [0.0]
  We introduce a novel fine-grained dataset and benchmark, the Danish Fungi 2020 (DF20) The dataset is constructed from observations submitted to the Danish Fungal Atlas. DF20 has zero overlap with ImageNet, allowing unbiased comparison of models fine-tuned from publicly available ImageNet checkpoints.
  arXiv  Detail & Related papers  (2021-03-18T09:33:11Z)
• Automatic sleep stage classification with deep residual networks in a mixed-cohort setting [63.52264764099532]
  We developed a novel deep neural network model to assess the generalizability of several large-scale cohorts. Overall classification accuracy improved with increasing fractions of training data.
  arXiv  Detail & Related papers  (2020-08-21T10:48:35Z)
• ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning [91.13797346047984]
  We introduce ADAHESSIAN, a second order optimization algorithm which dynamically incorporates the curvature of the loss function via ADAptive estimates. We show that ADAHESSIAN achieves new state-of-the-art results by a large margin as compared to other adaptive optimization methods.
  arXiv  Detail & Related papers  (2020-06-01T05:00:51Z)
• Diversity inducing Information Bottleneck in Model Ensembles [73.80615604822435]
  In this paper, we target the problem of generating effective ensembles of neural networks by encouraging diversity in prediction. We explicitly optimize a diversity inducing adversarial loss for learning latent variables and thereby obtain diversity in the output predictions necessary for modeling multi-modal data. Compared to the most competitive baselines, we show significant improvements in classification accuracy, under a shift in the data distribution.
  arXiv  Detail & Related papers  (2020-03-10T03:10:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.