O2RNet: Occluder-Occludee Relational Network for Robust Apple Detection in Clustered Orchard Environments

• URL: http://arxiv.org/abs/2303.04884v1
• Date: Wed, 8 Mar 2023 20:46:05 GMT
• Title: O2RNet: Occluder-Occludee Relational Network for Robust Apple Detection in Clustered Orchard Environments
• Authors: Pengyu Chu, Zhaojian Li, Kaixiang Zhang, Dong Chen, Kyle Lammers and Renfu Lu
• Abstract summary: We present the development of a novel deep learning-based apple detection framework, Occluder-Occludee Comprehensive Network (O2RNet) The developed O2RNet outperforms state-of-the-art models with a higher accuracy of 94% and a higher F1-score of 0.88 on apple detection.
• Score: 10.045174456984412
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Automated apple harvesting has attracted significant research interest in recent years due to its potential to revolutionize the apple industry, addressing the issues of shortage and high costs in labor. One key technology to fully enable efficient automated harvesting is accurate and robust apple detection, which is challenging due to complex orchard environments that involve varying lighting conditions and foliage/branch occlusions. Furthermore, clustered apples are common in the orchard, which brings additional challenges as the clustered apples may be identified as one apple. This will cause issues in localization for subsequent robotic operations. In this paper, we present the development of a novel deep learning-based apple detection framework, Occluder-Occludee Relational Network (O2RNet), for robust detection of apples in such clustered environments. This network exploits the occuluder-occludee relationship modeling head by introducing a feature expansion structure to enable the combination of layered traditional detectors to split clustered apples and foliage occlusions. More specifically, we collect a comprehensive apple orchard image dataset under different lighting conditions (overcast, front lighting, and back lighting) with frequent apple occlusions. We then develop a novel occlusion-aware network for apple detection, in which a feature expansion structure is incorporated into the convolutional neural networks to extract additional features generated by the original network for occluded apples. Comprehensive evaluations are performed, which show that the developed O2RNet outperforms state-of-the-art models with a higher accuracy of 94\% and a higher F1-score of 0.88 on apple detection.

Related papers

• Active search and coverage using point-cloud reinforcement learning [50.741409008225766]
  This paper presents an end-to-end deep reinforcement learning solution for target search and coverage. We show that deep hierarchical feature learning works for RL and that by using farthest point sampling (FPS) we can reduce the amount of points. We also show that multi-head attention for point-clouds helps to learn the agent faster but converges to the same outcome.
  arXiv  Detail & Related papers  (2023-12-18T18:16:30Z)
• S$^3$AD: Semi-supervised Small Apple Detection in Orchard Environments [3.1979650133817206]
  Crop detection is integral for precision agriculture applications such as automated yield estimation or fruit picking. In this work, we address the challenges by reformulating the apple detection task in a semi-supervised manner. We provide a large, high-resolution dataset MAD comprising 105 labeled images with 14,667 annotated apple instances and 4,440 unlabeled images. We also propose a novel Semi-Supervised Small Apple Detection system S$3$AD based on contextual attention and selective tiling to improve the challenging detection of small apples.
  arXiv  Detail & Related papers  (2023-11-08T21:25:27Z)
• Secure Deep Learning-based Distributed Intelligence on Pocket-sized Drones [75.80952211739185]
  Palm-sized nano-drones are an appealing class of edge nodes, but their limited computational resources prevent running large deep-learning models onboard. Adopting an edge-fog computational paradigm, we can offload part of the computation to the fog; however, this poses security concerns if the fog node, or the communication link, can not be trusted. We propose a novel distributed edge-fog execution scheme that validates fog computation by redundantly executing a random subnetwork aboard our nano-drone.
  arXiv  Detail & Related papers  (2023-07-04T08:29:41Z)
• Semi-Supervised and Long-Tailed Object Detection with CascadeMatch [91.86787064083012]
  We propose a novel pseudo-labeling-based detector called CascadeMatch. Our detector features a cascade network architecture, which has multi-stage detection heads with progressive confidence thresholds. We show that CascadeMatch surpasses existing state-of-the-art semi-supervised approaches in handling long-tailed object detection.
  arXiv  Detail & Related papers  (2023-05-24T07:09:25Z)
• Self-Supervised Masked Convolutional Transformer Block for Anomaly Detection [122.4894940892536]
  We present a novel self-supervised masked convolutional transformer block (SSMCTB) that comprises the reconstruction-based functionality at a core architectural level. In this work, we extend our previous self-supervised predictive convolutional attentive block (SSPCAB) with a 3D masked convolutional layer, a transformer for channel-wise attention, as well as a novel self-supervised objective based on Huber loss.
  arXiv  Detail & Related papers  (2022-09-25T04:56:10Z)
• Localizing Small Apples in Complex Apple Orchard Environments [4.468952886990851]
  We tackle the problem of localization of apples in images of entire apple trees by adapting the object proposal generation system AttentionMask. We adapt AttentionMask by either adding a new module for very small apples or integrating it into a tiling framework. Both approaches clearly outperform standard object proposal generation systems on the MinneApple dataset.
  arXiv  Detail & Related papers  (2022-02-23T09:25:37Z)
• Neural Pruning via Growing Regularization [82.9322109208353]
  We extend regularization to tackle two central problems of pruning: pruning schedule and weight importance scoring. Specifically, we propose an L2 regularization variant with rising penalty factors and show it can bring significant accuracy gains. The proposed algorithms are easy to implement and scalable to large datasets and networks in both structured and unstructured pruning.
  arXiv  Detail & Related papers  (2020-12-16T20:16:28Z)
• DeepApple: Deep Learning-based Apple Detection using a Suppression Mask R-CNN [15.58696661701869]
  This letter reports on the development of a novel deep learning-based apple detection framework named DeepApple. We first collect a comprehensive apple orchard dataset for 'Gala' and 'Blondee' apples, using a color camera, under different lighting conditions. We then develop a novel suppression Mask R-CNN for apple detection, in which a suppression branch is added to the standard Mask R-CNN to suppress non-apple features generated by the original network.
  arXiv  Detail & Related papers  (2020-10-19T21:07:46Z)
• Deep Learning for Apple Diseases: Classification and Identification [0.5735035463793008]
  Disease and pests cause huge economic loss to the apple industry every year. In this study, we propose a deep learning based approach for identification and classification of apple diseases.
  arXiv  Detail & Related papers  (2020-07-06T18:08:58Z)
• Real-Time Apple Detection System Using Embedded Systems With Hardware Accelerators: An Edge AI Application [1.3764085113103222]
  The proposed study adapts YOLOv3-tiny architecture to detect small objects. It shows the feasibility of deployment of the customized model on cheap and power-efficient embedded hardware. The proposed embedded solution can be deployed on the unmanned ground vehicles to detect, count, and measure the size of the apples.
  arXiv  Detail & Related papers  (2020-04-28T10:40:01Z)
• Automatic Perturbation Analysis for Scalable Certified Robustness and Beyond [171.07853346630057]
  Linear relaxation based perturbation analysis (LiRPA) for neural networks has become a core component in robustness verification and certified defense. We develop an automatic framework to enable perturbation analysis on any neural network structures. We demonstrate LiRPA based certified defense on Tiny ImageNet and Downscaled ImageNet.
  arXiv  Detail & Related papers  (2020-02-28T18:47:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.