Towards Practical Precision Agriculture: Real-Time Fruit Detection and Video Analytics on Embedded Edge Hardware

• URL: http://arxiv.org/abs/2609.13551v1
• Date: Fri, 11 Sep 2026 21:32:02 GMT
• Title: Towards Practical Precision Agriculture: Real-Time Fruit Detection and Video Analytics on Embedded Edge Hardware
• Abstract summary: This study presents an end-to-end framework for real-time fruit detection, tracking, and counting on the NVIDIA Jetson Orin Super.<n>A lightweight YOLO26s detector is trained independently on four public datasets representing apples, mangoes, blueberries, and strawberries.<n>APPLE MOTS is then used for temporal video analytics because it provides orchard sequences with persistent fruit identities.
• Score: 0.815557531820863
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Static-image benchmarks do not capture the computational and temporal requirements of practical orchard video analytics. This study presents an end-to-end framework for real-time fruit detection, tracking, and counting on the NVIDIA Jetson Orin Nano Super. A lightweight YOLO26s detector is trained independently on four public datasets representing apples, mangoes, blueberries, and strawberries under a common protocol. The models are deployed on embedded platform using PyTorch and TensorRT at FP32, FP16, and INT8 precision. APPLE MOTS is then used for temporal video analytics because it provides orchard sequences with persistent fruit identities, enabling evaluation of multi-object tracking and unique-fruit counting. The selected FP16 TensorRT detector is integrated into an NVIDIA DeepStream pipeline combining hardware-accelerated decoding, ByteTrack tracking, and motion-aware line-crossing analytics. Across the four detection tasks, mean test mAP@50:95 ranges from 0.4957 to 0.8656. On the Jetson, TensorRT FP16 achieves 66.76-74.56 images/s at 13.41-14.98 ms prediction latency, while reducing mAP@50:95 by only 0.0020-0.0054 and gross energy consumption by approximately 64-66% relative to PyTorch FP32. The complete detector-tracker-analytics pipeline reaches 44.96-54.11 FPS and sustains the configured 30-FPS input rate without output-frame loss. On held-out orchard video sequences, HOTA ranges from 0.345 to 0.538, event-level counting F1 from 0.611 to 0.803, and relative count error from 6.2% to 51.6%. Performance varies across acquisition geometries: near-lateral row viewing yields the most stable tracking and counting, whereas forward traversal remains association- and recall-limited despite spatially adaptive counting geometry. These results show that practical edge-based fruit monitoring requires efficient detection and acquisition geometries that support reliable temporal association.

Related papers

• Moving Like a Human: Ego-Motion-Normalized Temporal Signatures for Real-Time Aerial Person Tracking on Milliwatt-Class Hardware [1.932555230783329]
  Follow-me person tracking must run on the drone itself.<n>EMT-Det is a five-stage system that estimates ego-motion.<n>On a Raspberry Pi Zero 2W the pipeline runs at 31.85 FPS with 0.462 AP25 and 0.714 recall over 1,000 real-world UAV videos.
  arXiv  Detail & Related papers  (2026-07-09T19:30:00Z)
• EdgeZSAD: Practical Zero-Shot Anomaly Detection on Edge Devices [0.0]
  Industrial inspection needs zero-shot anomaly detection (ZSAD) that remains useful under edge deployment constraints.<n>We study this regime through EdgeZSAD, a compact reference system built around a TinyViT-21M-512 backbone.<n>We train a single checkpoint in a source-trained, target-unseen protocol and evaluate it across six industrial benchmarks.
  arXiv  Detail & Related papers  (2026-06-15T02:17:46Z)
• GPU-Accelerated Optimization of Transformer-Based Neural Networks for Real-Time Inference [0.0]
  This paper presents the design and evaluation of a GPU-accelerated inference pipeline for transformer models using NVIDIART with mixed-precision optimization.<n>The system achieves up to 64.4x speedup over CPU baselines, sub-10 ms latency for single-sample inference, and a 63 percent reduction in memory usage.
  arXiv  Detail & Related papers  (2026-03-30T17:27:33Z)
• No Dense Tensors Needed: Fully Sparse Object Detection on Event-Camera Voxel Grids [0.3823356975862005]
  Event cameras produce asynchronous, high-dynamic-range streams well suited for detecting small, fast-moving drones.<n>Most event-based detectors convert the sparse event stream into dense tensors, discarding the representational efficiency of neuromorphic sensing.<n>We propose SparseVoxelDet, the first fully sparse object detector for event cameras, in which backbone feature extraction, feature pyramid fusion, and the detection head all operate exclusively on occupied voxel positions.
  arXiv  Detail & Related papers  (2026-03-23T07:12:14Z)
• Trace Anything: Representing Any Video in 4D via Trajectory Fields [98.85848134960172]
  Trajectory Field is a dense mapping that assigns a continuous 3D trajectory function of time to each pixel in every frame.<n>We introduce Trace Anything, a neural network that predicts the entire trajectory field in a single feed-forward pass.<n>We trained the Trace Anything model on large-scale 4D data, including data from our new platform.
  arXiv  Detail & Related papers  (2025-10-15T17:59:04Z)
• Ultra-low Power Deep Learning-based Monocular Relative Localization Onboard Nano-quadrotors [64.68349896377629]
  This work presents a novel autonomous end-to-end system that addresses the monocular relative localization, through deep neural networks (DNNs), of two peer nano-drones. To cope with the ultra-constrained nano-drone platform, we propose a vertically-integrated framework, including dataset augmentation, quantization, and system optimizations. Experimental results show that our DNN can precisely localize a 10cm-size target nano-drone by employing only low-resolution monochrome images, up to 2m distance.
  arXiv  Detail & Related papers  (2023-03-03T14:14:08Z)
• EAutoDet: Efficient Architecture Search for Object Detection [110.99532343155073]
  EAutoDet framework can discover practical backbone and FPN architectures for object detection in 1.4 GPU-days. We propose a kernel reusing technique by sharing the weights of candidate operations on one edge and consolidating them into one convolution. In particular, the discovered architectures surpass state-of-the-art object detection NAS methods and achieve 40.1 mAP with 120 FPS and 49.2 mAP with 41.3 FPS on COCO test-dev set.
  arXiv  Detail & Related papers  (2022-03-21T05:56:12Z)
• VariabilityTrack:Multi-Object Tracking with Variable Speed Object Movement [1.6385815610837167]
  Multi-object tracking (MOT) aims at estimating bounding boxes and identities of objects in videos. We propose a variable speed Kalman filter algorithm based on environmental feedback and improve the matching process.
  arXiv  Detail & Related papers  (2022-03-12T12:39:41Z)
• Fast and Data Efficient Reinforcement Learning from Pixels via Non-Parametric Value Approximation [90.78178803486746]
  We present Nonparametric Approximation of Inter-Trace returns (NAIT), a Reinforcement Learning algorithm for discrete action, pixel-based environments. We empirically evaluate NAIT on both the 26 and 57 game variants of ATARI100k where, despite its simplicity, it achieves competitive performance in the online setting with greater than 100x speedup in wall-time.
  arXiv  Detail & Related papers  (2022-03-07T00:31:31Z)
• Accelerating Training and Inference of Graph Neural Networks with Fast Sampling and Pipelining [58.10436813430554]
  Mini-batch training of graph neural networks (GNNs) requires a lot of computation and data movement. We argue in favor of performing mini-batch training with neighborhood sampling in a distributed multi-GPU environment. We present a sequence of improvements to mitigate these bottlenecks, including a performance-engineered neighborhood sampler. We also conduct an empirical analysis that supports the use of sampling for inference, showing that test accuracies are not materially compromised.
  arXiv  Detail & Related papers  (2021-10-16T02:41:35Z)
• Tracking Objects as Points [83.9217787335878]
  We present a simultaneous detection and tracking algorithm that is simpler, faster, and more accurate than the state of the art. Our tracker, CenterTrack, applies a detection model to a pair of images and detections from the prior frame. CenterTrack is simple, online (no peeking into the future), and real-time.
  arXiv  Detail & Related papers  (2020-04-02T17:58:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.