Vision-based Vineyard Navigation Solution with Automatic Annotation
- URL: http://arxiv.org/abs/2303.14347v1
- Date: Sat, 25 Mar 2023 03:37:17 GMT
- Title: Vision-based Vineyard Navigation Solution with Automatic Annotation
- Authors: Ertai Liu, Josephine Monica, Kaitlin Gold, Lance Cadle-Davidson, David
Combs, Yu Jiang
- Abstract summary: We introduce a vision-based autonomous navigation framework for agriculture robots in trellised cropping systems such as vineyards.
We propose a novel learning-based method to estimate the path traversibility heatmap directly from an RGB-D image.
A trained path detection model was used to develop a full navigation framework consisting of row tracking and row switching modules.
- Score: 2.6013566739979463
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Autonomous navigation is the key to achieving the full automation of
agricultural research and production management (e.g., disease management and
yield prediction) using agricultural robots. In this paper, we introduced a
vision-based autonomous navigation framework for agriculture robots in
trellised cropping systems such as vineyards. To achieve this, we proposed a
novel learning-based method to estimate the path traversibility heatmap
directly from an RGB-D image and subsequently convert the heatmap to a
preferred traversal path. An automatic annotation pipeline was developed to
form a training dataset by projecting RTK GPS paths collected during the first
setup in a vineyard in corresponding RGB-D images as ground-truth path
annotations, allowing a fast model training and fine-tuning without costly
human annotation. The trained path detection model was used to develop a full
navigation framework consisting of row tracking and row switching modules,
enabling a robot to traverse within a crop row and transit between crop rows to
cover an entire vineyard autonomously. Extensive field trials were conducted in
three different vineyards to demonstrate that the developed path detection
model and navigation framework provided a cost-effective, accurate, and robust
autonomous navigation solution in the vineyard and could be generalized to
unseen vineyards with stable performance.
Related papers
- Neural Semantic Map-Learning for Autonomous Vehicles [85.8425492858912]
We present a mapping system that fuses local submaps gathered from a fleet of vehicles at a central instance to produce a coherent map of the road environment.
Our method jointly aligns and merges the noisy and incomplete local submaps using a scene-specific Neural Signed Distance Field.
We leverage memory-efficient sparse feature-grids to scale to large areas and introduce a confidence score to model uncertainty in scene reconstruction.
arXiv Detail & Related papers (2024-10-10T10:10:03Z) - RSRD: A Road Surface Reconstruction Dataset and Benchmark for Safe and
Comfortable Autonomous Driving [67.09546127265034]
Road surface reconstruction helps to enhance the analysis and prediction of vehicle responses for motion planning and control systems.
We introduce the Road Surface Reconstruction dataset, a real-world, high-resolution, and high-precision dataset collected with a specialized platform in diverse driving conditions.
It covers common road types containing approximately 16,000 pairs of stereo images, original point clouds, and ground-truth depth/disparity maps.
arXiv Detail & Related papers (2023-10-03T17:59:32Z) - Enhancing Navigation Benchmarking and Perception Data Generation for
Row-based Crops in Simulation [0.3518016233072556]
This paper presents a synthetic dataset to train semantic segmentation networks and a collection of virtual scenarios for a fast evaluation of navigation algorithms.
An automatic parametric approach is developed to explore different field geometries and features.
The simulation framework and the dataset have been evaluated by training a deep segmentation network on different crops and benchmarking the resulting navigation.
arXiv Detail & Related papers (2023-06-27T14:46:09Z) - Monocular BEV Perception of Road Scenes via Front-to-Top View Projection [57.19891435386843]
We present a novel framework that reconstructs a local map formed by road layout and vehicle occupancy in the bird's-eye view.
Our model runs at 25 FPS on a single GPU, which is efficient and applicable for real-time panorama HD map reconstruction.
arXiv Detail & Related papers (2022-11-15T13:52:41Z) - Position-Agnostic Autonomous Navigation in Vineyards with Deep
Reinforcement Learning [1.2599533416395767]
We propose a cutting-edge lightweight solution to tackle the problem of autonomous vineyard navigation without exploiting precise localization data and overcoming task-tailored algorithms with a flexible learning-based approach.
We train an end-to-end sensorimotor agent which directly maps noisy depth images and position-agnostic robot state information to velocity commands and guides the robot to the end of a row, continuously adjusting its heading for a collision-free central trajectory.
arXiv Detail & Related papers (2022-06-28T17:03:37Z) - ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hints [94.60414567852536]
Long-range navigation requires both planning and reasoning about local traversability.
We propose a learning-based approach that integrates learning and planning.
ViKiNG can leverage its image-based learned controller and goal-directed to navigate to goals up to 3 kilometers away.
arXiv Detail & Related papers (2022-02-23T02:14:23Z) - Towards Autonomous Crop-Agnostic Visual Navigation in Arable Fields [2.6323812778809907]
We introduce a vision-based navigation scheme which is able to reliably guide the robot through row-crop fields.
With the help of a novel crop-row detection and a novel crop-row switching technique, our navigation scheme can be deployed in a wide range of fields.
arXiv Detail & Related papers (2021-09-24T12:54:42Z) - Deep Semantic Segmentation at the Edge for Autonomous Navigation in
Vineyard Rows [0.0]
Precision agriculture aims at introducing affordable and effective automation into agricultural processes.
Our novel proposed control leverages the latest advancement in machine perception and edge AI techniques to achieve highly affordable and reliable navigation inside vineyard rows.
The segmentation maps generated by the control algorithm itself could be directly exploited as filters for a vegetative assessment of the crop status.
arXiv Detail & Related papers (2021-07-01T18:51:58Z) - GANav: Group-wise Attention Network for Classifying Navigable Regions in
Unstructured Outdoor Environments [54.21959527308051]
We present a new learning-based method for identifying safe and navigable regions in off-road terrains and unstructured environments from RGB images.
Our approach consists of classifying groups of terrain classes based on their navigability levels using coarse-grained semantic segmentation.
We show through extensive evaluations on the RUGD and RELLIS-3D datasets that our learning algorithm improves the accuracy of visual perception in off-road terrains for navigation.
arXiv Detail & Related papers (2021-03-07T02:16:24Z) - ViNG: Learning Open-World Navigation with Visual Goals [82.84193221280216]
We propose a learning-based navigation system for reaching visually indicated goals.
We show that our system, which we call ViNG, outperforms previously-proposed methods for goal-conditioned reinforcement learning.
We demonstrate ViNG on a number of real-world applications, such as last-mile delivery and warehouse inspection.
arXiv Detail & Related papers (2020-12-17T18:22:32Z) - Local Motion Planner for Autonomous Navigation in Vineyards with a RGB-D
Camera-Based Algorithm and Deep Learning Synergy [1.0312968200748118]
This study presents a low-cost local motion planner for autonomous navigation in vineyards.
The first algorithm exploits the disparity map and its depth representation to generate a proportional control for the robotic platform.
A second back-up algorithm, based on representations learning and resilient to illumination variations, can take control of the machine in case of a momentaneous failure of the first block.
arXiv Detail & Related papers (2020-05-26T15:47:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.