Collection and Evaluation of a Long-Term 4D Agri-Robotic Dataset
- URL: http://arxiv.org/abs/2211.14013v1
- Date: Fri, 25 Nov 2022 10:39:04 GMT
- Title: Collection and Evaluation of a Long-Term 4D Agri-Robotic Dataset
- Authors: Riccardo Polvara, Sergi Molina Mellado, Ibrahim Hroob, Grzegorz
Cielniak and Marc Hanheide
- Abstract summary: We report an ongoing effort in the long-term deployment of an autonomous mobile robot in a vineyard for data collection across multiple months.
The main aim is to collect data from the same area at different points in time so to be able to analyse the impact of the environmental changes in the mapping and localisation tasks.
We present a map-based localisation study taking 4 data sessions. We identify expected failures when the pre-built map visually differs from the environment's current appearance.
- Score: 8.81442358588687
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Long-term autonomy is one of the most demanded capabilities looked into a
robot. The possibility to perform the same task over and over on a long
temporal horizon, offering a high standard of reproducibility and robustness,
is appealing. Long-term autonomy can play a crucial role in the adoption of
robotics systems for precision agriculture, for example in assisting humans in
monitoring and harvesting crops in a large orchard. With this scope in mind, we
report an ongoing effort in the long-term deployment of an autonomous mobile
robot in a vineyard for data collection across multiple months. The main aim is
to collect data from the same area at different points in time so to be able to
analyse the impact of the environmental changes in the mapping and localisation
tasks. In this work, we present a map-based localisation study taking 4 data
sessions. We identify expected failures when the pre-built map visually differs
from the environment's current appearance and we anticipate LTS-Net, a solution
pointed at extracting stable temporal features for improving long-term 4D
localisation results.
Related papers
- AdaCropFollow: Self-Supervised Online Adaptation for Visual Under-Canopy Navigation [31.214318150001947]
Under-canopy agricultural robots can enable various applications like precise monitoring, spraying, weeding, and plant manipulation tasks.
We propose a self-supervised online adaptation method for adapting the semantic keypoint representation using a visual foundational model, geometric prior, and pseudo labeling.
This can enable fully autonomous row-following capability in under-canopy robots across fields and crops without requiring human intervention.
arXiv Detail & Related papers (2024-10-16T09:52:38Z) - Rethinking Urban Mobility Prediction: A Super-Multivariate Time Series
Forecasting Approach [71.67506068703314]
Long-term urban mobility predictions play a crucial role in the effective management of urban facilities and services.
Traditionally, urban mobility data has been structured as videos, treating longitude and latitude as fundamental pixels.
In our research, we introduce a fresh perspective on urban mobility prediction.
Instead of oversimplifying urban mobility data as traditional video data, we regard it as a complex time series.
arXiv Detail & Related papers (2023-12-04T07:39:05Z) - Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance.
We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach.
Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
arXiv Detail & Related papers (2023-09-12T13:28:06Z) - Panoptic Mapping with Fruit Completion and Pose Estimation for
Horticultural Robots [33.21287030243106]
Monitoring plants and fruits at high resolution play a key role in the future of agriculture.
Accurate 3D information can pave the way to a diverse number of robotic applications in agriculture ranging from autonomous harvesting to precise yield estimation.
We address the problem of jointly estimating complete 3D shapes of fruit and their pose in a 3D multi-resolution map built by a mobile robot.
arXiv Detail & Related papers (2023-03-15T20:41:24Z) - Semantic Segmentation of Vegetation in Remote Sensing Imagery Using Deep
Learning [77.34726150561087]
We propose an approach for creating a multi-modal and large-temporal dataset comprised of publicly available Remote Sensing data.
We use Convolutional Neural Networks (CNN) models that are capable of separating different classes of vegetation.
arXiv Detail & Related papers (2022-09-28T18:51:59Z) - General Place Recognition Survey: Towards the Real-world Autonomy Age [36.49196034588173]
The place recognition community has made astonishing progress over the last $20$ years.
Few methods have shown promising place recognition performance in complex real-world scenarios.
This paper can be a tutorial for researchers new to the place recognition community and those who care about long-term robotics autonomy.
arXiv Detail & Related papers (2022-09-09T19:37:05Z) - Object Goal Navigation using Data Regularized Q-Learning [9.65323691689801]
Object Goal Navigation requires a robot to find and navigate to an instance of a target object class in a previously unseen environment.
Our framework incrementally builds a semantic map of the environment over time, and then repeatedly selects a long-term goal.
Long-term goal selection is formulated as a vision-based deep reinforcement learning problem.
arXiv Detail & Related papers (2022-08-27T13:26:30Z) - A Spatio-Temporal Multilayer Perceptron for Gesture Recognition [70.34489104710366]
We propose a multilayer state-weighted perceptron for gesture recognition in the context of autonomous vehicles.
An evaluation of TCG and Drive&Act datasets is provided to showcase the promising performance of our approach.
We deploy our model to our autonomous vehicle to show its real-time capability and stable execution.
arXiv Detail & Related papers (2022-04-25T08:42:47Z) - Vision in adverse weather: Augmentation using CycleGANs with various
object detectors for robust perception in autonomous racing [70.16043883381677]
In autonomous racing, the weather can change abruptly, causing significant degradation in perception, resulting in ineffective manoeuvres.
In order to improve detection in adverse weather, deep-learning-based models typically require extensive datasets captured in such conditions.
We introduce an approach of using synthesised adverse condition datasets in autonomous racing (generated using CycleGAN) to improve the performance of four out of five state-of-the-art detectors.
arXiv Detail & Related papers (2022-01-10T10:02:40Z) - Deep Multi-Task Learning for Joint Localization, Perception, and
Prediction [68.50217234419922]
This paper investigates the issues that arise in state-of-the-art autonomy stacks under localization error.
We design a system that jointly performs perception, prediction, and localization.
Our architecture is able to reuse computation between both tasks, and is thus able to correct localization errors efficiently.
arXiv Detail & Related papers (2021-01-17T17:20:31Z) - Detection and Prediction of Nutrient Deficiency Stress using
Longitudinal Aerial Imagery [3.5417999811721677]
Early, precise detection of nutrient deficiency stress (NDS) has key economic as well as environmental impact precision.
We collect sequences of high-resolution aerial imagery and construct semantic segmentation models to detect and predict NDS across the field.
This work contributes to the recent developments in deep learning for remote sensing and agriculture, while addressing a key social challenge with implications for economics and sustainability.
arXiv Detail & Related papers (2020-12-17T15:06:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.