To Measure or Not: A Cost-Sensitive, Selective Measuring Environment for Agricultural Management Decisions with Reinforcement Learning

• URL: http://arxiv.org/abs/2501.12823v1
• Date: Wed, 22 Jan 2025 12:03:53 GMT
• Title: To Measure or Not: A Cost-Sensitive, Selective Measuring Environment for Agricultural Management Decisions with Reinforcement Learning
• Authors: Hilmy Baja, Michiel Kallenberg, Ioannis N. Athanasiadis,
• Abstract summary: In most cases, it is not feasible to gather crop state measurements before every decision moment. We apply reinforcement learning to recommend opportune moments to simultaneously measure crop features and apply nitrogen fertilizer. Our results highlight the importance of measuring when crop feature measurements are not readily available.
• Score: 0.0
• License:
• Abstract: Farmers rely on in-field observations to make well-informed crop management decisions to maximize profit and minimize adverse environmental impact. However, obtaining real-world crop state measurements is labor-intensive, time-consuming and expensive. In most cases, it is not feasible to gather crop state measurements before every decision moment. Moreover, in previous research pertaining to farm management optimization, these observations are often assumed to be readily available without any cost, which is unrealistic. Hence, enabling optimization without the need to have temporally complete crop state observations is important. An approach to that problem is to include measuring as part of decision making. As a solution, we apply reinforcement learning (RL) to recommend opportune moments to simultaneously measure crop features and apply nitrogen fertilizer. With realistic considerations, we design an RL environment with explicit crop feature measuring costs. While balancing costs, we find that an RL agent, trained with recurrent PPO, discovers adaptive measuring policies that follow critical crop development stages, with results aligned by what domain experts would consider a sensible approach. Our results highlight the importance of measuring when crop feature measurements are not readily available.

Related papers

• Learning-based agricultural management in partially observable environments subject to climate variability [5.5062239803516615]
  Agricultural management holds a central role in shaping crop yield, economic profitability, and environmental sustainability. We introduce an innovative framework that integrates Deep Reinforcement Learning (DRL) with Recurrent Neural Networks (RNNs) Our study illuminates the need for agent retraining to acquire new optimal policies under extreme weather events.
  arXiv  Detail & Related papers  (2024-01-02T16:18:53Z)
• Machine Learning-based Nutrient Application's Timeline Recommendation for Smart Agriculture: A Large-Scale Data Mining Approach [0.0]
  Inaccurate fertiliser application decisions can lead to costly consequences, hinder food production, and cause environmental harm. We propose a solution to predict nutrient application by determining required fertiliser quantities for an entire season. The proposed solution recommends adjusting fertiliser amounts based on weather conditions and soil characteristics to promote cost-effective and environmentally friendly agriculture.
  arXiv  Detail & Related papers  (2023-10-18T15:37:19Z)
• A SWAT-based Reinforcement Learning Framework for Crop Management [0.0]
  We introduce a reinforcement learning (RL) environment that leverages the dynamics in the Soil and Water Assessment Tool (SWAT) This drastically saves time and resources that would have been otherwise deployed during a full-growing season. We demonstrate the utility of our framework by developing and benchmarking various decision-making agents following management strategies informed by standard farming practices and state-of-the-art RL algorithms.
  arXiv  Detail & Related papers  (2023-02-10T00:24:22Z)
• Optimizing Crop Management with Reinforcement Learning and Imitation Learning [9.69704937572711]
  We present an intelligent crop management system which optimize the N fertilization and irrigation simultaneously via reinforcement learning (RL), imitation learning (IL), and crop simulations. We conduct experiments on a case study using maize in Florida and compare trained policies with a maize management guideline in simulations. Our trained policies under both full and partial observations achieve better outcomes, resulting in a higher profit or a similar profit with a smaller environmental impact.
  arXiv  Detail & Related papers  (2022-09-20T20:48:52Z)
• Risk-averse Stochastic Optimization for Farm Management Practices and Cultivar Selection Under Uncertainty [8.427937898153779]
  We develop optimization frameworks under uncertainty using conditional value-at-risk in the objective programming function. As a case study, we set up the crop model for 25 locations across the US Corn Belt. Results indicated that the proposed model produced meaningful connections between weather and optima decisions.
  arXiv  Detail & Related papers  (2022-07-17T01:14:43Z)
• Uncertainty-aware Remaining Useful Life predictor [57.74855412811814]
  Remaining Useful Life (RUL) estimation is the problem of inferring how long a certain industrial asset can be expected to operate. In this work, we consider Deep Gaussian Processes (DGPs) as possible solutions to the aforementioned limitations. The performance of the algorithms is evaluated on the N-CMAPSS dataset from NASA for aircraft engines.
  arXiv  Detail & Related papers  (2021-04-08T08:50:44Z)
• Estimating Crop Primary Productivity with Sentinel-2 and Landsat 8 using Machine Learning Methods Trained with Radiative Transfer Simulations [58.17039841385472]
  We take advantage of all parallel developments in mechanistic modeling and satellite data availability for advanced monitoring of crop productivity. Our model successfully estimates gross primary productivity across a variety of C3 crop types and environmental conditions even though it does not use any local information from the corresponding sites. This highlights its potential to map crop productivity from new satellite sensors at a global scale with the help of current Earth observation cloud computing platforms.
  arXiv  Detail & Related papers  (2020-12-07T16:23:13Z)
• Temporal Difference Uncertainties as a Signal for Exploration [76.6341354269013]
  An effective approach to exploration in reinforcement learning is to rely on an agent's uncertainty over the optimal policy. In this paper, we highlight that value estimates are easily biased and temporally inconsistent. We propose a novel method for estimating uncertainty over the value function that relies on inducing a distribution over temporal difference errors.
  arXiv  Detail & Related papers  (2020-10-05T18:11:22Z)
• Learning from Data to Optimize Control in Precision Farming [77.34726150561087]
  Special issue presents the latest development in statistical inference, machine learning and optimum control for precision farming. Satellite positioning and navigation followed by Internet-of-Things generate vast information that can be used to optimize farming processes in real-time.
  arXiv  Detail & Related papers  (2020-07-07T12:44:17Z)
• Deep Learning for Virtual Screening: Five Reasons to Use ROC Cost Functions [80.12620331438052]
  deep learning has become an important tool for rapid screening of billions of molecules in silico for potential hits containing desired chemical features. Despite its importance, substantial challenges persist in training these models, such as severe class imbalance, high decision thresholds, and lack of ground truth labels in some datasets. We argue in favor of directly optimizing the receiver operating characteristic (ROC) in such cases, due to its robustness to class imbalance.
  arXiv  Detail & Related papers  (2020-06-25T08:46:37Z)
• Enabling Counterfactual Survival Analysis with Balanced Representations [64.17342727357618]
  Survival data are frequently encountered across diverse medical applications, i.e., drug development, risk profiling, and clinical trials. We propose a theoretically grounded unified framework for counterfactual inference applicable to survival outcomes.
  arXiv  Detail & Related papers  (2020-06-14T01:15:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.