Power and accountability in reinforcement learning applications to environmental policy

• URL: http://arxiv.org/abs/2205.10911v1
• Date: Sun, 22 May 2022 19:31:37 GMT
• Title: Power and accountability in reinforcement learning applications to environmental policy
• Authors: Melissa Chapman, Caleb Scoville, Marcus Lapeyrolerie, Carl Boettiger
• Abstract summary: Reinforcement Learning (RL) may both hold the greatest promise and present the most pressing perils. This paper explores how RL-driven policy refracts existing power relations in the environmental domain.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Machine learning (ML) methods already permeate environmental decision-making, from processing high-dimensional data on earth systems to monitoring compliance with environmental regulations. Of the ML techniques available to address pressing environmental problems (e.g., climate change, biodiversity loss), Reinforcement Learning (RL) may both hold the greatest promise and present the most pressing perils. This paper explores how RL-driven policy refracts existing power relations in the environmental domain while also creating unique challenges to ensuring equitable and accountable environmental decision processes. We leverage examples from RL applications to climate change mitigation and fisheries management to explore how RL technologies shift the distribution of power between resource users, governing bodies, and private industry.

Related papers

• AI, Climate, and Transparency: Operationalizing and Improving the AI Act [2.874893537471256]
  This paper critically examines the AI Act's provisions on climate-related transparency. We identify key shortcomings, including the exclusion of energy consumption during AI inference. We propose a novel interpretation to bring inference-related energy use back within the Act's scope.
  arXiv  Detail & Related papers  (2024-08-28T07:57:39Z)
• Towards A Comprehensive Assessment of AI's Environmental Impact [0.5982922468400899]
  Recent surge of interest in machine learning has sparked a trend towards large-scale adoption of AI/ML. There is a need for a framework that monitors the environmental impact and degradation from AI/ML throughout its lifecycle. This study proposes a methodology to track environmental variables relating to the multifaceted impact of AI around datacenters using openly available energy data and globally acquired satellite observations.
  arXiv  Detail & Related papers  (2024-05-22T21:19:35Z)
• Reparameterized Policy Learning for Multimodal Trajectory Optimization [61.13228961771765]
  We investigate the challenge of parametrizing policies for reinforcement learning in high-dimensional continuous action spaces. We propose a principled framework that models the continuous RL policy as a generative model of optimal trajectories. We present a practical model-based RL method, which leverages the multimodal policy parameterization and learned world model.
  arXiv  Detail & Related papers  (2023-07-20T09:05:46Z)
• A Comparative Study of Machine Learning Algorithms for Anomaly Detection in Industrial Environments: Performance and Environmental Impact [62.997667081978825]
  This study seeks to address the demands of high-performance machine learning models with environmental sustainability. Traditional machine learning algorithms, such as Decision Trees and Random Forests, demonstrate robust efficiency and performance. However, superior outcomes were obtained with optimised configurations, albeit with a commensurate increase in resource consumption.
  arXiv  Detail & Related papers  (2023-07-01T15:18:00Z)
• A SWAT-based Reinforcement Learning Framework for Crop Management [0.0]
  We introduce a reinforcement learning (RL) environment that leverages the dynamics in the Soil and Water Assessment Tool (SWAT) This drastically saves time and resources that would have been otherwise deployed during a full-growing season. We demonstrate the utility of our framework by developing and benchmarking various decision-making agents following management strategies informed by standard farming practices and state-of-the-art RL algorithms.
  arXiv  Detail & Related papers  (2023-02-10T00:24:22Z)
• Dichotomy of Control: Separating What You Can Control from What You Cannot [129.62135987416164]
  We propose a future-conditioned supervised learning framework that separates mechanisms within a policy's control (actions) from those beyond a policy's control (environmentity) We show that DoC yields policies that are consistent with their conditioning inputs, ensuring that conditioning a learned policy on a desired high-return future outcome will correctly induce high-return behavior.
  arXiv  Detail & Related papers  (2022-10-24T17:49:56Z)
• Flexible Attention-Based Multi-Policy Fusion for Efficient Deep Reinforcement Learning [78.31888150539258]
  Reinforcement learning (RL) agents have long sought to approach the efficiency of human learning. Prior studies in RL have incorporated external knowledge policies to help agents improve sample efficiency. We present Knowledge-Grounded RL (KGRL), an RL paradigm fusing multiple knowledge policies and aiming for human-like efficiency and flexibility.
  arXiv  Detail & Related papers  (2022-10-07T17:56:57Z)
• Transfer learning with causal counterfactual reasoning in Decision Transformers [5.672132510411465]
  We study the problem of transfer learning under changes in the environment dynamics. Specifically, we use the Decision Transformer architecture to distill a new policy on the new environment. We show that this mechanism can bootstrap a successful policy on the target environment while retaining most of the reward.
  arXiv  Detail & Related papers  (2021-10-27T11:23:27Z)
• Deep Reinforcement Learning for Conservation Decisions [0.0]
  We show the potential of a promising corner of machine learning known as _reinforcement learning_ (RL) to help tackle the most challenging conservation decision problems. RL explicitly focuses on designing an agent who. interacts with an environment which is dynamic and uncertain. Four appendices with annotated code provide a tangible introduction to researchers looking to adopt, evaluate, or extend these approaches.
  arXiv  Detail & Related papers  (2021-06-15T16:32:48Z)
• Applications of physics-informed scientific machine learning in subsurface science: A survey [64.0476282000118]
  Geosystems are geological formations altered by humans activities such as fossil energy exploration, waste disposal, geologic carbon sequestration, and renewable energy generation. The responsible use and exploration of geosystems are thus critical to the geosystem governance, which in turn depends on the efficient monitoring, risk assessment, and decision support tools for practical implementation. Fast advances in machine learning algorithms and novel sensing technologies in recent years have presented new opportunities for the subsurface research community to improve the efficacy and transparency of geosystem governance.
  arXiv  Detail & Related papers  (2021-04-10T13:40:22Z)
• Deep Reinforcement Learning amidst Lifelong Non-Stationarity [67.24635298387624]
  We show that an off-policy RL algorithm can reason about and tackle lifelong non-stationarity. Our method leverages latent variable models to learn a representation of the environment from current and past experiences. We also introduce several simulation environments that exhibit lifelong non-stationarity, and empirically find that our approach substantially outperforms approaches that do not reason about environment shift.
  arXiv  Detail & Related papers  (2020-06-18T17:34:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.