Learning long term climate-resilient transport adaptation pathways under direct and indirect flood impacts using reinforcement learning

• URL: http://arxiv.org/abs/2601.18586v1
• Date: Mon, 26 Jan 2026 15:32:40 GMT
• Title: Learning long term climate-resilient transport adaptation pathways under direct and indirect flood impacts using reinforcement learning
• Authors: Miguel Costa, Arthur Vandervoort, Carolin Schmidt, Morten W. Petersen, Martin Drews, Karyn Morrissey, Francisco C. Pereira,
• Abstract summary: We propose a generic decision-support framework to learn adaptive, multi-decade investment pathways under uncertainty.<n>The framework combines long-term climate projections with models that map projected extreme-weather drivers into hazard likelihoods.<n>It learns adaptive climate adaptation policies that trade off investment and maintenance expenditures against avoided impacts.
• Score: 2.52487898284169
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Climate change is expected to intensify rainfall and other hazards, increasing disruptions in urban transportation systems. Designing effective adaptation strategies is challenging due to the long-term, sequential nature of infrastructure investments, deep uncertainty, and complex cross-sector interactions. We propose a generic decision-support framework that couples an integrated assessment model (IAM) with reinforcement learning (RL) to learn adaptive, multi-decade investment pathways under uncertainty. The framework combines long-term climate projections (e.g., IPCC scenario pathways) with models that map projected extreme-weather drivers (e.g. rain) into hazard likelihoods (e.g. flooding), propagate hazards into urban infrastructure impacts (e.g. transport disruption), and value direct and indirect consequences for service performance and societal costs. Embedded in a reinforcement-learning loop, it learns adaptive climate adaptation policies that trade off investment and maintenance expenditures against avoided impacts. In collaboration with Copenhagen Municipality, we demonstrate the approach on pluvial flooding in the inner city for the horizon of 2024 to 2100. The learned strategies yield coordinated spatial-temporal pathways and improved robustness relative to conventional optimization baselines, namely inaction and random action, illustrating the framework's transferability to other hazards and cities.

Related papers

• Hierarchical Reinforcement Learning for Cooperative Air-Ground Delivery in Urban System [41.96919926267983]
  We propose HRL4AG, a Hierarchical Reinforcement Learning framework for cooperative Air-Ground delivery.<n>Specifically, HRL4AG employs a high-level manager to tackle the scalability bottleneck by decomposing the joint action space.<n>Experiments on two real-world datasets and an evaluation platform demonstrate that HRL4AG significantly outperforms state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-02-13T13:19:59Z)
• Evaluating Impacts of Traffic Regulations in Complex Mobility Systems Using Scenario-Based Simulations [0.3867363075280543]
  Urban traffic regulation policies are increasingly used to address congestion, emissions, and accessibility in cities.<n>Recent advances in data availability and computational power enable new forms of model-driven, simulation-based decision support for transportation policy design.<n>This paper proposes a novel simulation paradigm for the ex-ante evaluation of both direct impacts and indirect impacts spanning transportation-related effects and economic accessibility.
  arXiv  Detail & Related papers  (2026-01-12T17:12:22Z)
• Climate Adaptation with Reinforcement Learning: Economic vs. Quality of Life Adaptation Pathways [2.1499528348377535]
  Reinforcement Learning can be a useful tool to identify adaptation pathways under uncertain conditions.<n>We use an Integrated Assessment Model (IAM) to link together a rainfall and flood model, and compute the impacts of flooding in terms of quality of life (QoL), transportation, and infrastructure damage.<n>Our results show that models prioritising QoL over economic impacts results in more adaptation spending as well as a more even distribution of spending over the study area.
  arXiv  Detail & Related papers  (2025-11-05T07:09:39Z)
• Incorporating Quality of Life in Climate Adaptation Planning via Reinforcement Learning [2.1499528348377535]
  Reinforcement Learning (RL) holds significant promise in tackling complex, dynamic, and uncertain problems.<n>We use RL to identify which climate adaptation pathways lead to a higher Quality of Life in the long term.<n>Our preliminary results suggest that this approach can be used to learn optimal adaptation measures and it outperforms other realistic and real-world planning strategies.
  arXiv  Detail & Related papers  (2025-11-05T07:00:55Z)
• Safe and Economical UAV Trajectory Planning in Low-Altitude Airspace: A Hybrid DRL-LLM Approach with Compliance Awareness [42.280913394678656]
  We propose a novel UAV trajectory planning framework that combines deep reinforcement learning (DRL) with large language model (LLM) reasoning to enable safe, compliant, and economically viable path planning.<n> Experimental results demonstrate that our method significantly outperforms existing baselines across multiple metrics, including data collection rate, collision avoidance, successful landing, regulatory compliance, and energy efficiency.
  arXiv  Detail & Related papers  (2025-06-10T07:51:29Z)
• Depth-Constrained ASV Navigation with Deep RL and Limited Sensing [43.785833390490446]
  We propose a reinforcement learning framework for ASV navigation under depth constraints.<n>To enhance environmental awareness, we integrate GP regression into the RL framework.<n>We demonstrate effective sim-to-real transfer, ensuring that trained policies generalize well to real-world aquatic conditions.
  arXiv  Detail & Related papers  (2025-04-25T10:56:56Z)
• Using Reinforcement Learning to Integrate Subjective Wellbeing into Climate Adaptation Decision Making [3.3024854970378317]
  We propose a multi-modular framework that uses reinforcement learning as a decision-support tool for climate adaptation in Copenhagen.<n>Our framework integrates four interconnected components: long-term rainfall projections, flood modeling, transport accessibility, and wellbeing modeling.
  arXiv  Detail & Related papers  (2025-04-14T09:34:12Z)
• Climate Adaptation with Reinforcement Learning: Experiments with Flooding and Transportation in Copenhagen [3.4447242282168777]
  Floods damage transport infrastructure and disrupt mobility, highlighting the need for cities to adapt to escalating risks.<n>In this study, we leverageReinforcement learning (RL) to identify the most effective timing and locations for implementing measures.<n>Our framework integrates climate change projections of future rainfall events and floods, models city-wide motorized trips, and quantifies direct and indirect impacts on infrastructure and mobility.
  arXiv  Detail & Related papers  (2024-09-27T09:18:57Z)
• Multi-scale Digital Twin: Developing a fast and physics-informed surrogate model for groundwater contamination with uncertain climate models [53.44486283038738]
  Climate change exacerbates the long-term soil management problem of groundwater contamination. We develop a physics-informed machine learning surrogate model using U-Net enhanced Fourier Neural Contaminated (PDENO) In parallel, we develop a convolutional autoencoder combined with climate data to reduce the dimensionality of climatic region similarities across the United States.
  arXiv  Detail & Related papers  (2022-11-20T06:46:35Z)
• A Bibliometric Analysis and Review on Reinforcement Learning for Transportation Applications [43.356096302298056]
  Transportation is the backbone of the economy and urban development. Reinforcement Learning (RL) that enables autonomous decision-makers to interact with the complex environment. This paper conducts a bibliometric analysis to identify the development of RL-based methods for transportation applications.
  arXiv  Detail & Related papers  (2022-10-26T07:34:51Z)
• Cautious Adaptation For Reinforcement Learning in Safety-Critical Settings [129.80279257258098]
  Reinforcement learning (RL) in real-world safety-critical target settings like urban driving is hazardous. We propose a "safety-critical adaptation" task setting: an agent first trains in non-safety-critical "source" environments. We propose a solution approach, CARL, that builds on the intuition that prior experience in diverse environments equips an agent to estimate risk.
  arXiv  Detail & Related papers  (2020-08-15T01:40:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.