A deep reinforcement learning model for predictive maintenance planning
of road assets: Integrating LCA and LCCA
- URL: http://arxiv.org/abs/2112.12589v3
- Date: Mon, 27 Nov 2023 18:29:31 GMT
- Title: A deep reinforcement learning model for predictive maintenance planning
of road assets: Integrating LCA and LCCA
- Authors: Moein Latifi, Fateme Golivand Darvishvand, Omid Khandel, Mobin Latifi
Nowsoud
- Abstract summary: This research proposes a framework using Reinforcement Learning (RL) to determine type and timing of M&R practices.
The results propose a 20-year M&R plan in which road condition remains in an excellent condition range.
Decision-makers and transportation agencies can use this scheme to conduct better maintenance practices that can prevent budget waste and minimize the environmental impacts.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Road maintenance planning is an integral part of road asset management. One
of the main challenges in Maintenance and Rehabilitation (M&R) practices is to
determine maintenance type and timing. This research proposes a framework using
Reinforcement Learning (RL) based on the Long Term Pavement Performance (LTPP)
database to determine the type and timing of M&R practices. A predictive DNN
model is first developed in the proposed algorithm, which serves as the
Environment for the RL algorithm. For the Policy estimation of the RL model,
both DQN and PPO models are developed. However, PPO has been selected in the
end due to better convergence and higher sample efficiency. Indicators used in
this study are International Roughness Index (IRI) and Rutting Depth (RD).
Initially, we considered Cracking Metric (CM) as the third indicator, but it
was then excluded due to the much fewer data compared to other indicators,
which resulted in lower accuracy of the results. Furthermore, in
cost-effectiveness calculation (reward), we considered both the economic and
environmental impacts of M&R treatments. Costs and environmental impacts have
been evaluated with paLATE 2.0 software. Our method is tested on a hypothetical
case study of a six-lane highway with 23 kilometers length located in Texas,
which has a warm and wet climate. The results propose a 20-year M&R plan in
which road condition remains in an excellent condition range. Because the early
state of the road is at a good level of service, there is no need for heavy
maintenance practices in the first years. Later, after heavy M&R actions, there
are several 1-2 years of no need for treatments. All of these show that the
proposed plan has a logical result. Decision-makers and transportation agencies
can use this scheme to conduct better maintenance practices that can prevent
budget waste and, at the same time, minimize the environmental impacts.
Related papers
- Data-efficient Deep Reinforcement Learning for Vehicle Trajectory
Control [6.144517901919656]
Reinforcement learning (RL) promises to achieve control performance superior to classical approaches.
Standard RL approaches like soft-actor critic (SAC) require extensive amounts of training data to be collected.
We apply recently developed data-efficient deep RL methods to vehicle trajectory control.
arXiv Detail & Related papers (2023-11-30T09:38:59Z) - A Survey on Service Route and Time Prediction in Instant Delivery:
Taxonomy, Progress, and Prospects [58.746820564288846]
Route&Time Prediction (RTP) aims to estimate the future service route as well as the arrival time of a worker.
Despite a plethora of algorithms developed to date, there is no systematic, comprehensive survey to guide researchers in this domain.
We categorize these methods based on three criteria: (i) type of task, subdivided into only-route prediction, only-time prediction, and joint route&time prediction; (ii) model architecture, which encompasses sequence-based and graph-based models; and (iii) learning paradigm, including Supervised Learning (SL) and Deep Reinforcement
arXiv Detail & Related papers (2023-09-03T14:43:33Z) - A Comparative Study of Machine Learning Algorithms for Anomaly Detection
in Industrial Environments: Performance and Environmental Impact [62.997667081978825]
This study seeks to address the demands of high-performance machine learning models with environmental sustainability.
Traditional machine learning algorithms, such as Decision Trees and Random Forests, demonstrate robust efficiency and performance.
However, superior outcomes were obtained with optimised configurations, albeit with a commensurate increase in resource consumption.
arXiv Detail & Related papers (2023-07-01T15:18:00Z) - Safe, Efficient, Comfort, and Energy-saving Automated Driving through
Roundabout Based on Deep Reinforcement Learning [3.4602940992970903]
Traffic scenarios in roundabouts pose substantial complexity for automated driving.
This study explores, employs, and implements various DRL algorithms to instruct automated vehicles' driving through roundabouts.
All three tested DRL algorithms succeed in enabling automated vehicles to drive through the roundabout.
arXiv Detail & Related papers (2023-06-20T11:39:55Z) - Machine learning framework for end-to-end implementation of Incident
duration prediction [0.0]
This research developed an analytical framework and end-to-end machine-learning solution for predicting incident duration based on information available as soon as an incident report is received.
The results showed that the framework significantly improved incident duration prediction compared to methods from previous research.
arXiv Detail & Related papers (2023-04-23T00:55:19Z) - Human-in-the-loop: Provably Efficient Preference-based Reinforcement
Learning with General Function Approximation [107.54516740713969]
We study human-in-the-loop reinforcement learning (RL) with trajectory preferences.
Instead of receiving a numeric reward at each step, the agent only receives preferences over trajectory pairs from a human overseer.
We propose the first optimistic model-based algorithm for PbRL with general function approximation.
arXiv Detail & Related papers (2022-05-23T09:03:24Z) - Deep reinforcement learning for optimal well control in subsurface
systems with uncertain geology [0.0]
A general control policy framework based on deep reinforcement learning (DRL) is introduced for closed-loop decision making in subsurface flow settings.
The DRL-based methodology is shown to result in an NPV increase of 15% (for the 2D cases) and 33% (3D cases) relative to robust optimization over prior models.
arXiv Detail & Related papers (2022-03-24T22:50:47Z) - Offline Reinforcement Learning for Road Traffic Control [12.251816544079306]
We build a model-based learning framework, A-DAC, which infers a Markov Decision Process (MDP) from dataset with pessimistic costs built in to deal with data uncertainties.
A-DAC is evaluated on a complex signalized roundabout using multiple datasets varying in size and in batch collection policy.
arXiv Detail & Related papers (2022-01-07T09:55:21Z) - Solving Multistage Stochastic Linear Programming via Regularized Linear
Decision Rules: An Application to Hydrothermal Dispatch Planning [77.34726150561087]
We propose a novel regularization scheme for linear decision rules (LDR) based on the AdaSO (adaptive least absolute shrinkage and selection operator)
Experiments show that the overfit threat is non-negligible when using the classical non-regularized LDR to solve MSLP.
For the LHDP problem, our analysis highlights the following benefits of the proposed framework in comparison to the non-regularized benchmark.
arXiv Detail & Related papers (2021-10-07T02:36:14Z) - Uncertainty-aware Remaining Useful Life predictor [57.74855412811814]
Remaining Useful Life (RUL) estimation is the problem of inferring how long a certain industrial asset can be expected to operate.
In this work, we consider Deep Gaussian Processes (DGPs) as possible solutions to the aforementioned limitations.
The performance of the algorithms is evaluated on the N-CMAPSS dataset from NASA for aircraft engines.
arXiv Detail & Related papers (2021-04-08T08:50:44Z) - The efficacy of Neural Planning Metrics: A meta-analysis of PKL on
nuScenes [77.83263286776938]
A high-performing object detection system plays a crucial role in autonomous driving (AD)
The performance, typically evaluated in terms of mean Average Precision, does not take into account orientation and distance of the actors in the scene.
Recently, Philion et al. proposed a neural planning metric (PKL), based on the KL divergence of a planner's trajectory and the groundtruth route.
arXiv Detail & Related papers (2020-10-19T09:32:48Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.