Explainable Reinforcement Learning on Financial Stock Trading using SHAP
- URL: http://arxiv.org/abs/2208.08790v1
- Date: Thu, 18 Aug 2022 12:03:28 GMT
- Title: Explainable Reinforcement Learning on Financial Stock Trading using SHAP
- Authors: Satyam Kumar, Mendhikar Vishal and Vadlamani Ravi
- Abstract summary: We propose to employ SHapley Additive exPlanation (SHAP) on a popular deep reinforcement learning architecture viz., deep Q network (DQN) to explain an action of an agent in financial stock trading.
To demonstrate the effectiveness of our method, we tested it on two popular datasets namely, SENSEX and DJIA, and reported the results.
- Score: 5.2725049926324745
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Explainable Artificial Intelligence (XAI) research gained prominence in
recent years in response to the demand for greater transparency and trust in AI
from the user communities. This is especially critical because AI is adopted in
sensitive fields such as finance, medicine etc., where implications for
society, ethics, and safety are immense. Following thorough systematic
evaluations, work in XAI has primarily focused on Machine Learning (ML) for
categorization, decision, or action. To the best of our knowledge, no work is
reported that offers an Explainable Reinforcement Learning (XRL) method for
trading financial stocks. In this paper, we proposed to employ SHapley Additive
exPlanation (SHAP) on a popular deep reinforcement learning architecture viz.,
deep Q network (DQN) to explain an action of an agent at a given instance in
financial stock trading. To demonstrate the effectiveness of our method, we
tested it on two popular datasets namely, SENSEX and DJIA, and reported the
results.
Related papers
- A Survey of Explainable Artificial Intelligence (XAI) in Financial Time Series Forecasting [1.2937020918620652]
The field of eXplainable AI (XAI) aims to make AI models more understandable.
This paper categorizes XAI approaches that predict financial time series.
It provides a comprehensive view of XAI's current role in finance.
arXiv Detail & Related papers (2024-07-22T17:06:19Z) - AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Framework [48.3060010653088]
We release AlphaFin datasets, combining traditional research datasets, real-time financial data, and handwritten chain-of-thought (CoT) data.
We then use AlphaFin datasets to benchmark a state-of-the-art method, called Stock-Chain, for effectively tackling the financial analysis task.
arXiv Detail & Related papers (2024-03-19T09:45:33Z) - Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era [77.174117675196]
XAI is being extended towards Large Language Models (LLMs)
This paper analyzes how XAI can benefit LLMs and AI systems.
We introduce 10 strategies, introducing the key techniques for each and discussing their associated challenges.
arXiv Detail & Related papers (2024-03-13T20:25:27Z) - Quantitative Trading using Deep Q Learning [0.0]
Reinforcement learning (RL) is a branch of machine learning that has been used in a variety of applications such as robotics, game playing, and autonomous systems.
This paper explores the use of RL in quantitative trading and presents a case study of a RL-based trading algorithm.
arXiv Detail & Related papers (2023-04-03T11:57:36Z) - Analyzing Machine Learning Models for Credit Scoring with Explainable AI
and Optimizing Investment Decisions [0.0]
This paper examines two different yet related questions related to explainable AI (XAI) practices.
The study compares various machine learning models, including single classifiers (logistic regression, decision trees, LDA, QDA), heterogeneous ensembles (AdaBoost, Random Forest), and sequential neural networks.
Two advanced post-hoc model explainability techniques - LIME and SHAP are utilized to assess ML-based credit scoring models.
arXiv Detail & Related papers (2022-09-19T21:44:42Z) - Augmented cross-selling through explainable AI -- a case from energy
retailing [0.0]
We analyze data on 220,185 customers of an energy retailer, predict cross-purchases with up to 86% correctness (AUC), and show that the XAI method SHAP provides explanations that hold for actual buyers.
We further outline implications for research in information systems, XAI, and relationship marketing.
arXiv Detail & Related papers (2022-08-24T09:51:52Z) - Collective eXplainable AI: Explaining Cooperative Strategies and Agent
Contribution in Multiagent Reinforcement Learning with Shapley Values [68.8204255655161]
This study proposes a novel approach to explain cooperative strategies in multiagent RL using Shapley values.
Results could have implications for non-discriminatory decision making, ethical and responsible AI-derived decisions or policy making under fairness constraints.
arXiv Detail & Related papers (2021-10-04T10:28:57Z) - Explainable AI in Credit Risk Management [0.0]
We implement two advanced explainability techniques called Local Interpretable Model Agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP) to machine learning (ML)-based credit scoring models.
Specifically, we use LIME to explain instances locally and SHAP to get both local and global explanations.
We discuss the results in detail and present multiple comparison scenarios by using various kernels available for explaining graphs generated using SHAP values.
arXiv Detail & Related papers (2021-03-01T12:23:20Z) - Explainability in Deep Reinforcement Learning [68.8204255655161]
We review recent works in the direction to attain Explainable Reinforcement Learning (XRL)
In critical situations where it is essential to justify and explain the agent's behaviour, better explainability and interpretability of RL models could help gain scientific insight on the inner workings of what is still considered a black box.
arXiv Detail & Related papers (2020-08-15T10:11:42Z) - Adversarial Attacks on Machine Learning Systems for High-Frequency
Trading [55.30403936506338]
We study valuation models for algorithmic trading from the perspective of adversarial machine learning.
We introduce new attacks specific to this domain with size constraints that minimize attack costs.
We discuss how these attacks can be used as an analysis tool to study and evaluate the robustness properties of financial models.
arXiv Detail & Related papers (2020-02-21T22:04:35Z) - Learning from Learning Machines: Optimisation, Rules, and Social Norms [91.3755431537592]
It appears that the area of AI that is most analogous to the behaviour of economic entities is that of morally good decision-making.
Recent successes of deep learning for AI suggest that more implicit specifications work better than explicit ones for solving such problems.
arXiv Detail & Related papers (2019-12-29T17:42:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.