NLP-based Decision Support System for Examination of Eligibility Criteria from Securities Prospectuses at the German Central Bank

• URL: http://arxiv.org/abs/2302.04562v1
• Date: Thu, 9 Feb 2023 11:00:58 GMT
• Title: NLP-based Decision Support System for Examination of Eligibility Criteria from Securities Prospectuses at the German Central Bank
• Authors: Christian H\"anig, Markus Schl\"osser, Serhii Hamotskyi, Gent Zambaku, Janek Blankenburg
• Abstract summary: The German Central Bank receives hundreds of scanned prospectuses in PDF format, which must be manually processed to decide upon their eligibility. We found that this tedious and time-consuming process can be (semi-automated) by employing modern NLP model architectures. The proposed Decision Support System provides decisions of document-level eligibility criteria accompanied by human-understandable explanations.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: As part of its digitization initiative, the German Central Bank (Deutsche Bundesbank) wants to examine the extent to which natural Language Processing (NLP) can be used to make independent decisions upon the eligibility criteria of securities prospectuses. Every month, the Directorate General Markets at the German Central Bank receives hundreds of scanned prospectuses in PDF format, which must be manually processed to decide upon their eligibility. We found that this tedious and time-consuming process can be (semi-)automated by employing modern NLP model architectures, which learn the linguistic feature representation in text to identify the present eligible and ineligible criteria. The proposed Decision Support System provides decisions of document-level eligibility criteria accompanied by human-understandable explanations of the decisions. The aim of this project is to model the described use case and to evaluate the extent to which current research results from the field of NLP can be applied to this problem. After creating a heterogeneous domain-specific dataset containing annotations of eligible and non-eligible mentions of relevant criteria, we were able to successfully build, train and deploy a semi-automatic decider model. This model is based on transformer-based language models and decision trees, which integrate the established rule-based parts of the decision processes. Results suggest that it is possible to efficiently model the problem and automate decision making to more than 90% for many of the considered eligibility criteria.

Related papers

• "A Good Bot Always Knows Its Limitations": Assessing Autonomous System Decision-making Competencies through Factorized Machine Self-confidence [5.167803438665586]
  Factorized Machine Self-confidence (FaMSeC) provides a holistic description of factors driving an algorithmic decision-making process. indicators are derived from hierarchical problem-solving statistics' embedded within broad classes of probabilistic decision-making algorithms. FaMSeC allows algorithmic goodness of fit' evaluations to be easily incorporated into the design of many kinds of autonomous agents.
  arXiv  Detail & Related papers  (2024-07-29T01:22:04Z)
• SKADA-Bench: Benchmarking Unsupervised Domain Adaptation Methods with Realistic Validation On Diverse Modalities [55.87169702896249]
  Unsupervised Domain Adaptation (DA) consists of adapting a model trained on a labeled source domain to perform well on an unlabeled target domain with some data distribution shift. We present a complete and fair evaluation of existing shallow algorithms, including reweighting, mapping, and subspace alignment. Our benchmark highlights the importance of realistic validation and provides practical guidance for real-life applications.
  arXiv  Detail & Related papers  (2024-07-16T12:52:29Z)
• Enhancing Language Model Rationality with Bi-Directional Deliberation Reasoning [73.77288647011295]
  This paper introduces BI-Directional DEliberation Reasoning (BIDDER) to enhance the decision rationality of language models. Our approach involves three key processes:. Inferring hidden states to represent uncertain information in the decision-making process from historical data;. Using hidden states to predict future potential states and potential outcomes;. Integrating historical information (past contexts) and long-term outcomes (future contexts) to inform reasoning.
  arXiv  Detail & Related papers  (2024-07-08T16:48:48Z)
• MR-Ben: A Meta-Reasoning Benchmark for Evaluating System-2 Thinking in LLMs [55.20845457594977]
  Large language models (LLMs) have shown increasing capability in problem-solving and decision-making. We present a process-based benchmark MR-Ben that demands a meta-reasoning skill. Our meta-reasoning paradigm is especially suited for system-2 slow thinking.
  arXiv  Detail & Related papers  (2024-06-20T03:50:23Z)
• A Taxonomy of Decentralized Identifier Methods for Practitioners [50.76687001060655]
  A core part of the new identity management paradigm of Self-Sovereign Identity (SSI) is the W3C Decentralized Identifiers (DIDs) standard. We propose a taxonomy of DID methods with the goal to empower practitioners to make informed decisions when selecting DID methods.
  arXiv  Detail & Related papers  (2023-10-18T13:01:40Z)
• Rational Decision-Making Agent with Internalized Utility Judgment [91.80700126895927]
  Large language models (LLMs) have demonstrated remarkable advancements and have attracted significant efforts to develop LLMs into agents capable of executing intricate multi-step decision-making tasks beyond traditional NLP applications. This paper proposes RadAgent, which fosters the development of its rationality through an iterative framework involving Experience Exploration and Utility Learning. Experimental results on the ToolBench dataset demonstrate RadAgent's superiority over baselines, achieving over 10% improvement in Pass Rate on diverse tasks.
  arXiv  Detail & Related papers  (2023-08-24T03:11:45Z)
• Natural Language in Requirements Engineering for Structure Inference -- An Integrative Review [0.0]
  The paper provides an integrative review regarding Natural Language Processing tools for Requirements Engineering. Results are that currently no open source approach exists that allows for the direct/primary extraction of information structure. An approach that allows for individual management of the algorithm, knowledge base, and text corpus is a possibility being pursued.
  arXiv  Detail & Related papers  (2022-02-10T14:46:09Z)
• CUGE: A Chinese Language Understanding and Generation Evaluation Benchmark [144.05723617401674]
  General-purpose language intelligence evaluation has been a longstanding goal for natural language processing. We argue that for general-purpose language intelligence evaluation, the benchmark itself needs to be comprehensive and systematic. We propose CUGE, a Chinese Language Understanding and Generation Evaluation benchmark with the following features.
  arXiv  Detail & Related papers  (2021-12-27T11:08:58Z)
• Desiderata for Explainable AI in statistical production systems of the European Central Bank [0.537133760455631]
  We aim to state user-centric desiderata for explainable AI reflecting common explainability needs experienced in statistical production systems of the European Central Bank. We provide two concrete use cases from the domain of statistical data production in central banks: the detection of outliers in the Centralised Securities Database and the data-driven identification of data quality checks for the Supervisory Banking data system.
  arXiv  Detail & Related papers  (2021-07-18T05:58:11Z)
• A Decision Model for Decentralized Autonomous Organization Platform Selection: Three Industry Case Studies [0.0]
  Decentralized autonomous organizations as a new form of online governance arecollections of smart contracts deployed on a blockchain platform. This study presents a decision model as a Multi-Criteria Decision-Making problem for the decentralized autonomous organization platform selection problem.
  arXiv  Detail & Related papers  (2021-07-07T10:05:56Z)
• Contestable Black Boxes [10.552465253379134]
  This paper investigates the type of assurances that are needed in the contesting process when algorithmic black-boxes are involved. We argue that specialised complementary methodologies to evaluate automated decision-making in the case of a particular decision being contested need to be developed.
  arXiv  Detail & Related papers  (2020-06-09T09:09:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.