Transparent AI for Mathematics: Transformer-Based Large Language Models for Mathematical Entity Relationship Extraction with XAI

• URL: http://arxiv.org/abs/2603.06348v1
• Date: Fri, 06 Mar 2026 14:50:08 GMT
• Title: Transparent AI for Mathematics: Transformer-Based Large Language Models for Mathematical Entity Relationship Extraction with XAI
• Abstract summary: This study formulates mathematical problem interpretation as a Mathematical Entity Relation Extraction task.<n>Transformer-based models are applied to automatically extract these relations from mathematical text.<n>Bidirectional Representations from Transformers (BERT) achieves the best performance, reaching an accuracy of 99.39%.
• Score: 1.5229257192293202
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Mathematical text understanding is a challenging task due to the presence of specialized entities and complex relationships between them. This study formulates mathematical problem interpretation as a Mathematical Entity Relation Extraction (MERE) task, where operands are treated as entities and operators as their relationships. Transformer-based models are applied to automatically extract these relations from mathematical text, with Bidirectional Encoder Representations from Transformers (BERT) achieving the best performance, reaching an accuracy of 99.39%. To enhance transparency and trust in the model's predictions, Explainable Artificial Intelligence (XAI) is incorporated using Shapley Additive Explanations (SHAP). The explainability analysis reveals how specific textual and mathematical features influence relation prediction, providing insights into feature importance and model behavior. By combining transformer-based learning, a task-specific dataset, and explainable modeling, this work offers an effective and interpretable framework for MERE, supporting future applications in automated problem solving, knowledge graph construction, and intelligent educational systems.

Related papers

• Self-explainable Operator Learning for Discovering Spatial Patterns in Functional Data [0.24554686192257422]
  Operator learning has emerged as a powerful tool for modeling complex physical systems in functional spaces.<n>We introduce a self-explainable operator learning framework that overcomes this challenge by reformulating operator learning as a linear combination of generalized functional linear models.<n>We demonstrate the framework on function-to-scalar and function-to-function mappings in fluid flow problems involving blood flow and unsteady aerodynamics.
  arXiv  Detail & Related papers  (2026-07-02T14:11:20Z)
• Open Mathematical Tasks as a Didactic Response to Generative Artificial Intelligence in Post-AI Contexts [0.0]
  This study analyzes a secondary school classroom experience in which open mathematical tasks are implemented as a didactic response to this scenario.<n>The analysis is structured around four analytical axes: open task design in post-AI contexts, students' mathematical agency, human-AI complementarity, and modeling and validation practices.
  arXiv  Detail & Related papers  (2026-02-09T22:16:04Z)
• VEHME: A Vision-Language Model For Evaluating Handwritten Mathematics Expressions [11.210768330027674]
  We introduce VEHME-a Vision-Language Model for evaluating handwritten math responses with high accuracy and interpretable reasoning traces.<n> VEHME integrates a two-phase training pipeline: (i) supervised fine-tuning using structured reasoning data, and (ii) reinforcement learning that aligns model outputs with multi-dimensional grading objectives.<n> VEHME achieves state-of-the-art performance among open-source models and approaches the accuracy of proprietary systems.
  arXiv  Detail & Related papers  (2025-10-26T19:03:27Z)
• Mathematical artificial data for operator learning [1.4579344926652846]
  We present the Mathematical Artificial Data (MAD) framework, a new paradigm that integrates physical laws with data-driven learning to facilitate large-scale operator discovery.<n>We show MAD's generalizability and superior efficiency/accuracy across various differential equations scenarios.
  arXiv  Detail & Related papers  (2025-07-09T11:23:05Z)
• Operator Learning: A Statistical Perspective [17.98959620987217]
  Operator learning has emerged as a powerful tool in scientific computing for approximating mappings between infinite-dimensional function spaces.<n>We begin by formalizing operator learning as a function-to-function regression problem and review some recent developments in the field.<n>We also discuss strategies for incorporating physical and mathematical constraints into architecture design and training processes.
  arXiv  Detail & Related papers  (2025-04-04T14:58:45Z)
• MathFusion: Enhancing Mathematical Problem-solving of LLM through Instruction Fusion [48.443460251524776]
  MathFusion is a novel framework that enhances mathematical reasoning through cross-problem instruction synthesis.<n>MathFusion achieves substantial improvements in mathematical reasoning while maintaining high data efficiency.
  arXiv  Detail & Related papers  (2025-03-20T15:00:41Z)
• Bridging Visualization and Optimization: Multimodal Large Language Models on Graph-Structured Combinatorial Optimization [56.17811386955609]
  Graph-structured challenges are inherently difficult due to their nonlinear and intricate nature.<n>In this study, we propose transforming graphs into images to preserve their higher-order structural features accurately.<n>By combining the innovative paradigm powered by multimodal large language models with simple search techniques, we aim to develop a novel and effective framework.
  arXiv  Detail & Related papers  (2025-01-21T08:28:10Z)
• Explaining Text Similarity in Transformer Models [52.571158418102584]
  Recent advances in explainable AI have made it possible to mitigate limitations by leveraging improved explanations for Transformers. We use BiLRP, an extension developed for computing second-order explanations in bilinear similarity models, to investigate which feature interactions drive similarity in NLP models. Our findings contribute to a deeper understanding of different semantic similarity tasks and models, highlighting how novel explainable AI methods enable in-depth analyses and corpus-level insights.
  arXiv  Detail & Related papers  (2024-05-10T17:11:31Z)
• A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis [128.0532113800092]
  We present a mechanistic interpretation of Transformer-based LMs on arithmetic questions. This provides insights into how information related to arithmetic is processed by LMs.
  arXiv  Detail & Related papers  (2023-05-24T11:43:47Z)
• Model-agnostic multi-objective approach for the evolutionary discovery of mathematical models [55.41644538483948]
  In modern data science, it is more interesting to understand the properties of the model, which parts could be replaced to obtain better results. We use multi-objective evolutionary optimization for composite data-driven model learning to obtain the algorithm's desired properties.
  arXiv  Detail & Related papers  (2021-07-07T11:17:09Z)
• Rational Shapley Values [0.0]
  Most popular tools for post-hoc explainable artificial intelligence (XAI) are either insensitive to context or difficult to summarize. I introduce emphrational Shapley values, a novel XAI method that synthesizes and extends these seemingly incompatible approaches. I leverage tools from decision theory and causal modeling to formalize and implement a pragmatic approach that resolves a number of known challenges in XAI.
  arXiv  Detail & Related papers  (2021-06-18T15:45:21Z)
• Counterfactual Explanations as Interventions in Latent Space [62.997667081978825]
  Counterfactual explanations aim to provide to end users a set of features that need to be changed in order to achieve a desired outcome. Current approaches rarely take into account the feasibility of actions needed to achieve the proposed explanations. We present Counterfactual Explanations as Interventions in Latent Space (CEILS), a methodology to generate counterfactual explanations.
  arXiv  Detail & Related papers  (2021-06-14T20:48:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.