FinVet: A Collaborative Framework of RAG and External Fact-Checking Agents for Financial Misinformation Detection

• URL: http://arxiv.org/abs/2510.11654v1
• Date: Mon, 13 Oct 2025 17:31:49 GMT
• Title: FinVet: A Collaborative Framework of RAG and External Fact-Checking Agents for Financial Misinformation Detection
• Abstract summary: FinVet is a novel framework that integrates two Retrieval-Augmented Generation pipelines with external fact-checking.<n>It provides evidence-backed verdicts, source attribution, confidence scores, and explicit uncertainty flags when evidence is insufficient.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Financial markets face growing threats from misinformation that can trigger billions in losses in minutes. Most existing approaches lack transparency in their decision-making and provide limited attribution to credible sources. We introduce FinVet, a novel multi-agent framework that integrates two Retrieval-Augmented Generation (RAG) pipelines with external fact-checking through a confidence-weighted voting mechanism. FinVet employs adaptive three-tier processing that dynamically adjusts verification strategies based on retrieval confidence, from direct metadata extraction to hybrid reasoning to full model-based analysis. Unlike existing methods, FinVet provides evidence-backed verdicts, source attribution, confidence scores, and explicit uncertainty flags when evidence is insufficient. Experimental evaluation on the FinFact dataset shows that FinVet achieves an F1 score of 0.85, which is a 10.4% improvement over the best individual pipeline (fact-check pipeline) and 37% improvement over standalone RAG approaches.

Related papers

• E2A-Bench: Benchmarking Evidence-to-Action Reliability in Financial Chart Reasoning [3.81869701471217]
  We introduce E2A-Bench, a benchmark for financial chart reasoning, constructed from 323 HS300 constituents.<n>E2A-Bench evaluates grounding, reasoning-action consistency, evidence-confidence calibration, and directional coverage.<n>We show that financial VLM evaluation should trace the full evidence-to-action chain rather than rely on a single hallucination score.
  arXiv  Detail & Related papers  (2026-09-13T05:50:05Z)
• RA-FinBERT: Rule-aware LoRA adaptation for low-resource financial sentiment classification [8.831449509561043]
  Rule-Aware FinBERT (RA-FinBERT) is a framework that integrates low-rank adaptation (LoRA) with three continuous VADER-derived sentiment proportions.<n> RA-FinBERT achieved 69.89% accuracy and a macro F1 score of 0.634, compared with 63.44% and 0.526 for text-only FinBERT.
  arXiv  Detail & Related papers  (2026-08-10T16:52:19Z)
• DFAH-Bench: Benchmarking Observable Agent Instability in Financial Decision-Making [0.7699235580548228]
  DFAH-Bench is a replay benchmark that measures observable behavioral instability in financial agent decision-making.<n>We find that frontier models can agree on decisions 95% of the time while following the same tool path only 77% of the time.<n>We identify three behavioral profiles: pattern matchers that achieve near-perfect agreement by collapsing to a single output regardless of input, stable executors with relatively consistent tool-use processes, and trajectory divergers that reach the same conclusions through materially different tool paths and evidence contacts.
  arXiv  Detail & Related papers  (2026-06-10T03:31:09Z)
• Agentic Retrieval-Augmented Generation for Financial Document Question Answering [7.56842616602779]
  FinAgent-RAG is an agentic RAG framework that orchestrates iterative retrieval-reasoning loops with self-verification.<n>It integrates a Contrastive Financial Retriever trained with hard negative mining to distinguish semantically similar but numerically distinct financial passages.<n>It achieves 76.81%, 78.46%, and 74.96% execution accuracy respectively, outperforming the strongest baseline by 5.62--9.32 percentage points.
  arXiv  Detail & Related papers  (2026-05-06T19:59:51Z)
• Claw-Eval: Toward Trustworthy Evaluation of Autonomous Agents [66.97968363332465]
  We introduce Claw-Eval, an end-to-end evaluation suite addressing all three gaps in agent benchmarks.<n>Claw-Eval comprises 300 human-verified tasks spanning 9 categories across three groups.<n>Every agent action is recorded through three independent evidence channels.
  arXiv  Detail & Related papers  (2026-04-07T17:43:18Z)
• OPV: Outcome-based Process Verifier for Efficient Long Chain-of-Thought Verification [91.15649744496834]
  We propose the Outcome-based Process Verifier (OPV), which verifies the rationale process of summarized outcomes from long chains of thought.<n>OPV achieves new state-of-the-art results on our held-out OPV-Bench, outperforming much larger open-source models such as Qwen3-Max-Preview with an F1 score of 83.1 compared to 76.3.
  arXiv  Detail & Related papers  (2025-12-11T15:47:38Z)
• FinReflectKG - EvalBench: Benchmarking Financial KG with Multi-Dimensional Evaluation [0.0]
  FinReflectKG - EvalBench is a benchmark and evaluation framework for financial knowledge graphs.<n>It links audited triples to source chunks from S&P 100 filings and supports single-pass, multi-pass, and reflection-agent-based extraction modes.<n>Our findings suggest that, when equipped with explicit bias controls, LLM-as-Judge protocols provide a reliable and cost-efficient alternative to human annotation.
  arXiv  Detail & Related papers  (2025-10-07T09:22:48Z)
• Eigen-1: Adaptive Multi-Agent Refinement with Monitor-Based RAG for Scientific Reasoning [53.45095336430027]
  We develop a unified framework that combines implicit retrieval and structured collaboration.<n>On Humanity's Last Exam (HLE) Bio/Chem Gold, our framework achieves 48.3% accuracy.<n>Results on SuperGPQA and TRQA confirm robustness across domains.
  arXiv  Detail & Related papers  (2025-09-25T14:05:55Z)
• ViFP: A Framework for Visual False Positive Detection to Enhance Reasoning Reliability in VLMs [10.920311878186483]
  We propose ViFP, a framework for Visual False Positive Detection to enhance reasoning reliability in vision-language models.<n>ViFP builds effective reasoning paths through multi-turn QA and dynamically analyzes the consistency of the reasoning path.<n>It also introduces a targeted reasoning chain correction mechanism to modify FP reasoning, thereby improving logical consistency and accuracy.
  arXiv  Detail & Related papers  (2025-08-06T08:31:11Z)
• FinChain: A Symbolic Benchmark for Verifiable Chain-of-Thought Financial Reasoning [82.7292329605713]
  FinChain is the first benchmark specifically designed for verifiable Chain-of-Thought evaluation in finance.<n>It spans 58 topics across 12 financial domains, each represented by parameterized symbolic templates with executable Python traces.<n>FinChain exposes persistent weaknesses in multi-step financial reasoning and provides a foundation for developing trustworthy, interpretable, and verifiable financial AI.
  arXiv  Detail & Related papers  (2025-06-03T06:44:42Z)
• VAPO: Efficient and Reliable Reinforcement Learning for Advanced Reasoning Tasks [49.0793012627959]
  We present VAPO, a novel framework tailored for reasoning models within the value-based paradigm.<n>VAPO attains a state-of-the-art score of $mathbf60.4$.<n>In direct comparison under identical experimental settings, VAPO outperforms the previously reported results of DeepSeek-R1-Zero-Qwen-32B and DAPO by more than 10 points.
  arXiv  Detail & Related papers  (2025-04-07T14:21:11Z)
• FinTSB: A Comprehensive and Practical Benchmark for Financial Time Series Forecasting [58.70072722290475]
  Financial time series (FinTS) record the behavior of human-brain-augmented decision-making.<n>FinTSB is a comprehensive and practical benchmark for financial time series forecasting.
  arXiv  Detail & Related papers  (2025-02-26T05:19:16Z)
• Fino1: On the Transferability of Reasoning-Enhanced LLMs and Reinforcement Learning to Finance [35.617409883103335]
  FinReason is the first financial reasoning benchmark covering multi-table analysis, long-context reasoning, and equation-based tasks.<n>We introduce FinCoT, the first open high-fidelity CoT corpus for finance, distilled from seven QA datasets.<n>We develop Fin-o1, the first open financial reasoning models trained via supervised fine-tuning and GRPO-based RL.
  arXiv  Detail & Related papers  (2025-02-12T05:13:04Z)
• Measuring Consistency in Text-based Financial Forecasting Models [10.339586273664725]
  FinTrust is an evaluation tool that assesses logical consistency in financial text. We show that the consistency of state-of-the-art NLP models for financial forecasting is poor. Our analysis of the performance degradation caused by meaning-preserving alternations suggests that current text-based methods are not suitable for robustly predicting market information.
  arXiv  Detail & Related papers  (2023-05-15T10:32:26Z)
• Fact Checking with Insufficient Evidence [52.879658637466605]
  We study what information fact checking models consider sufficient by introducing a novel task and advancing it with three main contributions. We identify when models consider the remaining evidence (in)sufficient for FC, based on three trained models with different Transformer architectures. Second, we ask annotators whether the omitted evidence was important for FC, resulting in a novel diagnostic dataset, SufficientFacts, for FC with omitted evidence.
  arXiv  Detail & Related papers  (2022-04-05T06:12:42Z)
• DeepTrust: A Reliable Financial Knowledge Retrieval Framework For Explaining Extreme Pricing Anomalies [0.0]
  We introduce DeepTrust, a reliable financial knowledge retrieval framework on Twitter to explain extreme price moves at speed. Our proposed framework consists of three modules, specialized for anomaly detection, information retrieval and reliability assessment. The framework is evaluated on two self-annotated financial anomalies, i.e., Twitter and Facebook stock price on 29 and 30 April 2021.
  arXiv  Detail & Related papers  (2022-03-11T06:29:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.