MoCA-Agent: A Market-of-Claims Code Agent for Financial and Numerical Reasoning
- URL: http://arxiv.org/abs/2606.11537v2
- Date: Wed, 17 Jun 2026 21:27:59 GMT
- Title: MoCA-Agent: A Market-of-Claims Code Agent for Financial and Numerical Reasoning
- Abstract summary: textscMOCA-Agent is a market-of-claims code agent that replaces free-form multi-agent debate with claim-level verification.<n>The system decomposes each question into typed atomic claims, asks specialist trader agents to buy or sell those claims, clears their orders into confidence-weighted accept/reject decisions.<n>A code-aware verifier then checks the program for execution, structural consistency, and common financial reasoning errors.
- Score: 47.751319722749116
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Financial and tabular question answering requires more than fluent reasoning: answers must be grounded in the exact facts, formulas, units, signs, and scales that support them. A single misread cell or incorrect operation can silently produce a plausible but wrong result. We introduce \textsc{MOCA-Agent}, a market-of-claims code agent that replaces free-form multi-agent debate with claim-level verification. The system decomposes each question into typed atomic claims, asks specialist trader agents to buy or sell those claims, clears their orders into confidence-weighted accept/reject decisions, and synthesizes an executable Python program from market-supported evidence. A code-aware verifier then checks the program for execution, structural consistency, and common financial reasoning errors, with at most one market-aware repair round. Across ten public benchmarks spanning financial numerical reasoning, general tabular reasoning, ESG question answering, and multimodal chart reasoning, \textsc{MOCA-Agent} achieves strong performance using a fixed Qwen3.6-27B backbone, including $78.3\%$ on FinQA, $76.0\%$ on FinanceMath, $71.2\%$ on MultiHiertt, $86.9\%$ on ESGenius, and $85.6\%$ average on FinChart-Bench. These results show that aggregating evidence at the level of atomic claims, rather than whole answers, improves robustness in high-stakes numerical reasoning.\footnote{The code and data are available: https://github.com/UBC-NLP/MoCA-Agent.
Related papers
- Codebook Agent: Amortized Topology Design for LLM Multi-Agent Systems [67.04448659688579]
We develop a query-independent 16-entry codebook that ranks the top decoded candidates in a single batched forward pass.<n>With no iterative search and no message passing at test time, Codebook Agent is the most accurate method on all six benchmarks.
arXiv Detail & Related papers (2026-09-02T08:10:22Z) - RusFinChain: A Russian Benchmark for Verifiable Chain-of-Thought Reasoning in Finance with Fuzzy-Aligned Evaluation [0.0]
RusFinChain is the first Russian-language symbolic benchmark for verifiable Chain-of-Thought (CoT) reasoning in finance.<n>It spans 17 domains, 172 topics, and comprises 5,280 parameterized examples from Python, ensuring contamination-free evaluation.<n>Results reveal a substantial reasoning gap: models achieve Hard F1 of 0.65 for step alignment, but only 29% of final answers are correct.
arXiv Detail & Related papers (2026-07-01T18:48:05Z) - OpenBioRQ: Unsolved Biomedical Research Questions for Agents [2.3677513428867614]
I introduce textopenbiorq, a benchmark for unsolved biomedical research questions.<n>This is the first benchmark to combine an agentic setting -- where the model must issue multiple tool calls -- with unsolved questions that have no answer key.<n>I observe agentic collapse on the hardest questions, where agents stop using their tools.
arXiv Detail & Related papers (2026-06-20T09:16:15Z) - AgentFinVQA: A Deployable Multi-Agent Pipeline for Auditable Financial Chart QA [7.135926644099901]
We present AgentFinVQA, a multi-agent pipeline that decomposes each query into planning, OCR, legend grounding, visual inspection, and verification.<n>On FinMME, AgentFinVQA improves $+7.68$ pp over a primary-backbone matched zero-shot baseline with a proprietary backbone.<n>Error analysis shows that question misunderstanding, legend confusion and extraction error account for nearly two-thirds of failures.
arXiv Detail & Related papers (2026-06-18T04:33:07Z) - TensorBench: Benchmarking Coding Agents on a Compiler-Based Tensor Framework [0.9012337166501982]
CohenBench is a benchmark for tasks on an open-source compiler-based framework.<n>It grades each run by applying the agent's patch and running the framework's test suite.<n>We evaluate seven coding agents spanning three frontier model families and one open-weight model.
arXiv Detail & Related papers (2026-06-04T01:42:40Z) - Scaling Laws for Agent Harnesses via Effective Feedback Compute [53.68149869349268]
emphEffective Feedback Compute (EFC) is a trace-level scaling coordinate that credits feedback only when it is informative, valid, non-redundant, and retained for subsequent decisions.<n>EFC-based coordinates consistently predict failure rates better than raw-compute baselines.
arXiv Detail & Related papers (2026-05-28T09:45:47Z) - Verus-SpecGym: An Agentic Environment for Evaluating Specification Autoformalization [26.123396123145415]
We study specification autoformalization: whether LLM agents can translate informal programming problems into faithful formal specifications.<n>We introduce Verus-SpecBench, a benchmark of 581 spec-writing tasks derived from Codeforces problems.<n>Our analysis of failure modes shows that model-generated specs can accept important input assumptions, accept incorrect outputs, & reject valid ones.
arXiv Detail & Related papers (2026-05-26T02:12:48Z) - Agentic Retrieval-Augmented Generation for Financial Document Question Answering [7.56842616602779]
FinAgent-RAG is an agentic RAG framework that orchestrates iterative retrieval-reasoning loops with self-verification.<n>It integrates a Contrastive Financial Retriever trained with hard negative mining to distinguish semantically similar but numerically distinct financial passages.<n>It achieves 76.81%, 78.46%, and 74.96% execution accuracy respectively, outperforming the strongest baseline by 5.62--9.32 percentage points.
arXiv Detail & Related papers (2026-05-06T19:59:51Z) - Time Series Augmented Generation for Financial Applications [0.10499611180329804]
We introduce a novel evaluation methodology and benchmark designed to rigorously measure an agent's reasoning for financial time-series analysis.<n>We apply this methodology in a large-scale empirical study using our framework, Time Series Augmented Generation.<n>The results demonstrate that capable agents can achieve near-perfect tool-use accuracy with minimal hallucination.
arXiv Detail & Related papers (2026-04-21T16:20:59Z) - Agent Q-Mix: Selecting the Right Action for LLM Multi-Agent Systems through Reinforcement Learning [68.85408801740228]
We propose textbfAgent Q-Mix, a reinforcement learning framework that reformulates topology selection as a cooperative Multi-Agent Reinforcement Learning problem.<n>Our method learns decentralized communication decisions using Qmix value factorization, where each agent selects from a set of communication actions that jointly induce a round-wise communication graph.<n>Agent Q-Mix achieves the highest average accuracy compared to existing methods while demonstrating superior token efficiency and robustness against agent failure.
arXiv Detail & Related papers (2026-04-01T00:38:24Z) - Omanic: Towards Step-wise Evaluation of Multi-hop Reasoning in Large Language Models [60.418191092851636]
Omanic is an open-domain multi-hop QA resource that provides decomposed sub-questions and intermediate answers as structural annotations for analyzing reasoning processes.<n>It contains 10,296 machine-generated training examples (Omanic Synth) and 967 expert-reviewed human-annotated evaluation examples (OmanicBench)
arXiv Detail & Related papers (2026-03-17T15:23:37Z) - Eigen-1: Adaptive Multi-Agent Refinement with Monitor-Based RAG for Scientific Reasoning [53.45095336430027]
We develop a unified framework that combines implicit retrieval and structured collaboration.<n>On Humanity's Last Exam (HLE) Bio/Chem Gold, our framework achieves 48.3% accuracy.<n>Results on SuperGPQA and TRQA confirm robustness across domains.
arXiv Detail & Related papers (2025-09-25T14:05:55Z) - FLARE: Faithful Logic-Aided Reasoning and Exploration [47.46564769245296]
We introduce a novel approach for traversing the problem space using task decompositions.<n>We use the Large Language Models to plan a solution, soft-formalise the query into facts and predicates using a logic programming code.<n>Our method allows us to compute the faithfulness of the reasoning process w.r.t. the generated code and analyse the steps of the multi-hop search without relying on external solvers.
arXiv Detail & Related papers (2024-10-14T19:39:11Z) - DCR: Divide-and-Conquer Reasoning for Multi-choice Question Answering with LLMs [9.561022942046279]
We propose Divide and Conquer Reasoning (DCR) to enhance the reasoning capability of large language models (LLMs)
We first categorize questions into two subsets based on confidence score ($mathcalCS$), which is estimated by statistical frequency of generated answers.
In particular, we first categorize questions into two subsets based on confidence score ($mathcalCS$), which is estimated by statistical frequency of generated answers.
arXiv Detail & Related papers (2024-01-10T14:38:46Z) - FinanceBench: A New Benchmark for Financial Question Answering [28.865821741574237]
FinanceBench is a first-of-its-kind test suite for evaluating the performance of LLMs on open book financial question answering (QA)
It comprises 10,231 questions about publicly traded companies, with corresponding answers and evidence strings.
We test 16 state of the art model configurations on a sample of 150 cases from FinanceBench, and manually review their answers.
arXiv Detail & Related papers (2023-11-20T17:28:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.