Scientific Claim-Source Retrieval Revisited: A Comparative Study of Style Transfer and Re-Ranking

• URL: http://arxiv.org/abs/2607.15875v1
• Date: Fri, 17 Jul 2026 11:43:37 GMT
• Title: Scientific Claim-Source Retrieval Revisited: A Comparative Study of Style Transfer and Re-Ranking
• Abstract summary: We present a comparative study of scientific claim-source retrieval on the CheckThat! 2026 benchmark.<n>Our results show that translating claims into English outperforms both original and bilingual claim representations.<n>We introduce three novel re-ranking models based on attribution, entity overlap, and verification-based reasoning.
• Score: 17.04255262988263
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Scientific claims shared on social media are often difficult to verify and may contribute to the spread of misinformation. To address this challenge, automated fact verification systems require scientific claim-source retrieval, the task of identifying the source publication underlying a given claim. However, claims often differ substantially from their source publications in language, style, and specificity, making retrieval challenging. We present a comparative study of scientific claim-source retrieval on the CheckThat! 2026 benchmark across sparse and dense retrieval models. Our results show that translating claims into English outperforms both original and bilingual claim representations, while incorporating publication metadata provides additional retrieval gains by capturing indirect source references. In addition, we analyze four style transfer approaches and find that they improve retrieval performance for most models, although the optimal style depends on the underlying retrieval objective. Finally, we investigate similarity- and signal-based re-ranking approaches, introducing three novel re-ranking models based on attribution, entity overlap, and verification-based reasoning. Verification-based re-ranking yields additional gains beyond semantic similarity and achieves the best overall performance with an MRR@5 of 0.758.

Related papers

• Claim2Source at CheckThat! 2026: Improving Multilingual Scientific Claim-Source Retrieval with Verification-based Re-Ranking [17.04255262988263]
  We propose a multi-stage retrieval framework for multilingual scientific claim-source retrieval.<n>The framework employs bilingual claim representations, metadata-enhanced source representations, and language-specific adaptation of dense retrieval models.<n>Our approach achieves an average MRR@5 score of 0.7628 across English, German, and French claims, ranking first on the CheckThat! 2026 leaderboard.
  arXiv  Detail & Related papers  (2026-07-04T22:07:23Z)
• Extending AI for Research to the Humanities: A Multi-Agent Framework for Evidence-Grounded Scholarship [16.735903349022777]
  SPIRE (Scholarly-Primitives-Inspired Research Engine) is a multi-agent framework for evidence-grounded humanities scholarship.<n>It casts recurring humanities operations as cooperating agent roles over a multi-scale close-reading substrate.<n>It receives higher blind-judge scores on answer accuracy, depth, coverage, and evidence quality.
  arXiv  Detail & Related papers  (2026-05-29T07:33:29Z)
• MeVer at CheckThat! 2026: Cluster-Aware Hard-Negative Mining for Multilingual Scientific-Source Retrieval [11.097006771680896]
  We present our submission to CheckThat! 2026 Task 1 on multilingual scientific-source retrieval.<n>We propose cluster-aware hard-negative mining strategies that exploit the semantic structure of retrieved candidate pools.<n>Our experiments show that different hard-negative structures induce different retrieval behaviors.
  arXiv  Detail & Related papers  (2026-05-22T21:24:14Z)
• Combining Trained Models in Reinforcement Learning [0.0]
  Deep reinforcement learning (DRL) has delivered strong results in domains such as Atari and Go, but it still suffers from high sample cost and weak transfer beyond the training setting.<n>A common response is to reuse information from previously trained models through transfer, distillation, ensemble methods, or federated training.<n>This paper presents a PRISMA-guided systematic review of empirical studies on pretrained knowledge reuse in DRL.
  arXiv  Detail & Related papers  (2026-05-04T02:37:55Z)
• Leveraging LLM Parametric Knowledge for Fact Checking without Retrieval [60.25608870901428]
  Trustworthiness is a core research challenge for agentic AI systems built on Large Language Models (LLMs)<n>We propose the task of fact-checking without retrieval, focusing on the verification of arbitrary natural language claims, independent of their source robustness.
  arXiv  Detail & Related papers  (2026-03-05T18:42:51Z)
• Rethinking On-policy Optimization for Query Augmentation [49.87723664806526]
  We present the first systematic comparison of prompting-based and RL-based query augmentation across diverse benchmarks.<n>We introduce a novel hybrid method, On-policy Pseudo-document Query Expansion (OPQE), which learns to generate a pseudo-document that maximizes retrieval performance.
  arXiv  Detail & Related papers  (2025-10-20T04:16:28Z)
• VeriCite: Towards Reliable Citations in Retrieval-Augmented Generation via Rigorous Verification [107.75781898355562]
  We introduce a novel framework, called VeriCite, designed to rigorously validate supporting evidence and enhance answer attribution.<n>We conduct experiments across five open-source LLMs and four datasets, demonstrating that VeriCite can significantly improve citation quality while maintaining the correctness of the answers.
  arXiv  Detail & Related papers  (2025-10-13T13:38:54Z)
• Improving Document Retrieval Coherence for Semantically Equivalent Queries [63.97649988164166]
  We propose a variation of the Multi-Negative Ranking loss for training DR that improves the coherence of models in retrieving the same documents.<n>The loss penalizes discrepancies between the top-k ranked documents retrieved for diverse but semantic equivalent queries.
  arXiv  Detail & Related papers  (2025-08-11T13:34:59Z)
• Unsupervised dense retrieval with conterfactual contrastive learning [16.679649921935482]
  We propose to improve the robustness of dense retrieval models by enhancing their sensitivity of fine-graned relevance signals.<n>A model achieving sensitivity in this context should exhibit high variances when documents' key passages determining their relevance to queries have been modified.<n>Motivated by causality and counterfactual analysis, we propose a series of counterfactual regularization methods.
  arXiv  Detail & Related papers  (2024-12-30T07:01:34Z)
• JudgeRank: Leveraging Large Language Models for Reasoning-Intensive Reranking [81.88787401178378]
  We introduce JudgeRank, a novel agentic reranker that emulates human cognitive processes when assessing document relevance. We evaluate JudgeRank on the reasoning-intensive BRIGHT benchmark, demonstrating substantial performance improvements over first-stage retrieval methods. In addition, JudgeRank performs on par with fine-tuned state-of-the-art rerankers on the popular BEIR benchmark, validating its zero-shot generalization capability.
  arXiv  Detail & Related papers  (2024-10-31T18:43:12Z)
• AmbiFC: Fact-Checking Ambiguous Claims with Evidence [57.7091560922174]
  We present AmbiFC, a fact-checking dataset with 10k claims derived from real-world information needs. We analyze disagreements arising from ambiguity when comparing claims against evidence in AmbiFC. We develop models for predicting veracity handling this ambiguity via soft labels.
  arXiv  Detail & Related papers  (2021-04-01T17:40:08Z)
• Generating Fact Checking Explanations [52.879658637466605]
  A crucial piece of the puzzle that is still missing is to understand how to automate the most elaborate part of the process. This paper provides the first study of how these explanations can be generated automatically based on available claim context. Our results indicate that optimising both objectives at the same time, rather than training them separately, improves the performance of a fact checking system.
  arXiv  Detail & Related papers  (2020-04-13T05:23:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.