LegalPincite: Multi-level Legal Information Retrieval Dataset

• URL: http://arxiv.org/abs/2608.03756v1
• Date: Tue, 04 Aug 2026 14:46:19 GMT
• Title: LegalPincite: Multi-level Legal Information Retrieval Dataset
• Abstract summary: We contribute a large-scale legal Information Retrieval dataset constructed from Court of Justice of the European Union (CJEU) judgments.<n>The dataset contains: (i) masked case/paragraph queries, with removed citation information; (ii) a corpus that includes all paragraphs; and (iii) case- and paragraph-level ground-truth citations.
• Score: 1.2425910171551517
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: A common task in legal Information Retrieval (IR) is to find relevant legal sources from case-law collections. While legal practice often requires pinpoint citations (pincites) to specific case paragraphs, most existing public legal IR datasets lack paragraph-level citation annotations. Yet, publicly available datasets with such information contain data leakage in the query text and exclude paragraphs that are neither citing nor cited from the corpora, creating an unrealistic and oversimplified retrieval setting, potentially leading to inflated performance. To address these limitations, we contribute a large-scale legal IR dataset constructed from Court of Justice of the European Union (CJEU) judgments. The dataset contains: (i) masked case/paragraph queries, with removed citation information; (ii) a corpus that includes all paragraphs; and (iii) case- and paragraph-level ground-truth citations, with partial human expert validation. Our dataset supports both the development and rigorous evaluation of legal IR methods, at multiple query-document levels (case-to-case, paragraph-to-case, and paragraph-to-paragraph retrieval). Link to dataset: https://huggingface.co/datasets/theresiavr/legalpincite

Related papers

• ClaimGen-CN: A Large-scale Chinese Dataset for Legal Claim Generation [56.79698529022327]
  Legal claims refer to the plaintiff's demands in a case and are essential to guiding judicial reasoning and case resolution.<n>This paper explores the problem of legal claim generation based on the given case's facts.<n>We construct ClaimGen-CN, the first dataset for Chinese legal claim generation task.
  arXiv  Detail & Related papers  (2025-08-24T07:19:25Z)
• AnnoCaseLaw: A Richly-Annotated Dataset For Benchmarking Explainable Legal Judgment Prediction [56.797874973414636]
  AnnoCaseLaw is a first-of-its-kind dataset of 471 meticulously annotated U.S. Appeals Court negligence cases.<n>Our dataset lays the groundwork for more human-aligned, explainable Legal Judgment Prediction models.<n>Results demonstrate that LJP remains a formidable task, with application of legal precedent proving particularly difficult.
  arXiv  Detail & Related papers  (2025-02-28T19:14:48Z)
• CLERC: A Dataset for Legal Case Retrieval and Retrieval-Augmented Analysis Generation [44.67578050648625]
  We transform a large open-source legal corpus into a dataset supporting information retrieval (IR) and retrieval-augmented generation (RAG) This dataset CLERC is constructed for training and evaluating models on their ability to (1) find corresponding citations for a given piece of legal analysis and to (2) compile the text of these citations into a cogent analysis that supports a reasoning goal.
  arXiv  Detail & Related papers  (2024-06-24T23:57:57Z)
• STARD: A Chinese Statute Retrieval Dataset with Real Queries Issued by Non-professionals [14.002280587675175]
  Statute retrieval aims to find relevant statutory articles for specific queries. Existing statute retrieval benchmarks focus on formal and professional queries from sources like bar exams and legal case documents. To address this gap, we introduce the STAtute Retrieval dataset (STARD) Unlike existing statute retrieval datasets, STARD captures the complexity and diversity of real queries from the general public.
  arXiv  Detail & Related papers  (2024-06-21T17:10:09Z)
• DELTA: Pre-train a Discriminative Encoder for Legal Case Retrieval via Structural Word Alignment [55.91429725404988]
  We introduce DELTA, a discriminative model designed for legal case retrieval. We leverage shallow decoders to create information bottlenecks, aiming to enhance the representation ability. Our approach can outperform existing state-of-the-art methods in legal case retrieval.
  arXiv  Detail & Related papers  (2024-03-27T10:40:14Z)
• LeCaRDv2: A Large-Scale Chinese Legal Case Retrieval Dataset [20.315416393247247]
  We introduce LeCaRDv2, a large-scale Legal Case Retrieval dataset (version 2). It consists of 800 queries and 55,192 candidates extracted from 4.3 million criminal case documents. We enrich the existing relevance criteria by considering three key aspects: characterization, penalty, procedure. It's important to note that all cases in the dataset have been annotated by multiple legal experts specializing in criminal law.
  arXiv  Detail & Related papers  (2023-10-26T17:32:55Z)
• MUSER: A Multi-View Similar Case Retrieval Dataset [65.36779942237357]
  Similar case retrieval (SCR) is a representative legal AI application that plays a pivotal role in promoting judicial fairness. Existing SCR datasets only focus on the fact description section when judging the similarity between cases. We present M, a similar case retrieval dataset based on multi-view similarity measurement and comprehensive legal element with sentence-level legal element annotations.
  arXiv  Detail & Related papers  (2023-10-24T08:17:11Z)
• LEEC: A Legal Element Extraction Dataset with an Extensive Domain-Specific Label System [0.4764641468273235]
  Legal Element ExtraCtion dataset (LEEC) represents the most extensive and domain-specific legal element extraction dataset for the Chinese legal system. We introduce a more comprehensive, large-scale criminal element extraction dataset, comprising 15,831 judicial documents and 159 labels.
  arXiv  Detail & Related papers  (2023-10-02T15:16:31Z)
• SAILER: Structure-aware Pre-trained Language Model for Legal Case Retrieval [75.05173891207214]
  Legal case retrieval plays a core role in the intelligent legal system. Most existing language models have difficulty understanding the long-distance dependencies between different structures. We propose a new Structure-Aware pre-traIned language model for LEgal case Retrieval.
  arXiv  Detail & Related papers  (2023-04-22T10:47:01Z)
• VerbCL: A Dataset of Verbatim Quotes for Highlight Extraction in Case Law [12.080138272647144]
  This paper presents a new dataset that consists of the citation graph of court opinions. We focus on the verbatim quotes, where the text of the original opinion is directly reused. We introduce the task of highlight extraction as a single-document summarization task based on the citation graph.
  arXiv  Detail & Related papers  (2021-08-23T12:41:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.