The Third Competition on Document Forgery Detection on ID-Cards and Passports
- URL: http://arxiv.org/abs/2607.15734v1
- Date: Fri, 17 Jul 2026 08:13:46 GMT
- Title: The Third Competition on Document Forgery Detection on ID-Cards and Passports
- Abstract summary: Third International Competition on Document Forgery Detection on ID-Cards and Passports held across two distinct tracks.<n>Winning team, textitIncode, achieves an $AV_Rank$ of 27.82%, confirming consistent performance across metrics.<n>Results demonstrate that PAD effectiveness requires high accuracy but also consistency across diverse attack types and imaging conditions.
- Score: 14.042684745723513
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: This paper presents a comprehensive analysis of the results from the Third International Competition on Document Forgery Detection on ID-Cards and Passports, which was held across two distinct tracks. Track 1 evaluates a synthetic-data-based ID-PAD system under controlled but diverse conditions, where the winning team, \textit{Incode}, achieves an $AV_{Rank}$ of 27.82%, confirming consistent performance across metrics and highlighting the importance of a balanced, generalizable design. In Track 2, the challenge intensifies with heterogeneous attack scenarios across different domains, where \textit{Incode} again achieved the top position with an $AV_{Rank}$ of 68.71% across thresholds, outperforming some baselines and established methods. These results demonstrate that PAD effectiveness requires not only high accuracy but also consistency across diverse attack types and imaging conditions. The success of this initiative across both tracks underscores the value of collaboration between companies and academic teams. This year, more than \textit{63 teams} were registered, and more than \textit{100 submission models} were evaluated. This competition has evolved into a leading benchmark state-of-the-art in PAD on ID documents, setting the standard for performance, reproducibility, and real-world applicability in secure identity verification.
Related papers
- IDSPACE: A Novel Document Generator for Reliable Evaluation of Digital Identity Verification Systems [Extended Technical Report] [12.27574663758225]
Fraud detection tools are widely available, but evaluating and fine-tuning them remains difficult because identity documents are sensitive and therefore scarce.<n>We introduce IDSpace, extending this line of research in three directions.<n>First, we propose model-guided Bayesian optimization, which tunes generation parameters to maximize both visual similarity and prediction consistency.<n>Second, we decouple user-specified metadata from automatically tuned control parameters, allowing users to configure evaluations without low-level expertise.
arXiv Detail & Related papers (2026-09-02T18:27:09Z) - Every Eval Ever: A Unifying Schema and Community Repository for AI Evaluation Results [60.31885052073872]
We introduce Every Eval Ever, the first shared schema and community repository for AI evaluation results.<n>Every Eval Ever ingesting results from evaluation harnesses and papers alike, and stores per-instance outputs for fine-grained analysis.
arXiv Detail & Related papers (2026-06-12T14:47:37Z) - Claw-Eval: Toward Trustworthy Evaluation of Autonomous Agents [66.97968363332465]
We introduce Claw-Eval, an end-to-end evaluation suite addressing all three gaps in agent benchmarks.<n>Claw-Eval comprises 300 human-verified tasks spanning 9 categories across three groups.<n>Every agent action is recorded through three independent evidence channels.
arXiv Detail & Related papers (2026-04-07T17:43:18Z) - DOCR-Inspector: Fine-Grained and Automated Evaluation of Document Parsing with VLM [35.910677096654574]
Document parsing aims to transform unstructured PDF images into semi-structured data, facilitating the digitization and utilization of information in diverse domains.<n>Common practice often selects the top-performing model on standard benchmarks.<n>We introduce DOCR-Inspector, which formalizes document parsing assessment as fine-grained error detection and analysis.
arXiv Detail & Related papers (2025-12-11T13:16:33Z) - Jointly Generating and Attributing Answers using Logits of Document-Identifier Tokens [2.5724047391808025]
We introduce LoDIT, a method that jointly generates and faithfully attributes answers in RAG.<n> Experiments on a trustworthiness-focused attributed text-generation benchmark, Trust-Align, show that LoDIT significantly outperforms state-of-the-art models on several metrics.
arXiv Detail & Related papers (2025-08-12T13:50:25Z) - Second Competition on Presentation Attack Detection on ID Card [12.609487726543774]
20 teams were registered, and 74 submitted models were evaluated.<n>For Track 1, the "Dragons" team reached first place with an Average Ranking and Equal Error rate (EER) of AV-Rank of 40.48% and 11.44% EER, respectively.<n>For the more challenging approach in Track 2, the "Incode" team reached the best results with an AV-Rank of 14.76% and 6.36% EER, improving on the results of the first edition of 74.30% and 21.87% EER, respectively.
arXiv Detail & Related papers (2025-07-27T20:18:52Z) - Generative Retrieval Meets Multi-Graded Relevance [104.75244721442756]
We introduce a framework called GRaded Generative Retrieval (GR$2$)
GR$2$ focuses on two key components: ensuring relevant and distinct identifiers, and implementing multi-graded constrained contrastive training.
Experiments on datasets with both multi-graded and binary relevance demonstrate the effectiveness of GR$2$.
arXiv Detail & Related papers (2024-09-27T02:55:53Z) - First Competition on Presentation Attack Detection on ID Card [9.872311870613748]
This paper summarises the Competition on Presentation Attack Detection on ID Cards (PAD-IDCard) held at the 2024 International Joint Conference on Biometrics (IJCB2024)
The competition attracted a total of ten registered teams, both from academia and industry.
In summary, a team that chose to be "Anonymous" reached the best average ranking results of 74.80%, followed very closely by the "IDVC" team with 77.65%.
arXiv Detail & Related papers (2024-08-31T07:24:19Z) - UniTTA: Unified Benchmark and Versatile Framework Towards Realistic Test-Time Adaptation [66.05528698010697]
Test-Time Adaptation aims to adapt pre-trained models to the target domain during testing.
Researchers have identified various challenging scenarios and developed diverse methods to address these challenges.
We propose a Unified Test-Time Adaptation benchmark, which is comprehensive and widely applicable.
arXiv Detail & Related papers (2024-07-29T15:04:53Z) - SigScatNet: A Siamese + Scattering based Deep Learning Approach for
Signature Forgery Detection and Similarity Assessment [1.474723404975345]
This research paper introduces SigScatNet, an innovative solution to combat the surge in counterfeit signatures.
Siamese deep learning network, bolstered by Scattering wavelets, is used to detect signature forgery and assess signature similarity.
In experiments, SigScatNet yields an unparalleled Equal Error Rate of 3.689% with the ICDAR SigComp Dutch dataset and an astonishing 0.0578% with the CEDAR dataset.
arXiv Detail & Related papers (2023-11-09T18:38:46Z) - Noisy-Correspondence Learning for Text-to-Image Person Re-identification [50.07634676709067]
We propose a novel Robust Dual Embedding method (RDE) to learn robust visual-semantic associations even with noisy correspondences.
Our method achieves state-of-the-art results both with and without synthetic noisy correspondences on three datasets.
arXiv Detail & Related papers (2023-08-19T05:34:13Z) - Identity Documents Authentication based on Forgery Detection of
Guilloche Pattern [2.606834301724095]
An authentication model for identity documents based on forgery detection of guilloche patterns is proposed.
Experiments are conducted in order to analyze and identify the most proper parameters to achieve higher authentication performance.
arXiv Detail & Related papers (2022-06-22T11:37:10Z) - Long Document Summarization with Top-down and Bottom-up Inference [113.29319668246407]
We propose a principled inference framework to improve summarization models on two aspects.
Our framework assumes a hierarchical latent structure of a document where the top-level captures the long range dependency.
We demonstrate the effectiveness of the proposed framework on a diverse set of summarization datasets.
arXiv Detail & Related papers (2022-03-15T01:24:51Z) - ICDAR 2021 Competition on Components Segmentation Task of Document
Photos [63.289361617237944]
Three challenge tasks were proposed entailing different segmentation assignments to be performed on a provided dataset.
The collected data are from several types of Brazilian ID documents, whose personal information was conveniently replaced.
Different Deep Learning models were applied by the entrants with diverse strategies to achieve the best results in each of the tasks.
arXiv Detail & Related papers (2021-06-16T00:49:58Z) - On Efficient and Robust Metrics for RANSAC Hypotheses and 3D Rigid
Registration [51.64236850960365]
This paper focuses on developing efficient and robust evaluation metrics for RANSAC hypotheses to achieve accurate 3D rigid registration.
We analyze the contributions of inliers and outliers, and then proposing several efficient and robust metrics with different designing motivations for RANSAC hypotheses.
arXiv Detail & Related papers (2020-11-10T02:22:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.