Weakly Supervised Training for Hologram Verification in Identity Documents

• URL: http://arxiv.org/abs/2404.17253v1
• Date: Fri, 26 Apr 2024 08:47:28 GMT
• Title: Weakly Supervised Training for Hologram Verification in Identity Documents
• Abstract summary: We propose a method to verify the authenticity of Optically Variable Devices (OVDs) in identity documents. Our method processes video clips captured with smartphones under common lighting conditions. Thanks to a weakly-supervised training, we optimize a feature extraction and decision pipeline which achieves a new leading performance.
• Score: 1.9197225657187418
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: We propose a method to remotely verify the authenticity of Optically Variable Devices (OVDs), often referred to as ``holograms'', in identity documents. Our method processes video clips captured with smartphones under common lighting conditions, and is evaluated on two public datasets: MIDV-HOLO and MIDV-2020. Thanks to a weakly-supervised training, we optimize a feature extraction and decision pipeline which achieves a new leading performance on MIDV-HOLO, while maintaining a high recall on documents from MIDV-2020 used as attack samples. It is also the first method, to date, to effectively address the photo replacement attack task, and can be trained on either genuine samples, attack samples, or both for increased performance. By enabling to verify OVD shapes and dynamics with very little supervision, this work opens the way towards the use of massive amounts of unlabeled data to build robust remote identity document verification systems on commodity smartphones. Code is available at https://github.com/EPITAResearchLab/pouliquen.24.icdar

Related papers

• Video Transformer for Remote Identity Document Hologram Detection [1.1688548469063844]
  hologram detection method builds on a robust model previously validated in a related research domain.<n>Our system is designed for a smartphone-based capture process, followed by a server-side verification.
  arXiv  Detail & Related papers  (2026-07-13T11:24:54Z)
• Verification of Dynamic Holographic Behavior in Identity Documents [1.208889278596182]
  This paper addresses the remote verification of the authenticity of Optically Variable Devices (commonly known as holograms) on identity documents.<n>These devices provide strong and easily verifiable security for human inspection but pose challenges for automated verification.<n>Existing approaches easily cover static frauds and can be evaluated for such, but their capacity to detect real, dynamic fraud cases has not been evaluated to date.<n>This work features three contributions to address these limitations: 1) a new public dataset, MIDV-DynAttack, which extends the existing MIDV-Holo dataset with realistic, static and dynamic attacks against identity document specimens.
  arXiv  Detail & Related papers  (2026-07-07T16:27:28Z)
• Temporal Modeling of Optically Variable Devices in Identity Documents [2.8297572190956917]
  We introduce two novel approaches for verifying the dynamic behavior of transparent OVDs protecting the holder's portrait.<n>We demonstrate these approaches can be trained without any attack samples in a self-supervised setting.<n>Our results confirm that modeling temporal dynamics is essential for defeating sophisticated attacks under realistic conditions.
  arXiv  Detail & Related papers  (2026-07-07T15:37:53Z)
• Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement [58.85593321752693]
  Identity-preserving text-to-video (IPT2V) generation creates videos faithful to both a reference subject image and a text prompt.<n>We introduce a Training-Free Prompt, Image, and Guidance Enhancement framework that bridges the semantic gap between the video description and the reference image.<n>We win first place in the ACM Multimedia 2025 Identity-Preserving Video Generation Challenge.
  arXiv  Detail & Related papers  (2025-09-01T11:03:13Z)
• SAM2Auto: Auto Annotation Using FLASH [13.638155035372835]
  Vision-Language Models (VLMs) lag behind Large Language Models due to the scarcity of annotated datasets.<n>We introduce SAM2Auto, the first fully automated annotation pipeline for video datasets requiring no human intervention or dataset-specific training.<n>Our system employs statistical approaches to minimize detection errors while ensuring consistent object tracking throughout entire video sequences.
  arXiv  Detail & Related papers  (2025-06-09T15:15:15Z)
• SynID: Passport Synthetic Dataset for Presentation Attack Detection [7.1212970088491385]
  Increase is driven by several factors, including the rise of remote work, online purchasing, migration, and advancements in synthetic images.<n>This work proposes a new passport dataset generated from a hybrid method that combines synthetic data and open-access information.
  arXiv  Detail & Related papers  (2025-05-12T13:24:54Z)
• CamoSAM2: Motion-Appearance Induced Auto-Refining Prompts for Video Camouflaged Object Detection [14.219232629274186]
  The application of SAM2 for automated segmentation in real-world scenarios faces challenges in camouflage perception and reliable prompts generation. We propose CamoSAM2, a motion-appearance prompt inducer (MAPI) and refinement framework to automatically generate and refine prompts for SAM2. Our proposed model, CamoSAM2, significantly outperforms existing state-of-the-art methods, achieving increases of 8.0% and 10.1% in mIoU metric.
  arXiv  Detail & Related papers  (2025-04-01T02:45:17Z)
• Neuromorphic Synergy for Video Binarization [54.195375576583864]
  Bimodal objects serve as a visual form to embed information that can be easily recognized by vision systems. Neuromorphic cameras offer new capabilities for alleviating motion blur, but it is non-trivial to first de-blur and then binarize the images in a real-time manner. We propose an event-based binary reconstruction method that leverages the prior knowledge of the bimodal target's properties to perform inference independently in both event space and image space. We also develop an efficient integration method to propagate this binary image to high frame rate binary video.
  arXiv  Detail & Related papers  (2024-02-20T01:43:51Z)
• Unified High-binding Watermark for Unconditional Image Generation Models [7.4037644261198885]
  An attacker can steal the output images of the target model and use them as part of the training data to train a private surrogate UIG model. We propose a two-stage unified watermark verification mechanism with high-binding effects. Experiments demonstrate our method can complete the verification work with almost zero false positive rate.
  arXiv  Detail & Related papers  (2023-10-14T03:26:21Z)
• Towards General Visual-Linguistic Face Forgery Detection [95.73987327101143]
  Deepfakes are realistic face manipulations that can pose serious threats to security, privacy, and trust. Existing methods mostly treat this task as binary classification, which uses digital labels or mask signals to train the detection model. We propose a novel paradigm named Visual-Linguistic Face Forgery Detection(VLFFD), which uses fine-grained sentence-level prompts as the annotation.
  arXiv  Detail & Related papers  (2023-07-31T10:22:33Z)
• NPVForensics: Jointing Non-critical Phonemes and Visemes for Deepfake Detection [50.33525966541906]
  Existing multimodal detection methods capture audio-visual inconsistencies to expose Deepfake videos. We propose a novel Deepfake detection method to mine the correlation between Non-critical Phonemes and Visemes, termed NPVForensics. Our model can be easily adapted to the downstream Deepfake datasets with fine-tuning.
  arXiv  Detail & Related papers  (2023-06-12T06:06:05Z)
• Unmasking Deepfakes: Masked Autoencoding Spatiotemporal Transformers for Enhanced Video Forgery Detection [19.432851794777754]
  We present a novel approach for the detection of deepfake videos using a pair of vision transformers pre-trained by a self-supervised masked autoencoding setup. Our method consists of two distinct components, one of which focuses on learning spatial information from individual RGB frames of the video, while the other learns temporal consistency information from optical flow fields generated from consecutive frames.
  arXiv  Detail & Related papers  (2023-06-12T05:49:23Z)
• Weakly Supervised Two-Stage Training Scheme for Deep Video Fight Detection Model [0.0]
  Fight detection in videos is an emerging deep learning application with today's prevalence of surveillance systems and streaming media. Previous work has largely relied on action recognition techniques to tackle this problem. We design the fight detection model as a composition of an action-aware feature extractor and an anomaly score generator.
  arXiv  Detail & Related papers  (2022-09-23T08:29:16Z)
• MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization [65.09758931804478]
  Three different data sources are combined: weakly-supervised videos, crowd-labeled text-image pairs and text-video pairs. A careful analysis of available pre-trained networks helps to choose the best prior-knowledge ones.
  arXiv  Detail & Related papers  (2022-03-14T13:15:09Z)
• Self-Supervised Person Detection in 2D Range Data using a Calibrated Camera [83.31666463259849]
  We propose a method to automatically generate training labels (called pseudo-labels) for 2D LiDAR-based person detectors. We show that self-supervised detectors, trained or fine-tuned with pseudo-labels, outperform detectors trained using manual annotations. Our method is an effective way to improve person detectors during deployment without any additional labeling effort.
  arXiv  Detail & Related papers  (2020-12-16T12:10:04Z)
• EHSOD: CAM-Guided End-to-end Hybrid-Supervised Object Detection with Cascade Refinement [53.69674636044927]
  We present EHSOD, an end-to-end hybrid-supervised object detection system. It can be trained in one shot on both fully and weakly-annotated data. It achieves comparable results on multiple object detection benchmarks with only 30% fully-annotated data.
  arXiv  Detail & Related papers  (2020-02-18T08:04:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.