CPG-PAD: Concept-Informed Prompts Guided Presentation Attack Detection
- URL: http://arxiv.org/abs/2607.01303v1
- Date: Wed, 01 Jul 2026 15:33:45 GMT
- Title: CPG-PAD: Concept-Informed Prompts Guided Presentation Attack Detection
- Abstract summary: Concept-Informed Prompts Guided Presentation Attack Detection (CPG-PAD) is a framework that introduces model-level concept guidance into the prompt learning process.<n>CPG-PAD consistently achieves state-of-the-art cross-domain performance under multi-source, limited-source, and single-source settings.
- Score: 33.657914787417525
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Presentation Attack Detection (PAD) serves as a crucial safeguard for face recognition systems against presentation attacks such as printed photos, replayed videos, and 3D masks. Despite significant progress, existing PAD models still struggle to generalize across unseen domains due to variations in sensors, lighting, and attack materials. Recent Vision-Language Models (VLMs) have shown strong generalization ability, yet their applications in PAD remain limited because learned prompts, typically optimized under class-label supervision, fail to explicitly align with fine-grained attack-relevant visual semantics. As a result, the learned representations often overfit domain-specific artifacts instead of capturing transferable attack cues. To address this, we propose Concept-Informed Prompts Guided Presentation Attack Detection (CPG-PAD), a framework that introduces model-level concept guidance into the prompt learning process. Specifically, we design a Visual Concept-driven Enhancement (VCE) module that employs eXplainable AI (XAI) techniques to automatically discover PAD-relevant visual concepts and generate concept-associated heatmaps providing localized fine-grained guidance. Guided by these heatmaps, a Prompt-based Concept Injection (PCI) mechanism integrates these concepts into the prompt space through a Visual-Prompt Decoder (VPD) and a concept-mapping loss, enabling prompts to align with the model's internal concept space. This design enables CPG-PAD to capture generalizable and domain-invariant attack cues while effectively suppressing dataset-specific biases. Extensive experiments across nine benchmark datasets demonstrate that CPG-PAD consistently achieves state-of-the-art cross-domain performance under multi-source, limited-source, and single-source settings.
Related papers
- Primitive-Driven Compositional Forensic Visual Prompting for Open-World Face Anti-Spoofing [59.765442274924595]
We propose a compositional visual prompt learning framework that operates entirely in the visual feature space.<n>The framework employs patch-aware attention to refine a shared set of learnable micro-forensic primitives into localized forensic evidence units.<n>Experiments on nine open-world protocols demonstrate state-of-the-art performance, strong cross-domain generalization, and robust adaptation to unseen attacks.
arXiv Detail & Related papers (2026-08-18T04:18:08Z) - Uni-AdaVD: Universal Concept Erasure for Visual Generation via Orthogonal Value Decomposition [62.947473058878565]
We present Uni-AdaVD, a universal inference-time concept erasure framework for visual generation.<n>Our results suggest that Uni-AdaVD provides an efficient and adaptable safety mechanism for modern visual generative models.
arXiv Detail & Related papers (2026-07-16T03:16:51Z) - Towards Robustness against Typographic Attack with Training-free Concept Localization [42.575178574443946]
Contrastive Language-Image Pretraining models (CLIP) serve as the foundational vision encoders for most modern Large Vision Language Models (LVLMs)<n>CLIP models exhibit a critical yet underexplored failure mode: irrelevant text appearing within images confounds visual representations, biasing them toward lexical meaning rather than true visual semantics.<n>This issue, commonly described as a Typographic Attack (TA), exposes a vulnerability that poses a significant risk to safety-critical applications such as autonomous driving.<n>We propose a novel, training-free mechanistic interpretability method to achieve interpretable and effective robustness against TA.
arXiv Detail & Related papers (2026-07-02T17:55:24Z) - From Local to Global to Mechanistic: An iERF-Centered Unified Framework for Interpreting Vision Models [29.908678230814015]
We introduce an iERF-centric framework that unifies local, global, and mechanistic interpretability around a single analysis unit.<n>On the local side, Sharing Ratio Decomposition (SRD) expresses each PFV as a mixture of upstream PFVs via sharing ratios and propagates iERFs to construct class-discriminative saliency maps.<n>For the global view, we introduce Concept-Anchored Feature Explanation (CAFE), which utilizes the iERF as a semantic label.
arXiv Detail & Related papers (2026-05-01T07:25:49Z) - Visual prompting reimagined: The power of the Activation Prompts [72.85146015928626]
We introduce a concept, termed activation prompt (AP), which extends the scope of the input-level VP.<n>AP is closely related to normalization tuning in convolutional neural networks and vision transformers.<n>We show that AP is closely related to normalization tuning in convolutional neural networks and vision transformers.
arXiv Detail & Related papers (2026-04-07T20:28:24Z) - PVI: Plug-in Visual Injection for Vision-Language-Action Models [8.641415997612066]
VLAs that pair a pretrained VLM with a flow-matching action expert have emerged as a strong paradigm for language-conditioned manipulation.<n>We propose Plug-in Visual Injection (PVI), a lightweight encoder-agnostic module that attaches to a pretrained action expert and injects auxiliary visual representations via zero-d residual pathways.
arXiv Detail & Related papers (2026-03-13T08:16:53Z) - SSVP: Synergistic Semantic-Visual Prompting for Industrial Zero-Shot Anomaly Detection [55.54007781679915]
We propose Synergistic Semantic-Visual Prompting (SSVP), that efficiently fuses diverse visual encodings to elevate model's fine-grained perception.<n>SSVP achieves state-of-the-art performance with 93.0% Image-AUROC and 92.2% Pixel-AUROC on MVTec-AD, significantly outperforming existing zero-shot approaches.
arXiv Detail & Related papers (2026-01-14T04:42:19Z) - V-Attack: Targeting Disentangled Value Features for Controllable Adversarial Attacks on LVLMs [66.81402538540458]
We propose V-Attack, a novel method for precise local semantic attacks.<n>V-Attack improves the attack success rate by an average of 36% over state-of-the-art methods.
arXiv Detail & Related papers (2025-11-25T11:51:17Z) - CoPA: Hierarchical Concept Prompting and Aggregating Network for Explainable Diagnosis [8.56688324078793]
Concept Prompting and Aggregating (CoPA) is a novel framework designed to capture multilayer concepts under prompt guidance.<n>Visual representations from each layer are aggregated to align with textual concept representations.<n>CoPA outperforms state-of-the-art methods on three public datasets.
arXiv Detail & Related papers (2025-10-04T10:29:15Z) - VGGT-DP: Generalizable Robot Control via Vision Foundation Models [13.41554759983567]
VGGT-DP is a visuomotor policy framework that integrates geometric priors from a pretrained 3D perception model with proprioceptive feedback.<n>We adopt the Visual Geometry Grounded Transformer (VGGT) as the visual encoder and introduce a proprioception-guided visual learning strategy to align perception with internal robot states.<n>Experiments on challenging MetaWorld tasks show that VGGT-DP significantly outperforms strong baselines such as DP and DP3, particularly in precision-critical and long-horizon scenarios.
arXiv Detail & Related papers (2025-09-23T08:15:30Z) - HAMLET-FFD: Hierarchical Adaptive Multi-modal Learning Embeddings Transformation for Face Forgery Detection [6.060036926093259]
HAMLET-FFD is a cross-domain generalization framework for face forgery detection.<n>It integrates visual evidence with conceptual cues, emulating expert forensic analysis.<n>By design, HAMLET-FFD freezes all pretrained parameters, serving as an external plugin.
arXiv Detail & Related papers (2025-07-28T15:09:52Z) - Advancing General Multimodal Capability of Vision-language Models with Pyramid-descent Visual Position Encoding [64.29499221878746]
Vision-language Models (VLMs) have shown remarkable capabilities in advancing general artificial intelligence.<n>PyPE is a novel approach designed to enhance the perception of visual tokens withinVLMs.<n>Our method reduces the relative distance between interrelated visual elements and instruction tokens.
arXiv Detail & Related papers (2025-01-19T07:00:46Z) - HCVP: Leveraging Hierarchical Contrastive Visual Prompt for Domain
Generalization [69.33162366130887]
Domain Generalization (DG) endeavors to create machine learning models that excel in unseen scenarios by learning invariant features.
We introduce a novel method designed to supplement the model with domain-level and task-specific characteristics.
This approach aims to guide the model in more effectively separating invariant features from specific characteristics, thereby boosting the generalization.
arXiv Detail & Related papers (2024-01-18T04:23:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.