Bridging Data Trials and Task Barriers: A Unified Framework for Sketch Biometric Identification
- URL: http://arxiv.org/abs/2605.17367v1
- Date: Sun, 17 May 2026 10:20:57 GMT
- Title: Bridging Data Trials and Task Barriers: A Unified Framework for Sketch Biometric Identification
- Abstract summary: Sketch biometric identification faces challenges, including scarce real data, high annotation costs, privacy risks, and insufficient generalization ability of cross-task models.<n>This paper proposes a unified framework that integrates efficient synthetic sketch generation and task-sequential continual learning.<n>To support the study of sketch biometric identification, we built a new large-scale benchmark, Sketch-BioID, with several practical evaluation protocols.
- Score: 99.67657930163358
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Different from existing cross-modality identification tasks (e.g., heterogeneous face recognition, sketch re-identification, etc.), we introduce a novel yet practical setting for these related identification tasks, named \textbf{sketch biometric identification}, which aims to continually train a unified model across different data domains, even diverse identification tasks. Sketch biometric identification faces challenges, including scarce real sketch data, high annotation costs, privacy risks, and insufficient generalization ability of cross-task models. Existing methods usually rely on limited real data or single-task optimization, making it difficult to effectively address the joint challenges of cross-modality and cross-task. This paper proposes a unified framework that integrates efficient synthetic sketch generation and task-sequential continual learning. First, we design an efficient pipeline to generate a large-scale and high-quality synthetic person and face sketch data, which significantly reduces costs and avoids privacy risks. Meanwhile, we enhance the model's robustness by fusing real data. Second, we construct a universal unified framework for sketch biometric identification, which adopts a task-sequential training strategy: the model first completes sketch person re-identification learning on the person dataset; subsequently, it maintains the acquired person recognition capability through a trusted sample replay technique and seamlessly performs incremental training on the face dataset. This enables a single model to simultaneously handle the cross-task capabilities of multiple sketch biometric identification tasks. To support the study of the mentioned sketch biometric identification, we built a new large-scale benchmark, SketchUnified-BioID, with several practical evaluation protocols.
Related papers
- Designing and Generating Diverse, Equitable Face Image Datasets for Face Verification Tasks [16.06801103297664]
We propose a comprehensive methodology that integrates advanced generative models to create varied and diverse high-quality synthetic face images.<n>This work not only enriches the discussion on diversity and ethics in artificial intelligence but also lays the foundation for developing more inclusive and reliable face verification technologies.
arXiv Detail & Related papers (2025-11-21T16:53:08Z) - WithAnyone: Towards Controllable and ID Consistent Image Generation [83.55786496542062]
Identity-consistent generation has become an important focus in text-to-image research.<n>We develop a large-scale paired dataset tailored for multi-person scenarios.<n>We propose a novel training paradigm with a contrastive identity loss that leverages paired data to balance fidelity with diversity.
arXiv Detail & Related papers (2025-10-16T17:59:54Z) - GaitCrafter: Diffusion Model for Biometric Preserving Gait Synthesis [14.174192604480599]
GaitCrafter is a diffusion-based framework for synthesizing realistic gait sequences in the silhouette domain.<n>Our approach enables the generation of temporally consistent and identity-preserving gait sequences.<n>We introduce a mechanism to generate novel identities-synthetic individuals not present in the original dataset.
arXiv Detail & Related papers (2025-08-18T18:32:42Z) - Hybrid Generative Fusion for Efficient and Privacy-Preserving Face Recognition Dataset Generation [87.48785461212556]
We present our approach to the DataCV ICCV Challenge, which centers on building a high-quality face dataset to train a face recognition model.<n>The constructed dataset must not contain identities overlapping with any existing public face datasets.<n>Our method achieves textbf1st place in the competition, and experimental results show that our dataset improves model performance across 10K, 20K, and 100K identity scales.
arXiv Detail & Related papers (2025-08-14T14:14:18Z) - FaceXFormer: A Unified Transformer for Facial Analysis [59.94066615853198]
FaceXFormer is an end-to-end unified transformer model capable of performing ten facial analysis tasks.<n>Tasks include face parsing, landmark detection, head pose estimation, attribute prediction, age, gender, and race estimation.<n>We train FaceXFormer on ten diverse face perception datasets and evaluate it against both specialized and multi-task models.
arXiv Detail & Related papers (2024-03-19T17:58:04Z) - Data-Driven but Privacy-Conscious: Pedestrian Dataset De-identification
via Full-Body Person Synthesis [16.394031759681678]
We motivate and introduce the Pedestrian dataset De-Identification task.
PDI evaluates the degree of de-identification and downstream task training performance for a given de-identification method.
We show how our data is able to narrow the synthetic-to-real performance gap in a privacy-conscious manner.
arXiv Detail & Related papers (2023-06-20T17:39:24Z) - Improving Identity-Robustness for Face Models [9.721206532236515]
We explore using face-recognition embedding vectors, as proxies for identities, to enforce such robustness.
We do so by weighting samples according to their conditional inverse density (CID) in the proxy embedding space.
Our experiments suggest that such a simple sample weighting scheme, not only improves the training robustness, it often improves the overall performance.
arXiv Detail & Related papers (2023-04-07T20:41:10Z) - Unifying Flow, Stereo and Depth Estimation [121.54066319299261]
We present a unified formulation and model for three motion and 3D perception tasks.
We formulate all three tasks as a unified dense correspondence matching problem.
Our model naturally enables cross-task transfer since the model architecture and parameters are shared across tasks.
arXiv Detail & Related papers (2022-11-10T18:59:54Z) - Unsupervised Noisy Tracklet Person Re-identification [100.85530419892333]
We present a novel selective tracklet learning (STL) approach that can train discriminative person re-id models from unlabelled tracklet data.
This avoids the tedious and costly process of exhaustively labelling person image/tracklet true matching pairs across camera views.
Our method is particularly more robust against arbitrary noisy data of raw tracklets therefore scalable to learning discriminative models from unconstrained tracking data.
arXiv Detail & Related papers (2021-01-16T07:31:00Z) - Intra-Camera Supervised Person Re-Identification [87.88852321309433]
We propose a novel person re-identification paradigm based on an idea of independent per-camera identity annotation.
This eliminates the most time-consuming and tedious inter-camera identity labelling process.
We formulate a Multi-tAsk mulTi-labEl (MATE) deep learning method for Intra-Camera Supervised (ICS) person re-id.
arXiv Detail & Related papers (2020-02-12T15:26:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.