OneFocus: Enabling Real-World X-ray Security Screening with a Unified Vision-Language Model
- URL: http://arxiv.org/abs/2606.15663v1
- Date: Sun, 14 Jun 2026 08:02:06 GMT
- Title: OneFocus: Enabling Real-World X-ray Security Screening with a Unified Vision-Language Model
- Abstract summary: Vision-language models (VLMs) offer strong generalization but are hindered by the scarcity of high-quality X-ray image-caption data.<n>We present MMXray, a benchmark of 52,124 image-caption pairs spanning 28 fine-grained classes of X-ray contraband.<n>We propose OneFocus, a unified VLM that supports four core tasks: visual question answering, contraband localization, classification, and image understanding.
- Score: 6.260320929730542
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: X-ray contraband detection is critical for security in large-scale logistics and transportation, yet conventional detectors struggle to adapt to emerging contraband types and lack fundamental visual understanding. Vision-language models (VLMs) offer strong generalization but are hindered by the scarcity of high-quality X-ray image-caption data. To bridge this critical gap, we present MMXray, a meticulously curated benchmark of 52,124 image-caption pairs spanning 28 fine-grained classes of X-ray contraband. To enrich MMXray with realistic occlusion patterns, we further introduce CleanDET, a dedicated synthesis dataset containing clean foreground contraband images from 28 categories and background images with diverse density levels, together with AnyContraSyn, a controllable synthesis method designed to operate on CleanDET. We also develop OnePipe, an extensible pipeline for systematic data curation. Built on MMXray, we propose OneFocus, a unified VLM that supports four core tasks: visual question answering, contraband localization, classification, and image understanding. OneFocus achieves state-of-the-art performance in X-ray contraband understanding and demonstrates robust cross-domain generalization, establishing a strong vision-language baseline for security screening.
Related papers
- Partial Skeleton Visibility for Action Recognition: A Constrained Field-of-View Approach [60.596944437968524]
PartialVisGraph is a novel framework for robust skeleton-based action recognition under constrained field-of-view.<n>It consistently achieves state-of-the-art accuracy under partial visibility, with gains of up to 68.8% on subsets with severe FoV restrictions.<n>Our approach offers a principled and practical pathway toward deployable skeleton-based action understanding in unconstrained environments.
arXiv Detail & Related papers (2026-07-01T10:03:11Z) - SonoCLIP: Mask-Guided Region-Aware Vision-Language Pretraining for Fetal Ultrasound Analysis [51.81845420301345]
SonoCLIP is a vision-language foundation model for fetal ultrasound analysis.<n>It integrates segmentation masks as mask-channel visual prompts within the vision encoder.<n>It achieves superior zero-shot transfer performance under both global and mask-guided inference.
arXiv Detail & Related papers (2026-06-28T20:04:49Z) - Beyond a Single Frame: Multi-Frame Spatially Grounded Reasoning Across Volumetric MRI [22.439797107933355]
We introduceSGMRI-VQA, a benchmark for multi-frame, spatially grounded reasoning on volumetric MRI.<n>Each QA pair includes a clinician-aligned chain-of-thought trace with frame-indexed bounding box coordinates.<n>We show that supervised fine-tuning of Qwen3-VL-8B with bounding box supervision consistently improves grounding performance over strong zero-shot baselines.
arXiv Detail & Related papers (2026-04-17T08:06:39Z) - MetaDent: Labeling Clinical Images for Vision-Language Models in Dentistry [32.93319761809706]
Vision-Language Models (VLMs) have demonstrated significant potential in medical image analysis.<n>Their application in intraoral photography remains largely underexplored due to the lack of fine-grained, annotated datasets and comprehensive benchmarks.<n>We present MetaDent, a comprehensive resource that includes a novel and large-scale dentistry image dataset collected from clinical, public, and web sources.
arXiv Detail & Related papers (2026-04-16T10:56:54Z) - Can a Second-View Image Be a Language? Geometric and Semantic Cross-Modal Reasoning for X-ray Prohibited Item Detection [55.44671451998018]
We introduce DualXrayBench, the first comprehensive benchmark for X-ray inspection.<n>We introduce a caption corpus consisting of 45,613 dual-view image pairs across 12 categories with corresponding captions.<n>We propose the Geometric (cross-view)-Semantic (cross-modality) Reasoner (GSR) as a multimodal model that learns correspondences between cross-view geometry and cross-modal semantics.
arXiv Detail & Related papers (2025-11-23T10:25:24Z) - MIRNet: Integrating Constrained Graph-Based Reasoning with Pre-training for Diagnostic Medical Imaging [67.74482877175797]
MIRNet is a novel framework that integrates self-supervised pre-training with constrained graph-based reasoning.<n>We introduce TongueAtlas-4K, a benchmark comprising 4,000 images annotated with 22 diagnostic labels.
arXiv Detail & Related papers (2025-11-13T06:30:41Z) - STING-BEE: Towards Vision-Language Model for Real-World X-ray Baggage Security Inspection [43.69783848100359]
We introduce STCray, the first multimodal X-ray baggage security dataset, comprising 46,642 image-caption paired scans across 21 threat categories.<n> STCray is meticulously developed with our specialized protocol that ensures domain-aware, coherent captions.<n>This allows us to train a domain-aware visual AI assistant named STING-BEE that supports a range of vision-language tasks.
arXiv Detail & Related papers (2025-04-03T17:59:12Z) - MFCLIP: Multi-modal Fine-grained CLIP for Generalizable Diffusion Face Forgery Detection [64.29452783056253]
The rapid development of photo-realistic face generation methods has raised significant concerns in society and academia.<n>Although existing approaches mainly capture face forgery patterns using image modality, other modalities like fine-grained noises and texts are not fully explored.<n>We propose a novel multi-modal fine-grained CLIP (MFCLIP) model, which mines comprehensive and fine-grained forgery traces across image-noise modalities.
arXiv Detail & Related papers (2024-09-15T13:08:59Z) - Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning [65.54680361074882]
Eye-gaze Guided Multi-modal Alignment (EGMA) framework harnesses eye-gaze data for better alignment of medical visual and textual features.
We conduct downstream tasks of image classification and image-text retrieval on four medical datasets.
arXiv Detail & Related papers (2024-03-19T03:59:14Z) - Cross-Modal Contrastive Learning for Abnormality Classification and
Localization in Chest X-rays with Radiomics using a Feedback Loop [63.81818077092879]
We propose an end-to-end semi-supervised cross-modal contrastive learning framework for medical images.
We first apply an image encoder to classify the chest X-rays and to generate the image features.
The radiomic features are then passed through another dedicated encoder to act as the positive sample for the image features generated from the same chest X-ray.
arXiv Detail & Related papers (2021-04-11T09:16:29Z) - Severity Quantification and Lesion Localization of COVID-19 on CXR using
Vision Transformer [25.144248675578286]
Under the global pandemic of COVID-19, building an automated framework that quantifies the severity of COVID-19 has become increasingly important.
We propose a novel Vision Transformer tailored for both quantification of the severity and clinically applicable localization of the COVID-19 related lesions.
Our model is trained in a weakly-supervised manner to generate the full probability maps from weak array-based labels.
arXiv Detail & Related papers (2021-03-12T03:17:19Z) - Synthesis of COVID-19 Chest X-rays using Unpaired Image-to-Image
Translation [6.22964000148682]
We build the first-of-its-kind open dataset of synthetic COVID-19 chest X-ray images of high fidelity using an unsupervised domain adaptation approach.
We show considerable performance improvements on COVID-19 detection using various deep learning architectures.
Our publicly available benchmark dataset consists of 21,295 synthetic COVID-19 chest X-ray images.
arXiv Detail & Related papers (2020-10-20T13:37:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.