Differential Attention-Augmented BiomedCLIP with Asymmetric Focal Optimization for Imbalanced Multi-Label Video Capsule Endoscopy Classification

• URL: http://arxiv.org/abs/2603.17879v1
• Date: Wed, 18 Mar 2026 16:04:50 GMT
• Title: Differential Attention-Augmented BiomedCLIP with Asymmetric Focal Optimization for Imbalanced Multi-Label Video Capsule Endoscopy Classification
• Abstract summary: This work presents a multi-label classification framework for video capsule endoscopy (VCE)<n>It addresses the extreme class imbalance inherent in the Galar dataset through a combination of architectural and optimization-level strategies.
• Score: 1.2246649738388389
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: This work presents a multi-label classification framework for video capsule endoscopy (VCE) that addresses the extreme class imbalance inherent in the Galar dataset through a combination of architectural and optimization-level strategies. Our approach modifies BiomedCLIP, a biomedical vision-language foundation model, by replacing its standard multi-head self-attention with a differential attention mechanism that computes the difference between two softmax attention maps to suppress attention noise. To counteract the skewed label distribution, where pathological findings constitute less than 0.1% of all annotated frames, a sqrt-frequency weighted sampler, asymmetric focal loss, mixup regularization, and per-class threshold optimization are employed. Temporal coherence is enforced through median-filter smoothing and gap merging prior to event-level JSON generation. On the held-out RARE-VISION test set comprising three NaviCam examinations (161,025 frames), the pipeline achieves an overall temporal mAP@0.5 of 0.2456 and mAP@0.95 of 0.2353, with total inference completed in approximately 8.6 minutes on a single GPU.

Related papers

• Few-shot Deep Learning for Phase-Amplitude Aberration Correction in Transcranial Focused Ultrasound [2.1352542609902447]
  We propose a few-shot framework that predicts per-element phase and amplitude corrections for a 96-element 3D phased-array transducer from patient CT images.<n>The framework is pretrained on diverse skull geometries and fine-tuned with only ten target points, enabling rapid adaptation to unseen patients.
  arXiv  Detail & Related papers  (2026-07-31T09:02:47Z)
• Modeling Normal Is All You Need: Joint Latent Clustering for Anomaly Detection in Multimodal Cyber-Physical Systems [47.027290803102666]
  Normal behaviour is the union of many imbalanced, curved, thin-fringed operating regimes.<n>We model the normal law with a jointly learned latent representation plus explicit Gaussian-mixture mode clustering.<n>We evaluate under a deliberately fair protocol: raw point-wise metrics with no point adjustment, a trivial-detector difficulty split, prevalence-matched F1, and train-normal-only calibration.
  arXiv  Detail & Related papers  (2026-07-07T10:10:00Z)
• PulmoSight-XAI: An Explainable Multi-View Attention Ensemble with Gradient Boosting Meta-Learning for Multi-Label Chest X-Ray Classification [1.2744523252873352]
  We propose an explainable hierarchical multi-view ensemble framework for the robust classification of 14 thoracic pathologies.<n>The framework employs view-specific training by independently modeling frontal and lateral radiographs.<n>The framework achieves state-of-the-art macro-average AUROC scores of 0.9319 for frontal and 0.9154 for lateral radiographs.
  arXiv  Detail & Related papers  (2026-07-05T19:50:53Z)
• FedCC: A Low-Resource Federated Adaptation of Foundation Models for Robust Corpus Callosum localization in Fetal Ultrasound Images [34.592227505836156]
  We propose FedCC, a framework for corpus callosum (CC) localization in fetal US images.<n>The framework integrates a frozen DINOv2 backbone with a lightweight YOLO-based detection head.<n>It substantially reduces both computational and communication overhead, making the framework suitable for low-resource environments.
  arXiv  Detail & Related papers  (2026-06-30T09:02:13Z)
• Cascade Classification of Dermoscopic Images of Skin Neoplasms with Controllable Sensitivity and External Clinical Validation [36.94429692322632]
  Four architectures were compared in three schemes: binary (malignant/benign), single-stage four-class (benign, MEL, SCC, BCC), and a two-stage cascade (binary triage, then three-class differentiation MEL/ SCC/BCC)<n>All models used ImageNet-pretrained weights and a single augmentation protocol on aggregated open ISIC Archive data.<n>On ISIC MILK10k, direct 11-class classification yields mean-class sensitivity 0.525.
  arXiv  Detail & Related papers  (2026-06-11T09:55:57Z)
• UTOPYA: A Multimodal Deep Learning Framework for Physics-Informed Anomaly Detection and Time-Series Prediction [42.532335022354545]
  Anomaly detection in batch processes is hindered by transient dynamics, scarce fault labels, and reliance on singlemodality sensor data.<n>This work introduces UTOPYA, a multimodal framework that jointly addresses anomaly detection, time-series prediction, and phase classification in batch distillation.<n>A physics-informed regularisation scheme introduced in this work enforces temporal smoothness and thermodynamic monotonicity.
  arXiv  Detail & Related papers  (2026-05-18T10:28:15Z)
• Quantum-Inspired Geometric Classification with Correlation Group Structures and VQC Decision Modeling [0.5039813366558307]
  We propose a geometry-driven quantum-inspired classification framework that integrates Correlation Group Structures (CGR), compact SWAP-test-based overlap estimation, and selective variational quantum decision modelling.<n>CGR organizes features into anchor-centered correlation neighbourhoods, generating nonlinear, correlation-weighted representations.<n>On the Credit Card Fraud dataset (0.17% prevalence), the Delta + VQC pipeline achieves approximately 0.85 minority recall at an alert rate of approximately 1.31%, with ROC-AUC 0.9249 and PR-AUC 0.3251 under full-dataset evaluation.
  arXiv  Detail & Related papers  (2026-04-02T11:50:29Z)
• A Heterogeneous Ensemble for Multi-Center COVID-19 Classification from Chest CT Scans [0.39998518782208775]
  We present a heterogeneous ensemble of nine models spanning three inference paradigms.<n>The ensemble achieves an average macro F1 of 0.9280 across four hospital centres, outperforming the best single model.
  arXiv  Detail & Related papers  (2026-03-15T21:34:59Z)
• A Detection-Gated Pipeline for Robust Glottal Area Waveform Extraction and Clinical Pathology Assessment [0.0]
  We propose a detection-gated pipeline that integrates a localizer with a segmenter.<n>The pipeline achieved state-of-the-art consistency on the GIRAFE and BAGLS benchmarks.
  arXiv  Detail & Related papers  (2026-03-02T17:05:41Z)
• Suppressing Prior-Comparison Hallucinations in Radiology Report Generation via Semantically Decoupled Latent Steering [94.37535002230504]
  We develop a training-free, inference-time control framework termed Semantically Decoupled Latent Steering.<n>Our approach constructs a semantic-free intervention vector via large language model (LLM)-driven semantic decomposition.<n>We show that our approach significantly reduces the probability of historical hallucinations.
  arXiv  Detail & Related papers  (2026-02-27T04:49:01Z)
• Fast Model Selection and Stable Optimization for Softmax-Gated Multinomial-Logistic Mixture of Experts Models [40.216463162163976]
  We develop a batch minorization-maximization algorithm for softmax-gated multinomial-logistic MoE.<n>We also prove finite-sample rates for conditional density estimation and parameter recovery.<n>Experiments on biological protein--protein interaction prediction validate the full pipeline.
  arXiv  Detail & Related papers  (2026-02-08T14:45:41Z)
• SKANet: A Cognitive Dual-Stream Framework with Adaptive Modality Fusion for Robust Compound GNSS Interference Classification [47.20483076887704]
  Global Navigation Satellite Systems (GNSS) face growing threats from sophisticated jamming interference.<n>We propose a cognitive deep learning framework built upon a dual-stream architecture that integrates Time-Frequency Images (TFIs) and Power Spectral Density (PSD)<n>We show that SKANet achieves an overall accuracy of 96.99%, exhibiting superior robustness for compound jamming classification.
  arXiv  Detail & Related papers  (2026-01-19T07:42:45Z)
• Transparent Early ICU Mortality Prediction with Clinical Transformer and Per-Case Modality Attribution [42.85462513661566]
  We present a lightweight, transparent multimodal ensemble that fuses physiological time-series measurements with unstructured clinical notes from the first 48 hours of an ICU stay.<n>A logistic regression model combines predictions from two modality-specific models: a bidirectional LSTM for vitals and a finetuned ClinicalModernBERT transformer for notes.<n>On the MIMIC-III benchmark, our late-fusion ensemble improves discrimination over the best single model while maintaining well-calibrated predictions.
  arXiv  Detail & Related papers  (2025-11-19T20:11:49Z)
• AttentiveGRUAE: An Attention-Based GRU Autoencoder for Temporal Clustering and Behavioral Characterization of Depression from Wearable Data [46.262619407930266]
  We present AttentiveGRUAE, a novel attention-based gated recurrent unit (GRU) autoencoder designed for temporal clustering and prediction of outcome from longitudinal wearable data.<n>We evaluate AttentiveGRUAE on longitudinal sleep data from 372 participants (GLOBEM 2018-2019)<n>It demonstrates superior performance over baseline clustering, domain-aligned self-supervised, and ablated models in both clustering quality and depression classification.
  arXiv  Detail & Related papers  (2025-10-02T20:52:16Z)
• ERSR: An Ellipse-constrained pseudo-label refinement and symmetric regularization framework for semi-supervised fetal head segmentation in ultrasound images [11.602941736726633]
  We propose a novel semi-supervised framework, ERSR, for fetal head ultrasound segmentation.<n>Our framework consists of the dual-scoring adaptive filtering strategy, the ellipse-constrained pseudo-label refinement, and the symmetry-based multiple consistency regularization.<n>Our method achieves state-of-the-art performance on two benchmarks.
  arXiv  Detail & Related papers  (2025-08-27T12:01:57Z)
• AHDMIL: Asymmetric Hierarchical Distillation Multi-Instance Learning for Fast and Accurate Whole-Slide Image Classification [51.525891360380285]
  AHDMIL is an Asymmetric Hierarchical Distillation Multi-Instance Learning framework.<n>It eliminates irrelevant patches through a two-step training process.<n>It consistently outperforms previous state-of-the-art methods in both classification performance and inference speed.
  arXiv  Detail & Related papers  (2025-08-07T07:47:16Z)
• Survival Modeling from Whole Slide Images via Patch-Level Graph Clustering and Mixture Density Experts [7.0624785659308165]
  We propose a modular framework for predicting cancer specific survival from whole slide pathology images.<n>The framework consists of four key stages designed to capture prognostic morphological and heterogeneity.
  arXiv  Detail & Related papers  (2025-07-22T11:32:36Z)
• Multiple Time Series Fusion Based on LSTM An Application to CAP A Phase Classification Using EEG [56.155331323304]
  Deep learning based electroencephalogram channels' feature level fusion is carried out in this work. Channel selection, fusion, and classification procedures were optimized by two optimization algorithms.
  arXiv  Detail & Related papers  (2021-12-18T14:17:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.