VISTA: Validation-Guided Integration of Spatial and Temporal Foundation Models with Anatomical Decoding for Rare-Pathology VCE Event Detection -- after competition results

• URL: http://arxiv.org/abs/2605.22096v1
• Date: Thu, 21 May 2026 07:35:02 GMT
• Title: VISTA: Validation-Guided Integration of Spatial and Temporal Foundation Models with Anatomical Decoding for Rare-Pathology VCE Event Detection -- after competition results
• Abstract summary: We propose VISTA, a metric-aligned multi-backbone framework for the RAREVISION task.<n>The original official submission achieved hidden-test temporal mAP@0.5 of 0.3530 and mAP@0.95 of 0.3235.<n>After the competition, extending local threshold refinement with a global coarse search improved performance to 0.3726 mAP@0.5 and 0.3431 mAP@0.95.
• Score: 9.248504942839382
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Capsule endoscopy event detection is challenging because clinically relevant findings are sparse, visually heterogeneous, and evaluated at the event level rather than by frame accuracy. We propose VISTA, a metric-aligned multi-backbone framework for the RAREVISION task. VISTA combines EndoFM-LV for temporal context and DINOv3 ViTL/16 for frame-level visual semantics, followed by a Diverse Head Ensemble (DHE), Validation-Guided Weighted Fusion (VGWF), and Anatomy-Aware Temporal Event Decoding (ATED). The original official submission achieved hidden-test temporal mAP@0.5 of 0.3530 and mAP@0.95 of 0.3235. After the competition, extending local threshold refinement with a global coarse search improved performance to 0.3726 mAP@0.5 and 0.3431 mAP@0.95, ranking Team ACVLab second in the post-competition evaluation.

Related papers

• TMF-RSE: Tri-Modal Fusion with Regional Semantics and Evidential Uncertainty for Lung Severity Scoring [11.785230718509196]
  We propose a tri-modal deep learning framework, TMF-RSE, that combines appearance features from two-dimensional chest inputs, structural features from lung segmentation masks, and semantic features from vision-language models for severity quantification.<n>Our approach employs complementary fusion mechanisms that integrate semantic guidance, structural priors, and hierarchical interactions across modalities.<n> Experiments on the Per-COVID-19 CT and RALO datasets show that TMF-RSE outperforms recent transformer-based baselines.
  arXiv  Detail & Related papers  (2026-07-07T14:54:40Z)
• GALAR-TemporalNet v2: Anatomy-Guided Dual-Branch Temporal Classification with Bidirectional Mamba and Dual-Graph GCN for Video Capsule Endoscopy -- after competition results [2.9421642252347624]
  We present a hierarchical temporal model that addresses three core challenges: extreme class imbalance, long-range temporal dependencies, and pathology--anatomy entanglement.<n>Our architecture combines windowed self-attention for local modeling, a Dual-Graph GCN for global frame relationships, and Bidirectional Mamba for selective boundary context encoding.
  arXiv  Detail & Related papers  (2026-05-21T09:15:43Z)
• Training-inference input alignment outweighs framework choice in longitudinal retinal image prediction [3.0602131532925436]
  Recent methods have moved toward increasing generative complexity, but the conditions under which this complexity is necessary remain unclear.<n>We propose that generative complexity should match the entropy of a predictable task's conditional posterior component, with training-inference input alignment required in all regimes.<n>We validated this framework on a fundus autofluorescence dataset by contrasting five configurations.
  arXiv  Detail & Related papers  (2026-04-18T10:28:00Z)
• ConvFormer3D-TAP: Phase/Uncertainty-Aware Front-End Fusion for Cine CMR View Classification Pipelines [0.879504058268139]
  ConvFormer3D-TAP integrates 3D convolutional tokenization with multiscale self-attention to enhance robustness across cardiac phases and ambiguous temporal segments.<n>On a cohort of 150,974 clinically acquired cine sequences, ConvFormer3D- achieved 96% validation accuracy with per-class F1-scores.<n>These results support ConvFormer3DTAP as a scalable front-end for view routing, filtering and quality control in end-to-end cMRI.
  arXiv  Detail & Related papers  (2026-04-13T12:29:16Z)
• VISTA: Validation-Guided Integration of Spatial and Temporal Foundation Models with Anatomical Decoding for Rare-Pathology VCE Event Detection [39.50945484737978]
  We formulate the RARE-VISION task as a metric-aligned event detection problem instead of a purely frame-wise classification task.<n>Our framework combines two complementary backbones, EndoFM-LV for local temporal context and DINOv3 ViT-L/16 for strong frame-level visual semantics.<n> validation ablations indicate that complementary backbones, validation-guided fusion, and anatomy-aware temporal decoding all contribute to event-level performance.
  arXiv  Detail & Related papers  (2026-03-18T23:01:12Z)
• Suppressing Prior-Comparison Hallucinations in Radiology Report Generation via Semantically Decoupled Latent Steering [94.37535002230504]
  We develop a training-free, inference-time control framework termed Semantically Decoupled Latent Steering.<n>Our approach constructs a semantic-free intervention vector via large language model (LLM)-driven semantic decomposition.<n>We show that our approach significantly reduces the probability of historical hallucinations.
  arXiv  Detail & Related papers  (2026-02-27T04:49:01Z)
• Cross-Sample Augmented Test-Time Adaptation for Personalized Intraoperative Hypotension Prediction [45.67071315035565]
  Intraoperative hypotension poses significant surgical risks, but accurate prediction remains challenging due to patient-specific variability.<n>We propose CSA-TTA, a novel Cross-Sample Augmented Test-Time Adaptation framework that enhances training by incorporating hypotension events from other individuals.<n>We evaluate the proposed CSA-TTA on both the VitalDB dataset and a real-world in-hospital dataset by integrating it with state-of-the-art time series forecasting models.
  arXiv  Detail & Related papers  (2025-12-12T08:02:37Z)
• AttentiveGRUAE: An Attention-Based GRU Autoencoder for Temporal Clustering and Behavioral Characterization of Depression from Wearable Data [46.262619407930266]
  We present AttentiveGRUAE, a novel attention-based gated recurrent unit (GRU) autoencoder designed for temporal clustering and prediction of outcome from longitudinal wearable data.<n>We evaluate AttentiveGRUAE on longitudinal sleep data from 372 participants (GLOBEM 2018-2019)<n>It demonstrates superior performance over baseline clustering, domain-aligned self-supervised, and ablated models in both clustering quality and depression classification.
  arXiv  Detail & Related papers  (2025-10-02T20:52:16Z)
• A Novel Attention-Augmented Wavelet YOLO System for Real-time Brain Vessel Segmentation on Transcranial Color-coded Doppler [49.03919553747297]
  We propose an AI-powered, real-time CoW auto-segmentation system capable of efficiently capturing cerebral arteries.<n>No prior studies have explored AI-driven cerebrovascular segmentation using Transcranial Color-coded Doppler (TCCD)<n>The proposed AAW-YOLO demonstrated strong performance in segmenting both ipsilateral and contralateral CoW vessels.
  arXiv  Detail & Related papers  (2025-08-19T14:41:22Z)
• Weakly supervised segmentation of intracranial aneurysms using a novel 3D focal modulation UNet [0.5106162890866905]
  We propose FocalSegNet, a novel 3D focal modulation UNet, to detect an aneurysm and offer an initial, coarse segmentation of it from time-of-flight MRA image patches. We trained and evaluated our model on a public dataset, and in terms of UIA detection, our model showed a low false-positive rate of 0.21 and a high sensitivity of 0.80.
  arXiv  Detail & Related papers  (2023-08-06T03:28:08Z)
• MSED: a multi-modal sleep event detection model for clinical sleep analysis [62.997667081978825]
  We designed a single deep neural network architecture to jointly detect sleep events in a polysomnogram. The performance of the model was quantified by F1, precision, and recall scores, and by correlating index values to clinical values.
  arXiv  Detail & Related papers  (2021-01-07T13:08:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.