Extending ZACH-ViT to Robust Medical Imaging: Corruption and Adversarial Stress Testing in Low-Data Regimes

• URL: http://arxiv.org/abs/2604.06099v1
• Date: Tue, 07 Apr 2026 17:11:07 GMT
• Title: Extending ZACH-ViT to Robust Medical Imaging: Corruption and Adversarial Stress Testing in Low-Data Regimes
• Abstract summary: ZACH-ViT (Zero-token Adaptive Compact Hierarchical Vision Transformer) formalized a compact permutation-invariant Vision Transformer for medical imaging.<n>We present the first robustness-focused extension of ZACH-ViT by evaluating its behavior under common image corruptions and adversarial perturbations.
• Score: 0.23166812624868952
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The recently introduced ZACH-ViT (Zero-token Adaptive Compact Hierarchical Vision Transformer) formalized a compact permutation-invariant Vision Transformer for medical imaging and argued that architectural alignment with spatial structure can matter more than universal benchmark dominance. Its design was motivated by the observation that positional embeddings and a dedicated class token encode fixed spatial assumptions that may be suboptimal when spatial organization is weakly informative, locally distributed, or variable across biomedical images. The foundational study established a regime-dependent clean performance profile across MedMNIST, but did not examine robustness in detail. In this work, we present the first robustness-focused extension of ZACH-ViT by evaluating its behavior under common image corruptions and adversarial perturbations in the same low-data setting. We compare ZACH-ViT with three scratch-trained compact baselines, ABMIL, Minimal-ViT, and TransMIL, on seven MedMNIST datasets using 50 samples per class, fixed hyperparameters, and five random seeds. Across the benchmark, ZACH-ViT achieves the best overall mean rank on clean data (1.57) and under common corruptions (1.57), indicating a favorable balance between baseline predictive performance and robustness to realistic image degradation. Under adversarial stress, all models deteriorate substantially; nevertheless, ZACH-ViT remains competitive, ranking first under FGSM (2.00) and second under PGD (2.29), where ABMIL performs best overall. These results extend the original ZACH-ViT narrative: the advantages of compact permutation-invariant transformers are not limited to clean evaluation, but can persist under realistic perturbation stress in low-data medical imaging, while adversarial robustness remains an open challenge for all evaluated models.

Related papers

• SVC-Probe: A Framework for Evaluating Perturbation Generalization in Spatial Foundation-Model Embeddings [3.884856136722027]
  This work examines generalization in spatial foundation-model embeddings derived from fluorescence microscopy images.<n>We introduce SVC-Probe, a perturbation-aware framework that combines Subcellular Embedding Atlas Stability, Mondrian Neighborhood Graphs, and a Foundation Model Perturbation Probe.
  arXiv  Detail & Related papers  (2026-06-26T13:46:36Z)
• Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedback [51.08692072066352]
  Text-to-image (T2I) models still exhibit localized, subtle, and structurally complex failures.<n>Structured Defect Grounding casts T2I diagnosis as structured set prediction by modeling each defect as a location, type, reason, importance.<n>Our detector outperforms leading proprietary VLMs on structured defect grounding.
  arXiv  Detail & Related papers  (2026-06-04T13:03:16Z)
• Learning to Synergize Semantic and Geometric Priors for Limited-Data Wheat Disease Segmentation [51.06355116973389]
  We propose a framework that treats wheat disease segmentation as a coupled task of disease-specific semantic perception and disease boundary localization.<n>Our core insight is that pretrained DINOv2 provides robust category-aware semantic priors to handle appearance shifts.<n>We show that SGPer consistently achieves state-of-the-art performance on wheat disease and organ segmentation benchmarks.
  arXiv  Detail & Related papers  (2026-04-07T04:19:39Z)
• Improving Automated Wound Assessment Using Joint Boundary Segmentation and Multi-Class Classification Models [1.1432909951914676]
  This study presents a deep learning model based on YOLOv11 that simultaneously performs wound boundary segmentation (WBS) and wound classification (WC) across five clinically relevant wound types.<n>The results confirm the model's robustness against complex backgrounds and high intra-class variability.
  arXiv  Detail & Related papers  (2026-03-28T16:11:31Z)
• VFM-Recon: Unlocking Cross-Domain Scene-Level Neural Reconstruction with Scale-Aligned Foundation Priors [49.39553550491549]
  We present VFMRecon, the first attempt to bridge transferable VFM priors with scaleconsistent requirements in scene-level neural reconstruction.<n> Specifically, we first introduce a lightweight scale alignment stage that restores multiview scale coherence.<n>We then integrate pretrained VFM features into the neural volumetric reconstruction pipeline via lightweight task-specific adapters.
  arXiv  Detail & Related papers  (2026-03-13T05:00:44Z)
• VLM-RobustBench: A Comprehensive Benchmark for Robustness of Vision-Language Models [64.56065206447788]
  Vision-language models (VLMs) achieve strong performance on standard, high-quality datasets.<n>We present VLM-RobustBench, a benchmark spanning 49 augmentation types across noise, blur, weather, digital, and geometrics.<n>We show that low-severity spatial perturbations often degrade performance more than visually severe photometric corruptions.
  arXiv  Detail & Related papers  (2026-03-06T10:58:02Z)
• ZACH-ViT: Regime-Dependent Inductive Bias in Compact Vision Transformers for Medical Imaging [0.0]
  ZACH-ViT is a compact Vision Transformer that removes both positional embeddings and the [token] token.<n>"Zero-token" specifically refers to removing the dedicated [NIST] aggregation token and positional embeddings.<n>ZACH-ViT achieves competitive performance while maintaining sub-second inference times.
  arXiv  Detail & Related papers  (2026-02-20T01:38:59Z)
• VesSAM: Efficient Multi-Prompting for Segmenting Complex Vessel [68.24765319399286]
  We present VesSAM, a powerful and efficient framework tailored for 2D vessel segmentation.<n>VesSAM integrates (1) a convolutional adapter to enhance local texture features, (2) a multi-prompt encoder that fuses anatomical prompts, and (3) a lightweight mask decoder to reduce jagged artifacts.<n>VesSAM consistently outperforms state-of-the-art PEFT-based SAM variants by over 10% Dice and 13% IoU.
  arXiv  Detail & Related papers  (2025-11-02T15:47:05Z)
• Enhancing CLIP Robustness via Cross-Modality Alignment [54.01929554563447]
  We propose Cross-modality Alignment, an optimal transport-based framework for vision-language models.<n> COLA restores global image-text alignment and local structural consistency in the feature space.<n> COLA is training-free and compatible with existing fine-tuned models.
  arXiv  Detail & Related papers  (2025-10-28T03:47:44Z)
• ZACH-ViT: A Zero-Token Vision Transformer with ShuffleStrides Data Augmentation for Robust Lung Ultrasound Classification [0.7495002546468839]
  We introduce ZACH-ViT (Zero- parameter Adaptive Compact Hierarchical Vision Transformer), a 0.25 M-Hierarchical Vision Transformer that removes both positional embeddings and variant token.<n>ZACH-ViT was evaluated on 380 LUS videos from 95 critically ill patients against nine state-of-the-art baselines.<n>It achieved the highest validation and test ROC-AUC (0.80 and 0.79) with balanced sensitivity (0.60) and specificity (0.91), while all competing models collapsed to trivial classification.
  arXiv  Detail & Related papers  (2025-10-20T15:26:38Z)
• The 1st Solution for CARE Liver Task Challenge 2025: Contrast-Aware Semi-Supervised Segmentation with Domain Generalization and Test-Time Adaptation [23.156209918252838]
  CoSSeg-TTA is a compact segmentation framework for the GED4 (Gd-EOB-DTPA enhanced hepatobiliary phase MRI) modality built upon nnU-Netv2.<n>A domain adaptation module, incorporating a randomized histogram-based style appearance transfer function and a trainable contrast-aware network, enriches domain diversity and mitigates cross-center variability.
  arXiv  Detail & Related papers  (2025-10-05T15:18:53Z)
• Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective [51.70661197256033]
  We propose ARCO, a semi-supervised contrastive learning framework with stratified group theory for medical image segmentation. We first propose building ARCO through the concept of variance-reduced estimation and show that certain variance-reduction techniques are particularly beneficial in pixel/voxel-level segmentation tasks. We experimentally validate our approaches on eight benchmarks, i.e., five 2D/3D medical and three semantic segmentation datasets, with different label settings.
  arXiv  Detail & Related papers  (2023-02-03T13:50:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.