DLTTA: Dynamic Learning Rate for Test-time Adaptation on Cross-domain
Medical Images
- URL: http://arxiv.org/abs/2205.13723v1
- Date: Fri, 27 May 2022 02:34:32 GMT
- Title: DLTTA: Dynamic Learning Rate for Test-time Adaptation on Cross-domain
Medical Images
- Authors: Hongzheng Yang, Cheng Chen, Meirui Jiang, Quande Liu, Jianfeng Cao,
Pheng Ann Heng, Qi Dou
- Abstract summary: We propose a novel dynamic learning rate adjustment method for test-time adaptation, called DLTTA.
Our method achieves effective and fast test-time adaptation with consistent performance improvement over current state-of-the-art test-time adaptation methods.
- Score: 56.72015587067494
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Test-time adaptation (TTA) has increasingly been an important topic to
efficiently tackle the cross-domain distribution shift at test time for medical
images from different institutions. Previous TTA methods have a common
limitation of using a fixed learning rate for all the test samples. Such a
practice would be sub-optimal for TTA, because test data may arrive
sequentially therefore the scale of distribution shift would change frequently.
To address this problem, we propose a novel dynamic learning rate adjustment
method for test-time adaptation, called DLTTA, which dynamically modulates the
amount of weights update for each test image to account for the differences in
their distribution shift. Specifically, our DLTTA is equipped with a memory
bank based estimation scheme to effectively measure the discrepancy of a given
test sample. Based on this estimated discrepancy, a dynamic learning rate
adjustment strategy is then developed to achieve a suitable degree of
adaptation for each test sample. The effectiveness and general applicability of
our DLTTA is extensively demonstrated on three tasks including retinal optical
coherence tomography (OCT) segmentation, histopathological image
classification, and prostate 3D MRI segmentation. Our method achieves effective
and fast test-time adaptation with consistent performance improvement over
current state-of-the-art test-time adaptation methods. Code is available at:
https://github.com/med-air/DLTTA.
Related papers
- PMT: Progressive Mean Teacher via Exploring Temporal Consistency for Semi-Supervised Medical Image Segmentation [51.509573838103854]
We propose a semi-supervised learning framework, termed Progressive Mean Teachers (PMT), for medical image segmentation.
Our PMT generates high-fidelity pseudo labels by learning robust and diverse features in the training process.
Experimental results on two datasets with different modalities, i.e., CT and MRI, demonstrate that our method outperforms the state-of-the-art medical image segmentation approaches.
arXiv Detail & Related papers (2024-09-08T15:02:25Z) - Gradient Alignment Improves Test-Time Adaptation for Medical Image Segmentation [15.791041311313448]
gradient alignment-based Test-time adaptation (GraTa) method to improve gradient direction and learning rate.
GraTa method incorporates an auxiliary gradient with the pseudo one to facilitate gradient alignment.
Design a dynamic learning rate based on the cosine similarity between the pseudo and auxiliary gradients.
arXiv Detail & Related papers (2024-08-14T07:37:07Z) - Active Test-Time Adaptation: Theoretical Analyses and An Algorithm [51.84691955495693]
Test-time adaptation (TTA) addresses distribution shifts for streaming test data in unsupervised settings.
We propose the novel problem setting of active test-time adaptation (ATTA) that integrates active learning within the fully TTA setting.
arXiv Detail & Related papers (2024-04-07T22:31:34Z) - Each Test Image Deserves A Specific Prompt: Continual Test-Time Adaptation for 2D Medical Image Segmentation [14.71883381837561]
Cross-domain distribution shift is a significant obstacle to deploying the pre-trained semantic segmentation model in real-world applications.
Test-time adaptation has proven its effectiveness in tackling the cross-domain distribution shift during inference.
We propose the Visual Prompt-based Test-Time Adaptation (VPTTA) method to train a specific prompt for each test image to align the statistics in the batch normalization layers.
arXiv Detail & Related papers (2023-11-30T09:03:47Z) - Point-TTA: Test-Time Adaptation for Point Cloud Registration Using
Multitask Meta-Auxiliary Learning [17.980649681325406]
We present Point-TTA, a novel test-time adaptation framework for point cloud registration (PCR)
Our model can adapt to unseen distributions at test-time without requiring any prior knowledge of the test data.
During training, our model is trained using a meta-auxiliary learning approach, such that the adapted model via auxiliary tasks improves the accuracy of the primary task.
arXiv Detail & Related papers (2023-08-31T06:32:11Z) - A Comprehensive Survey on Test-Time Adaptation under Distribution Shifts [143.14128737978342]
Test-time adaptation, an emerging paradigm, has the potential to adapt a pre-trained model to unlabeled data during testing, before making predictions.
Recent progress in this paradigm highlights the significant benefits of utilizing unlabeled data for training self-adapted models prior to inference.
arXiv Detail & Related papers (2023-03-27T16:32:21Z) - DELTA: degradation-free fully test-time adaptation [59.74287982885375]
We find that two unfavorable defects are concealed in the prevalent adaptation methodologies like test-time batch normalization (BN) and self-learning.
First, we reveal that the normalization statistics in test-time BN are completely affected by the currently received test samples, resulting in inaccurate estimates.
Second, we show that during test-time adaptation, the parameter update is biased towards some dominant classes.
arXiv Detail & Related papers (2023-01-30T15:54:00Z) - Efficient Test-Time Model Adaptation without Forgetting [60.36499845014649]
Test-time adaptation seeks to tackle potential distribution shifts between training and testing data.
We propose an active sample selection criterion to identify reliable and non-redundant samples.
We also introduce a Fisher regularizer to constrain important model parameters from drastic changes.
arXiv Detail & Related papers (2022-04-06T06:39:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.