FOAL: Fast Online Adaptive Learning for Cardiac Motion Estimation

• URL: http://arxiv.org/abs/2003.04492v2
• Date: Fri, 14 Aug 2020 18:02:53 GMT
• Title: FOAL: Fast Online Adaptive Learning for Cardiac Motion Estimation
• Abstract summary: Motion estimation of cardiac MRI videos is crucial for the evaluation of human heart anatomy and function. Recent researches show promising results with deep learning-based methods, but they suffer dramatic performance drops due to mismatched between training and testing datasets. We propose a novel fast online adaptive learning framework: an online gradient descent based that is optimized by a meta-learner.
• Score: 20.642769236234848
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Motion estimation of cardiac MRI videos is crucial for the evaluation of human heart anatomy and function. Recent researches show promising results with deep learning-based methods. In clinical deployment, however, they suffer dramatic performance drops due to mismatched distributions between training and testing datasets, commonly encountered in the clinical environment. On the other hand, it is arguably impossible to collect all representative datasets and to train a universal tracker before deployment. In this context, we proposed a novel fast online adaptive learning (FOAL) framework: an online gradient descent based optimizer that is optimized by a meta-learner. The meta-learner enables the online optimizer to perform a fast and robust adaptation. We evaluated our method through extensive experiments on two public clinical datasets. The results showed the superior performance of FOAL in accuracy compared to the offline-trained tracking method. On average, the FOAL took only $0.4$ second per video for online optimization.

Related papers

• MetaDAT: Generalizable Trajectory Prediction via Meta Pre-training and Data-Adaptive Test-Time Updating [18.84791793147564]
  Existing trajectory prediction methods exhibit significant performance degradation under distribution shifts during test time.<n>We propose a meta-learning framework to directly optimize the predictor for fast and accurate online adaptation.<n>At test time, we introduce a data-adaptive model updating mechanism that dynamically adjusts the learning rates and updating frequencies based on online partial derivatives and hard sample selection.<n>Results demonstrate that our method achieves superior adaptation accuracy, surpassing state-of-the-art test-time training methods for trajectory prediction.
  arXiv  Detail & Related papers  (2026-03-10T09:34:32Z)
• Heart Disease Prediction: A Comparative Study of Optimisers Performance in Deep Neural Networks [0.0]
  We compare the performance of 10 different approaches in training a simple Multi-layer Perceptron model using a heart disease dataset from Kaggle.<n>We set up a consistent training paradigm and evaluate the metrics based on metrics such as convergence speed and stability.<n>Across all our metrics, we chose RMSProp to be the most effective for this heart disease prediction task because it offered a balanced performance across key metrics.
  arXiv  Detail & Related papers  (2025-09-10T11:15:44Z)
• Towards High Data Efficiency in Reinforcement Learning with Verifiable Reward [54.708851958671794]
  We propose a Data-Efficient Policy Optimization pipeline that combines optimized strategies for both offline and online data selection.<n>In offline phase, we curate a high-quality subset of training samples based on diversity, influence, and appropriate difficulty.<n>During online RLVR training, we introduce a sample-level explorability metric to dynamically filter samples with low exploration potential.
  arXiv  Detail & Related papers  (2025-09-01T10:04:20Z)
• FREE: Faster and Better Data-Free Meta-Learning [77.90126669914324]
  Data-Free Meta-Learning (DFML) aims to extract knowledge from a collection of pre-trained models without requiring the original data. We introduce the Faster and Better Data-Free Meta-Learning framework, which contains: (i) a meta-generator for rapidly recovering training tasks from pre-trained models; and (ii) a meta-learner for generalizing to new unseen tasks.
  arXiv  Detail & Related papers  (2024-05-02T03:43:19Z)
• Incorporating Test-Time Optimization into Training with Dual Networks for Human Mesh Recovery [35.138312681232264]
  We propose a dual-network architecture that unifies the training-time and test-time objectives. Our method, armed with meta-learning and the dual networks, outperforms state-of-the-art regression-based and optimization-based HMR approaches.
  arXiv  Detail & Related papers  (2024-01-25T12:04:53Z)
• Applications of Sequential Learning for Medical Image Classification [0.13191970195165517]
  We develop a neural network training framework for continual training of small amounts of medical imaging data. We address problems that impede sequential learning such as overfitting, catastrophic forgetting, and concept drift.
  arXiv  Detail & Related papers  (2023-09-26T00:46:25Z)
• Robust Learning with Progressive Data Expansion Against Spurious Correlation [65.83104529677234]
  We study the learning process of a two-layer nonlinear convolutional neural network in the presence of spurious features. Our analysis suggests that imbalanced data groups and easily learnable spurious features can lead to the dominance of spurious features during the learning process. We propose a new training algorithm called PDE that efficiently enhances the model's robustness for a better worst-group performance.
  arXiv  Detail & Related papers  (2023-06-08T05:44:06Z)
• Learning Large-scale Neural Fields via Context Pruned Meta-Learning [60.93679437452872]
  We introduce an efficient optimization-based meta-learning technique for large-scale neural field training. We show how gradient re-scaling at meta-test time allows the learning of extremely high-quality neural fields. Our framework is model-agnostic, intuitive, straightforward to implement, and shows significant reconstruction improvements for a wide range of signals.
  arXiv  Detail & Related papers  (2023-02-01T17:32:16Z)
• Automatic Assessment of Functional Movement Screening Exercises with Deep Learning Architectures [0.0]
  The success of physiotherapy depends on the regular and correct performance of movement exercises. Previous approaches in this area rarely rely on Deep Learning methods and do not yet fully use their potential.
  arXiv  Detail & Related papers  (2022-10-03T20:00:01Z)
• Learn Fine-grained Adaptive Loss for Multiple Anatomical Landmark Detection in Medical Images [15.7026400415269]
  We propose a novel learning-to-learn framework for landmark detection. Our proposed framework is general and shows the potential to improve the efficiency of anatomical landmark detection.
  arXiv  Detail & Related papers  (2021-05-19T13:39:18Z)
• Faster Meta Update Strategy for Noise-Robust Deep Learning [62.08964100618873]
  We introduce a novel Faster Meta Update Strategy (FaMUS) to replace the most expensive step in the meta gradient with a faster layer-wise approximation. We show our method is able to save two-thirds of the training time while still maintaining the comparable or achieving even better generalization performance.
  arXiv  Detail & Related papers  (2021-04-30T16:19:07Z)
• One to Many: Adaptive Instrument Segmentation via Meta Learning and Dynamic Online Adaptation in Robotic Surgical Video [71.43912903508765]
  MDAL is a dynamic online adaptive learning scheme for instrument segmentation in robot-assisted surgery. It learns the general knowledge of instruments and the fast adaptation ability through the video-specific meta-learning paradigm. It outperforms other state-of-the-art methods on two datasets.
  arXiv  Detail & Related papers  (2021-03-24T05:02:18Z)
• Motion Pyramid Networks for Accurate and Efficient Cardiac Motion Estimation [51.72616167073565]
  We propose Motion Pyramid Networks, a novel deep learning-based approach for accurate and efficient cardiac motion estimation. We predict and fuse a pyramid of motion fields from multiple scales of feature representations to generate a more refined motion field. We then use a novel cyclic teacher-student training strategy to make the inference end-to-end and further improve the tracking performance.
  arXiv  Detail & Related papers  (2020-06-28T21:03:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.