Predicting Blastocyst Formation in IVF: Integrating DINOv2 and Attention-Based LSTM on Time-Lapse Embryo Images
- URL: http://arxiv.org/abs/2604.16505v1
- Date: Tue, 14 Apr 2026 17:49:56 GMT
- Title: Predicting Blastocyst Formation in IVF: Integrating DINOv2 and Attention-Based LSTM on Time-Lapse Embryo Images
- Abstract summary: A key obstacle in IVF is predicting blastocyst formation from the limited number of daily images available.<n>Many clinics lack complete time-lapse systems, so full videos are often unavailable.<n>In this study, we aimed to predict which embryos will develop into blastocysts using limited daily images from time-lapse recordings.
- Score: 1.948638796030649
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The selection of the optimal embryo for transfer is a critical yet challenging step in in vitro fertilization (IVF), primarily due to its reliance on the manual inspection of extensive time-lapse imaging data. A key obstacle in this process is predicting blastocyst formation from the limited number of daily images available. Many clinics also lack complete time-lapse systems, so full videos are often unavailable. In this study, we aimed to predict which embryos will develop into blastocysts using limited daily images from time-lapse recordings. We propose a novel hybrid model that combines DINOv2, a transformer-based vision model, with an enhanced long short-term memory (LSTM) network featuring a multi-head attention layer. DINOv2 extracts meaningful features from embryo images, and the LSTM model then uses these features to analyze embryo development over time and generate final predictions. We tested our model on a real dataset of 704 embryo videos. The model achieved 96.4% accuracy, surpassing existing methods. It also performs well with missing frames, making it valuable for many IVF laboratories with limited imaging systems. Our approach can assist embryologists in selecting better embryos more efficiently and with greater confidence.
Related papers
- Epistemic-aware Vision-Language Foundation Model for Fetal Ultrasound Interpretation [83.02147613524032]
We introduce FetalMind, a medical AI system tailored to fetal ultrasound for both report generation and diagnosis.<n>We propose Salient Epistemic Disentanglement (SED), which injects an expert-curated bipartite graph into the model to decouple view-disease associations.<n>FetalMind outperforms open- and closed-source baselines across all gestational stages, achieving +14% average gains and +61.2% higher accuracy on critical conditions.
arXiv Detail & Related papers (2025-10-14T19:57:03Z) - Interpretation of Deep Learning Model in Embryo Selection for In Vitro Fertilization (IVF) Treatment [0.0]
Expert embryologists conventionally grade embryos by reviewing blastocyst images to select the most optimal for transfer.<n>In this study, we introduce an explainable artificial intelligence framework for classifying embryos, employing a fusion of convolutional neural network (CNN) and long short-term memory (LSTM) architecture.<n>Our model achieves high accuracy in embryo classification while maintaining interpretability through XAI.
arXiv Detail & Related papers (2025-06-07T06:25:22Z) - DiffDoctor: Diagnosing Image Diffusion Models Before Treating [57.82359018425674]
We propose DiffDoctor, a two-stage pipeline to assist image diffusion models in generating fewer artifacts.<n>We collect a dataset of over 1M flawed synthesized images and set up an efficient human-in-the-loop annotation process.<n>The learned artifact detector is then involved in the second stage to optimize the diffusion model by providing pixel-level feedback.
arXiv Detail & Related papers (2025-01-21T18:56:41Z) - Merging synthetic and real embryo data for advanced AI predictions [69.07284335967019]
We train two generative models using two datasets-one we created and made publicly available, and one existing public dataset-to generate synthetic embryo images at various cell stages.<n>These were combined with real images to train classification models for embryo cell stage prediction.<n>Our results demonstrate that incorporating synthetic images alongside real data improved classification performance, with the model achieving 97% accuracy compared to 94.5% when trained solely on real data.
arXiv Detail & Related papers (2024-12-02T08:24:49Z) - Multimodal Learning for Embryo Viability Prediction in Clinical IVF [24.257300904706902]
In clinical In-Vitro Fertilization (IVF), identifying the most viable embryo for transfer is important to increasing the likelihood of a successful pregnancy.
Traditionally, this process involves embryologists manually assessing embryos' static morphological features at specific intervals using light microscopy.
This manual evaluation is not only time-intensive and costly, due to the need for expert analysis, but also inherently subjective, leading to variability in the selection process.
arXiv Detail & Related papers (2024-10-21T01:58:26Z) - Neuromorphic Synergy for Video Binarization [54.195375576583864]
Bimodal objects serve as a visual form to embed information that can be easily recognized by vision systems.
Neuromorphic cameras offer new capabilities for alleviating motion blur, but it is non-trivial to first de-blur and then binarize the images in a real-time manner.
We propose an event-based binary reconstruction method that leverages the prior knowledge of the bimodal target's properties to perform inference independently in both event space and image space.
We also develop an efficient integration method to propagate this binary image to high frame rate binary video.
arXiv Detail & Related papers (2024-02-20T01:43:51Z) - Robotic Navigation Autonomy for Subretinal Injection via Intelligent
Real-Time Virtual iOCT Volume Slicing [88.99939660183881]
We propose a framework for autonomous robotic navigation for subretinal injection.
Our method consists of an instrument pose estimation method, an online registration between the robotic and the i OCT system, and trajectory planning tailored for navigation to an injection target.
Our experiments on ex-vivo porcine eyes demonstrate the precision and repeatability of the method.
arXiv Detail & Related papers (2023-01-17T21:41:21Z) - Developmental Stage Classification of EmbryosUsing Two-Stream Neural
Network with Linear-Chain Conditional Random Field [74.53314729742966]
We propose a two-stream model for developmental stage classification.
Unlike previous methods, our two-stream model accepts both temporal and image information.
We demonstrate our algorithm on two time-lapse embryo video datasets.
arXiv Detail & Related papers (2021-07-13T19:56:01Z) - Robust and generalizable embryo selection based on artificial
intelligence and time-lapse image sequences [0.0]
We investigate how a deep learning-based embryo selection model using only time-lapse image sequences performs across different patient ages and clinical conditions.
The model was trained and evaluated based on a large dataset from 18 IVF centers consisting of 115,832 embryos.
The fully automated iDAScore v1.0 model was shown to perform at least as good as a state-of-the-art manual embryo selection model.
arXiv Detail & Related papers (2021-03-12T13:36:30Z) - Deep learning mediated single time-point image-based prediction of
embryo developmental outcome at the cleavage stage [1.6753684438635652]
Cleavage stage transfers are beneficial for patients with poor prognosis and at fertility centers in resource-limited settings.
Time-lapse imaging systems have been proposed as possible solutions, but they are cost-prohibitive and require bulky and expensive hardware.
Here, we report an automated system for classification and selection of human embryos at the cleavage stage using a trained CNN combined with a genetic algorithm.
arXiv Detail & Related papers (2020-05-21T21:21:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.