CONFLUX: A Latent Diffusion Model for 3D Chest-CT Synthesis with RL Post-Training

• URL: http://arxiv.org/abs/2607.02998v2
• Date: Tue, 07 Jul 2026 11:19:28 GMT
• Title: CONFLUX: A Latent Diffusion Model for 3D Chest-CT Synthesis with RL Post-Training
• Abstract summary: Controllable generative models of 3D medical images can synthesize volumes with specified clinical attributes.<n>We present CONFLUX, a latent diffusion model for chest computed tomography (CT)<n>A 3D variational autoencoder compresses each volume, and a rectified-flow transformer generates in the latent space.
• Score: 2.2462804525190427
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Controllable generative models of 3D medical images can synthesize volumes with specified clinical attributes, but this demands samples that are simultaneously high-fidelity, natively 3D, and faithful to the requested conditioning. We present CONFLUX, a latent diffusion model for chest computed tomography (CT): a 3D variational autoencoder compresses each volume, and a rectified-flow transformer generates in the latent space. Generation is conditioned on structured radiological metadata (18 abnormality findings, sex, age, and reconstruction kernel) through adaptive layer normalization. The model leads strong volumetric baselines on tri-planar Frechet distance (FID 32.3 vs. 74.6 for MAISI) while exposing direct control over clinical attributes. To strengthen that control we add an online reinforcement-learning post-training stage (group-relative policy optimization) that rewards how reliably a classifier recovers the requested findings from each generated volume. Judged by a separate, independent classifier, post-training removes 47% of the shortfall relative to real-scan reliability. We release the model and a ~200k synthetic chest-CT dataset with conditioning metadata spanning a wide variety of clinical findings.

Related papers

• TMF-RSE: Tri-Modal Fusion with Regional Semantics and Evidential Uncertainty for Lung Severity Scoring [11.785230718509196]
  We propose a tri-modal deep learning framework, TMF-RSE, that combines appearance features from two-dimensional chest inputs, structural features from lung segmentation masks, and semantic features from vision-language models for severity quantification.<n>Our approach employs complementary fusion mechanisms that integrate semantic guidance, structural priors, and hierarchical interactions across modalities.<n> Experiments on the Per-COVID-19 CT and RALO datasets show that TMF-RSE outperforms recent transformer-based baselines.
  arXiv  Detail & Related papers  (2026-07-07T14:54:40Z)
• Evidence-Based Text-Conditioned 3D CT Synthesis for Ovarian Cancer [9.862634656196759]
  Ovarian cancer is frequently diagnosed at an advanced stage, making preoperative contrast-enhanced computed tomography (CT) central to staging and surgical planning.<n>Text-conditioned 3D CT synthesis has shown promise, but existing pipelines depend on paired radiology reports and have been evaluated only on chest CT.<n>We propose OvESyn, a framework that constructs standardized Findings and Impression sections directly from CT-derived imaging descriptors and routine clinical metadata.
  arXiv  Detail & Related papers  (2026-06-27T15:30:29Z)
• Anatomically-conditioned Latent Diffusion Model for Data-Efficient Few-Shot Cross-Domain 3D Glioma MRI Synthesis [1.4312099612976772]
  Anatomically-conditioned Latent Diffusion Model (ALDM) is a novel framework for data-efficient, few-shot 3D MRI synthesis.<n> evaluated in an extreme few-shot setting with only 16 target images.
  arXiv  Detail & Related papers  (2026-06-24T04:42:42Z)
• EPC-3D-Diff: Equivariant Physics Consistent Conditional 3D Latent Diffusion for CBCT to CT Synthesis [36.790666885042356]
  We propose EPC-3D-Diff, a novel conditional 3D latent diffusion framework for CBCT to CT synthesis.<n>We exploit the fact that an in plane rotation of the volume corresponds to an angular shift in its projections.<n>We validate on a paired head CBCT/CT phantom dataset, including repeat scans, and paired clinical data using patient wise splits.<n> EPC-3D-Diff generalizes well and achieved substantial improvements, +7.4 dB (phantom) and +1.8 dB (clinical data) in PSNR compared to state of the art methods.
  arXiv  Detail & Related papers  (2026-05-19T20:34:09Z)
• 3D Ultrasound-Derived Pseudo-CT Synthesis Using a Transformer-Augmented Residual Network for Real-Time Operator Guidance [0.0]
  Ultrasound (US) is non-ionizing and widely accessible; however, it is highly operator dependent and lacks quantitative tissue characterization.<n>This work presents a 3D ultrasound-derived pseudo-CT framework that generates CT-like anatomical reference volumes inferred from US.<n>The proposed method outperforms established baselines in structural fidelity and perceptual image quality.
  arXiv  Detail & Related papers  (2026-05-06T12:52:59Z)
• EqDiff-CT: Equivariant Conditional Diffusion model for CT Image Synthesis from CBCT [43.92108185590778]
  Cone-beam computed tomography (CBCT) is widely used for imageguided radiotherapy (IGRT)<n>We propose a novel diffusion-based conditional generative model, coined EqDiff-CT, to synthesize high-quality CT images from CBCT.
  arXiv  Detail & Related papers  (2025-09-26T05:51:59Z)
• Random forest-based out-of-distribution detection for robust lung cancer segmentation [2.6825994665041235]
  Transformer-based models with self-supervised pretraining can produce reliably accurate segmentation from in-distribution (ID) data but degrade when applied to out-of-distribution (OOD) datasets.<n>We address this challenge with RF-Deep, a random forest classifier that utilizes deep features from a pretrained transformer encoder of the segmentation model to detect OOD scans and enhance segmentation reliability.
  arXiv  Detail & Related papers  (2025-08-26T15:14:29Z)
• Towards Unified and Lossless Latent Space for 3D Molecular Latent Diffusion Modeling [90.23688195918432]
  3D molecule generation is crucial for drug discovery and material science.<n>Existing approaches typically maintain separate latent spaces for invariant and equivariant modalities.<n>We propose textbfUAE-3D, a multi-modal VAE that compresses 3D molecules into latent sequences from a unified latent space.
  arXiv  Detail & Related papers  (2025-03-19T08:56:13Z)
• Validated respiratory drug deposition predictions from 2D and 3D medical images with statistical shape models and convolutional neural networks [47.187609203210705]
  We aim to develop and validate an automated computational framework for patient-specific deposition modelling. An image processing approach is proposed that could produce 3D patient respiratory geometries from 2D chest X-rays and 3D CT images.
  arXiv  Detail & Related papers  (2023-03-02T07:47:07Z)
• Image Synthesis with Disentangled Attributes for Chest X-Ray Nodule Augmentation and Detection [52.93342510469636]
  Lung nodule detection in chest X-ray (CXR) images is common to early screening of lung cancers. Deep-learning-based Computer-Assisted Diagnosis (CAD) systems can support radiologists for nodule screening in CXR. To alleviate the limited availability of such datasets, lung nodule synthesis methods are proposed for the sake of data augmentation.
  arXiv  Detail & Related papers  (2022-07-19T16:38:48Z)
• Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans [72.04652116817238]
  We propose a differentiable neural architecture search (DNAS) framework to automatically search for the 3D DL models for 3D chest CT scans classification. We also exploit the Class Activation Mapping (CAM) technique on our models to provide the interpretability of the results.
  arXiv  Detail & Related papers  (2021-01-14T03:45:01Z)
• Revisiting 3D Context Modeling with Supervised Pre-training for Universal Lesion Detection in CT Slices [48.85784310158493]
  We propose a Modified Pseudo-3D Feature Pyramid Network (MP3D FPN) to efficiently extract 3D context enhanced 2D features for universal lesion detection in CT slices. With the novel pre-training method, the proposed MP3D FPN achieves state-of-the-art detection performance on the DeepLesion dataset. The proposed 3D pre-trained weights can potentially be used to boost the performance of other 3D medical image analysis tasks.
  arXiv  Detail & Related papers  (2020-12-16T07:11:16Z)
• Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumes [64.21642241351857]
  We curated and analyzed a chest computed tomography (CT) data set of 36,316 volumes from 19,993 unique patients. We developed a rule-based method for automatically extracting abnormality labels from free-text radiology reports. We also developed a model for multi-organ, multi-disease classification of chest CT volumes.
  arXiv  Detail & Related papers  (2020-02-12T00:59:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.