Coarse to Fine: Iterative Adversarial Neural Cellular Automata for Medical Image Synthesis

• URL: http://arxiv.org/abs/2608.28909v1
• Date: Fri, 28 Aug 2026 22:16:35 GMT
• Title: Coarse to Fine: Iterative Adversarial Neural Cellular Automata for Medical Image Synthesis
• Abstract summary: StyleGANCA is a lightweight general-purpose generative adversarial network.<n>We show that StyleGANCA achieves competitive image quality with substantially fewer parameters than baseline architectures.
• Score: 0.9787044180368328
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large-scale, publicly available datasets have driven advances in deep learning, but privacy and legal restrictions often limit data sharing in medical imaging. Synthetic data generation offers a privacy-friendly alternative to enable the training of high-performance models on health data. While most state-of-the-art generative models produce high-quality images, they remain computationally expensive, which limits their applicability on resource-constrained hardware. We propose StyleGANCA, the first lightweight general-purpose NCA-based generative adversarial network. The architecture integrates a StyleGAN-inspired mapping network and adaptive style modulation into a multi-scale NCA synthesis process, enabling latent-controlled image generation through iterative local interactions. We evaluate StyleGANCA on BloodMNIST and PathMNIST against adversarial, variational, diffusion, and NCA-based baselines. Experimental results demonstrate that StyleGANCA achieves competitive image quality with substantially fewer parameters than baseline architectures, achieving the best FID and KID scores on PathMNIST with only 617k parameters. Furthermore, downstream experiments show that the generated images preserve class-specific information and effectively support the training of multi-class classifiers. Our code is publicly available at: https://github.com/MECLabTUDA/StyleGANCA

Related papers

• Generalized Synthetic Image Detection with Enhanced RGB-Noise Representation Learning [33.97020349697987]
  We propose RNSIDNet, a novel forensic framework that achieves robust detection through enhanced RGB-Noise representation learning.<n>Specifically, our method employs a dual-branch architecture where global RGB semantics, extracted by an attention-refined CLIP backbone, dynamically modulate high-frequency noise artifacts captured by Bayar convolutions via a Feature-wise Linear Modulation (FiLM) module.<n>To further enhance the learned representations, we design a Hard Sample-aware Contrastive Learning (HSCL) strategy.
  arXiv  Detail & Related papers  (2026-07-07T14:52:22Z)
• ICG: Improving Cover Image Generation via MLLM-based Prompting and Personalized Preference Alignment [70.19758313256503]
  We propose ICG, a framework that integrates MLLM-based prompting with personalized preference alignment to generate contextually relevant covers.<n>ICG extracts semantic features from item titles and reference images via meta tokens, refines them with user embeddings, and injects the resulting personalized context into the diffusion model.<n>Experiments demonstrate that ICG significantly improves image quality, semantic fidelity, and personalization, leading to stronger user appeal and offline recommendation accuracy.
  arXiv  Detail & Related papers  (2026-04-08T06:36:54Z)
• A New One-Shot Federated Learning Framework for Medical Imaging Classification with Feature-Guided Rectified Flow and Knowledge Distillation [13.353672721534627]
  One-Shot Federated Learning (OSFL) has attracted increasing attention due to its low communication overhead.<n>Existing generative model-based OSFL methods suffer from low training efficiency and potential privacy leakage in the healthcare domain.<n>In this paper a modified OSFL framework is proposed, in which a new Feature-Guided Rectified Flow Model (FG-RF) and Dual-Layer Knowledge Distillation (DLKD) aggregation method are developed.
  arXiv  Detail & Related papers  (2025-07-25T08:05:47Z)
• EndoGen: Conditional Autoregressive Endoscopic Video Generation [51.97720772069513]
  We propose the first conditional endoscopic video generation framework, namely EndoGen.<n>Specifically, we build an autoregressive model with a tailored Spatiotemporal Grid-Frame Patterning strategy.<n>We demonstrate the effectiveness of our framework in generating high-quality, conditionally guided endoscopic content.
  arXiv  Detail & Related papers  (2025-07-23T10:32:20Z)
• Flow Matching for Medical Image Synthesis: Bridging the Gap Between Speed and Quality [1.0922645515457987]
  We propose the use of an optimal transport flow matching approach to accelerate image generation.<n>By introducing a straighter mapping between the source and target distribution, our method significantly reduces inference time.<n>Our results demonstrate the efficiency and versatility of this framework, making it a promising advancement for medical imaging applications.
  arXiv  Detail & Related papers  (2025-03-01T00:49:47Z)
• RATLIP: Generative Adversarial CLIP Text-to-Image Synthesis Based on Recurrent Affine Transformations [0.0]
  Conditional affine transformations (CAT) have been applied to different layers of GAN to control content synthesis in images.<n>We first model CAT and a recurrent neural network (RAT) to ensure that different layers can access global information.<n>We then introduce shuffle attention between RAT to mitigate the characteristic of information forgetting in recurrent neural networks.
  arXiv  Detail & Related papers  (2024-05-13T18:49:18Z)
• MoreStyle: Relax Low-frequency Constraint of Fourier-based Image Reconstruction in Generalizable Medical Image Segmentation [53.24011398381715]
  We introduce a Plug-and-Play module for data augmentation called MoreStyle. MoreStyle diversifies image styles by relaxing low-frequency constraints in Fourier space. With the help of adversarial learning, MoreStyle pinpoints the most intricate style combinations within latent features.
  arXiv  Detail & Related papers  (2024-03-18T11:38:47Z)
• Semi-supervised Medical Image Segmentation Method Based on Cross-pseudo Labeling Leveraging Strong and Weak Data Augmentation Strategies [2.8246591681333024]
  This paper proposes a semi-supervised model, DFCPS, which innovatively incorporates the Fixmatch concept. Cross-pseudo-supervision is introduced, integrating consistency learning with self-training. Our model consistently exhibits superior performance across all four subdivisions containing different proportions of unlabeled data.
  arXiv  Detail & Related papers  (2024-02-17T13:07:44Z)
• Additional Look into GAN-based Augmentation for Deep Learning COVID-19 Image Classification [57.1795052451257]
  We study the dependence of the GAN-based augmentation performance on dataset size with a focus on small samples. We train StyleGAN2-ADA with both sets and then, after validating the quality of generated images, we use trained GANs as one of the augmentations approaches in multi-class classification problems. The GAN-based augmentation approach is found to be comparable with classical augmentation in the case of medium and large datasets but underperforms in the case of smaller datasets.
  arXiv  Detail & Related papers  (2024-01-26T08:28:13Z)
• Learned representation-guided diffusion models for large-image generation [58.192263311786824]
  We introduce a novel approach that trains diffusion models conditioned on embeddings from self-supervised learning (SSL) Our diffusion models successfully project these features back to high-quality histopathology and remote sensing images. Augmenting real data by generating variations of real images improves downstream accuracy for patch-level and larger, image-scale classification tasks.
  arXiv  Detail & Related papers  (2023-12-12T14:45:45Z)
• Learnable Weight Initialization for Volumetric Medical Image Segmentation [66.3030435676252]
  We propose a learnable weight-based hybrid medical image segmentation approach. Our approach is easy to integrate into any hybrid model and requires no external training data. Experiments on multi-organ and lung cancer segmentation tasks demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-06-15T17:55:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.