Paired and Unpaired Image to Image Translation using Generative Adversarial Networks

• URL: http://arxiv.org/abs/2505.16310v1
• Date: Thu, 22 May 2025 07:06:39 GMT
• Title: Paired and Unpaired Image to Image Translation using Generative Adversarial Networks
• Authors: Gaurav Kumar, Soham Satyadharma, Harpreet Singh,
• Abstract summary: Recent architectures leverage Generative Adversarial Networks (GANs) to transform input images from one domain to another.<n>We study the study of both paired and unpaired image translation across multiple image domains.
• Score: 3.418003108727248
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Image to image translation is an active area of research in the field of computer vision, enabling the generation of new images with different styles, textures, or resolutions while preserving their characteristic properties. Recent architectures leverage Generative Adversarial Networks (GANs) to transform input images from one domain to another. In this work, we focus on the study of both paired and unpaired image translation across multiple image domains. For the paired task, we used a conditional GAN model, and for the unpaired task, we trained it using cycle consistency loss. We experimented with different types of loss functions, multiple Patch-GAN sizes, and model architectures. New quantitative metrics - precision, recall, and FID score - were used for analysis. In addition, a qualitative study of the results of different experiments was conducted.

Related papers

• Mechanisms of Generative Image-to-Image Translation Networks [1.602820210496921]
  We propose a streamlined image-to-image translation network with a simpler architecture compared to existing models. We show that adversarial for GAN models yields results comparable to those of existing methods without additional complex loss penalties.
  arXiv  Detail & Related papers  (2024-11-15T17:17:46Z)
• On the exploitation of DCT statistics for cropping detectors [5.039808715733204]
  In this work, we investigated a novel image resolution classifier that employs DCT statistics with the goal to detect the original resolution of images. The results demonstrate the classifier's reliability in distinguishing between cropped and not cropped images, providing a dependable estimation of their original resolution. This work opens new perspectives in the field, with potential to transform image analysis and usage across multiple domains.
  arXiv  Detail & Related papers  (2024-03-21T19:05:31Z)
• Multi-cropping Contrastive Learning and Domain Consistency for Unsupervised Image-to-Image Translation [5.562419999563734]
  We propose a novel unsupervised image-to-image translation framework based on multi-cropping contrastive learning and domain consistency, called MCDUT. In many image-to-image translation tasks, our method achieves state-of-the-art results, and the advantages of our method have been proven through comparison experiments and ablation research.
  arXiv  Detail & Related papers  (2023-04-24T16:20:28Z)
• Multi-domain Unsupervised Image-to-Image Translation with Appearance Adaptive Convolution [62.4972011636884]
  We propose a novel multi-domain unsupervised image-to-image translation (MDUIT) framework. We exploit the decomposed content feature and appearance adaptive convolution to translate an image into a target appearance. We show that the proposed method produces visually diverse and plausible results in multiple domains compared to the state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-02-06T14:12:34Z)
• Self-Supervised Learning of Domain Invariant Features for Depth Estimation [35.74969527929284]
  We tackle the problem of unsupervised synthetic-to-realistic domain adaptation for single image depth estimation. An essential building block of single image depth estimation is an encoder-decoder task network that takes RGB images as input and produces depth maps as output. We propose a novel training strategy to force the task network to learn domain invariant representations in a self-supervised manner.
  arXiv  Detail & Related papers  (2021-06-04T16:45:48Z)
• Ensembling with Deep Generative Views [72.70801582346344]
  generative models can synthesize "views" of artificial images that mimic real-world variations, such as changes in color or pose. Here, we investigate whether such views can be applied to real images to benefit downstream analysis tasks such as image classification. We use StyleGAN2 as the source of generative augmentations and investigate this setup on classification tasks involving facial attributes, cat faces, and cars.
  arXiv  Detail & Related papers  (2021-04-29T17:58:35Z)
• A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detection [93.38607559281601]
  We devise a hierarchical generative model that captures the multi-scale patch distribution of each training image. The anomaly score is obtained by aggregating the patch-based votes of the correct transformation across scales and image regions.
  arXiv  Detail & Related papers  (2021-04-29T17:49:48Z)
• Factors of Influence for Transfer Learning across Diverse Appearance Domains and Task Types [50.1843146606122]
  A simple form of transfer learning is common in current state-of-the-art computer vision models. Previous systematic studies of transfer learning have been limited and the circumstances in which it is expected to work are not fully understood. In this paper we carry out an extensive experimental exploration of transfer learning across vastly different image domains.
  arXiv  Detail & Related papers  (2021-03-24T16:24:20Z)
• MOGAN: Morphologic-structure-aware Generative Learning from a Single Image [59.59698650663925]
  Recently proposed generative models complete training based on only one image. We introduce a MOrphologic-structure-aware Generative Adversarial Network named MOGAN that produces random samples with diverse appearances. Our approach focuses on internal features including the maintenance of rational structures and variation on appearance.
  arXiv  Detail & Related papers  (2021-03-04T12:45:23Z)
• Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Network [73.5062435623908]
  We propose a new I2I translation method that generates a new model in the target domain via a series of model transformations. By feeding the latent vector into the generated model, we can perform I2I translation between the source domain and target domain.
  arXiv  Detail & Related papers  (2020-10-12T13:51:40Z)
• Network-to-Network Translation with Conditional Invertible Neural Networks [19.398202091883366]
  Recent work suggests that the power of massive machine learning models is captured by the representations they learn. We seek a model that can relate between different existing representations and propose to solve this task with a conditionally invertible network. Our domain transfer network can translate between fixed representations without having to learn or finetune them.
  arXiv  Detail & Related papers  (2020-05-27T18:14:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.