Abstract Art Interpretation Using ControlNet

• URL: http://arxiv.org/abs/2408.13287v1
• Date: Fri, 23 Aug 2024 06:25:54 GMT
• Title: Abstract Art Interpretation Using ControlNet
• Authors: Rishabh Srivastava, Addrish Roy,
• Abstract summary: We empower users with finer control over the synthesis process, enabling enhanced manipulation of synthesized imagery. Inspired by the minimalist forms found in abstract artworks, we introduce a novel condition crafted from geometric primitives such as triangles.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Our study delves into the fusion of abstract art interpretation and text-to-image synthesis, addressing the challenge of achieving precise spatial control over image composition solely through textual prompts. Leveraging the capabilities of ControlNet, we empower users with finer control over the synthesis process, enabling enhanced manipulation of synthesized imagery. Inspired by the minimalist forms found in abstract artworks, we introduce a novel condition crafted from geometric primitives such as triangles.

Related papers

• Zero-Painter: Training-Free Layout Control for Text-to-Image Synthesis [63.757624792753205]
  We present Zero-Painter, a framework for layout-conditional text-to-image synthesis. Our method utilizes object masks and individual descriptions, coupled with a global text prompt, to generate images with high fidelity.
  arXiv  Detail & Related papers  (2024-06-06T13:02:00Z)
• Integrating View Conditions for Image Synthesis [14.738884513493227]
  This paper introduces a pioneering framework that integrates viewpoint information to enhance the control of image editing tasks. We distill three essential criteria -- consistency, controllability, and harmony -- that should be met for an image editing method.
  arXiv  Detail & Related papers  (2023-10-24T16:55:07Z)
• Survey on Controlable Image Synthesis with Deep Learning [15.29961293132048]
  We present a survey of some recent works on 3D controllable image synthesis using deep learning. We first introduce the datasets and evaluation indicators for 3D controllable image synthesis. The photometrically controllable image synthesis approaches are also reviewed for 3D re-lighting researches.
  arXiv  Detail & Related papers  (2023-07-18T07:02:51Z)
• Conditional Human Sketch Synthesis with Explicit Abstraction Control [0.0]
  We present a novel free-hand sketch synthesis approach addressing explicit abstraction control in class-conditional and photo-to-sketch synthesis. We propose two novel abstraction control mechanisms, state embeddings and the stroke token, integrated into a transformer-based latent diffusion model.
  arXiv  Detail & Related papers  (2023-06-15T16:54:58Z)
• Synthesizing Anyone, Anywhere, in Any Pose [0.7252027234425334]
  TriA-GAN is a keypoint-guided GAN that can synthesize Anyone, Anywhere, in Any given pose. We show that TriA-GAN significantly improves over previous in-the-wild full-body synthesis methods. We also show that the latent space of TriA-GAN is compatible with standard unconditional editing techniques.
  arXiv  Detail & Related papers  (2023-04-06T15:48:42Z)
• HORIZON: High-Resolution Semantically Controlled Panorama Synthesis [105.55531244750019]
  Panorama synthesis endeavors to craft captivating 360-degree visual landscapes, immersing users in the heart of virtual worlds. Recent breakthroughs in visual synthesis have unlocked the potential for semantic control in 2D flat images, but a direct application of these methods to panorama synthesis yields distorted content. We unveil an innovative framework for generating high-resolution panoramas, adeptly addressing the issues of spherical distortion and edge discontinuity through sophisticated spherical modeling.
  arXiv  Detail & Related papers  (2022-10-10T09:43:26Z)
• More Control for Free! Image Synthesis with Semantic Diffusion Guidance [79.88929906247695]
  Controllable image synthesis models allow creation of diverse images based on text instructions or guidance from an example image. We introduce a novel unified framework for semantic diffusion guidance, which allows either language or image guidance, or both. We conduct experiments on FFHQ and LSUN datasets, and show results on fine-grained text-guided image synthesis.
  arXiv  Detail & Related papers  (2021-12-10T18:55:50Z)
• Realistic Image Synthesis with Configurable 3D Scene Layouts [59.872657806747576]
  We propose a novel approach to realistic-looking image synthesis based on a 3D scene layout. Our approach takes a 3D scene with semantic class labels as input and trains a 3D scene painting network. With the trained painting network, realistic-looking images for the input 3D scene can be rendered and manipulated.
  arXiv  Detail & Related papers  (2021-08-23T09:44:56Z)
• PIE: Portrait Image Embedding for Semantic Control [82.69061225574774]
  We present the first approach for embedding real portrait images in the latent space of StyleGAN. We use StyleRig, a pretrained neural network that maps the control space of a 3D morphable face model to the latent space of the GAN. An identity energy preservation term allows spatially coherent edits while maintaining facial integrity.
  arXiv  Detail & Related papers  (2020-09-20T17:53:51Z)
• Semantic View Synthesis [56.47999473206778]
  We tackle a new problem of semantic view synthesis -- generating free-viewpoint rendering of a synthesized scene using a semantic label map as input. First, we focus on synthesizing the color and depth of the visible surface of the 3D scene. We then use the synthesized color and depth to impose explicit constraints on the multiple-plane image (MPI) representation prediction process.
  arXiv  Detail & Related papers  (2020-08-24T17:59:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.