Stylebreeder: Exploring and Democratizing Artistic Styles through Text-to-Image Models

• URL: http://arxiv.org/abs/2406.14599v1
• Date: Thu, 20 Jun 2024 17:59:56 GMT
• Title: Stylebreeder: Exploring and Democratizing Artistic Styles through Text-to-Image Models
• Authors: Matthew Zheng, Enis Simsar, Hidir Yesiltepe, Federico Tombari, Joel Simon, Pinar Yanardag,
• Abstract summary: We introduce textttSTYLEBREEDER, a comprehensive dataset of 6.8M images and 1.8M prompts generated by 95K users on Artbreeder. By documenting unique, user-generated styles that transcend conventional categories like 'cyberpunk' or 'Picasso,' we explore the potential for unique, crowd-sourced styles. Our research demonstrates the potential of text-to-image diffusion models to uncover and promote unique artistic expressions.
• Score: 38.5896770458884
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Text-to-image models are becoming increasingly popular, revolutionizing the landscape of digital art creation by enabling highly detailed and creative visual content generation. These models have been widely employed across various domains, particularly in art generation, where they facilitate a broad spectrum of creative expression and democratize access to artistic creation. In this paper, we introduce \texttt{STYLEBREEDER}, a comprehensive dataset of 6.8M images and 1.8M prompts generated by 95K users on Artbreeder, a platform that has emerged as a significant hub for creative exploration with over 13M users. We introduce a series of tasks with this dataset aimed at identifying diverse artistic styles, generating personalized content, and recommending styles based on user interests. By documenting unique, user-generated styles that transcend conventional categories like 'cyberpunk' or 'Picasso,' we explore the potential for unique, crowd-sourced styles that could provide deep insights into the collective creative psyche of users worldwide. We also evaluate different personalization methods to enhance artistic expression and introduce a style atlas, making these models available in LoRA format for public use. Our research demonstrates the potential of text-to-image diffusion models to uncover and promote unique artistic expressions, further democratizing AI in art and fostering a more diverse and inclusive artistic community. The dataset, code and models are available at https://stylebreeder.github.io under a Public Domain (CC0) license.

Related papers

• FedStyle: Style-Based Federated Learning Crowdsourcing Framework for Art Commissions [3.1676484382068315]
  FedStyle is a style-based federated learning crowdsourcing framework. It allows artists to train local style models and share model parameters rather than artworks for collaboration. It addresses extreme data heterogeneity by having artists learn their abstract style representations and align with the server.
  arXiv  Detail & Related papers  (2024-04-25T04:53:43Z)
• Rethinking Artistic Copyright Infringements in the Era of Text-to-Image Generative Models [47.19481598385283]
  ArtSavant is a tool to determine the unique style of an artist by comparing it to a reference dataset of works from WikiArt. We then perform a large-scale empirical study to provide quantitative insight on the prevalence of artistic style copying across 3 popular text-to-image generative models.
  arXiv  Detail & Related papers  (2024-04-11T17:59:43Z)
• CreativeSynth: Creative Blending and Synthesis of Visual Arts based on Multimodal Diffusion [74.44273919041912]
  Large-scale text-to-image generative models have made impressive strides, showcasing their ability to synthesize a vast array of high-quality images. However, adapting these models for artistic image editing presents two significant challenges. We build the innovative unified framework Creative Synth, which is based on a diffusion model with the ability to coordinate multimodal inputs.
  arXiv  Detail & Related papers  (2024-01-25T10:42:09Z)
• State of the Art on Diffusion Models for Visual Computing [191.6168813012954]
  This report introduces the basic mathematical concepts of diffusion models, implementation details and design choices of the popular Stable Diffusion model. We also give a comprehensive overview of the rapidly growing literature on diffusion-based generation and editing. We discuss available datasets, metrics, open challenges, and social implications.
  arXiv  Detail & Related papers  (2023-10-11T05:32:29Z)
• StyleAvatar3D: Leveraging Image-Text Diffusion Models for High-Fidelity 3D Avatar Generation [103.88928334431786]
  We present a novel method for generating high-quality, stylized 3D avatars. We use pre-trained image-text diffusion models for data generation and a Generative Adversarial Network (GAN)-based 3D generation network for training. Our approach demonstrates superior performance over current state-of-the-art methods in terms of visual quality and diversity of the produced avatars.
  arXiv  Detail & Related papers  (2023-05-30T13:09:21Z)
• Few-shots Portrait Generation with Style Enhancement and Identity Preservation [3.6937810031393123]
  StyleIdentityGAN model can ensure the identity and artistry of the generated portrait at the same time. Style-enhanced module focuses on artistic style features decoupling and transferring to improve the artistry of generated virtual face images. Experiments demonstrate the superiority of StyleIdentityGAN over state-of-art methods in artistry and identity effects.
  arXiv  Detail & Related papers  (2023-03-01T10:02:12Z)
• Creative Painting with Latent Diffusion Models [1.4649095013539173]
  latent diffusion models (LDMs) have achieved stable and high fertility image generation. We focus on enhancing the creative painting ability of current LDMs in two directions, textual condition extension and model retraining with Wikiart dataset.
  arXiv  Detail & Related papers  (2022-09-29T11:49:07Z)
• Art Creation with Multi-Conditional StyleGANs [81.72047414190482]
  A human artist needs a combination of unique skills, understanding, and genuine intention to create artworks that evoke deep feelings and emotions. We introduce a multi-conditional Generative Adversarial Network (GAN) approach trained on large amounts of human paintings to synthesize realistic-looking paintings that emulate human art.
  arXiv  Detail & Related papers  (2022-02-23T20:45:41Z)
• Exploring Latent Dimensions of Crowd-sourced Creativity [0.02294014185517203]
  We build our work on the largest AI-based creativity platform, Artbreeder. We explore the latent dimensions of images generated on this platform and present a novel framework for manipulating images to make them more creative.
  arXiv  Detail & Related papers  (2021-12-13T19:24:52Z)
• LiveStyle -- An Application to Transfer Artistic Styles [0.0]
  Style Transfer using Neural Networks refers to optimization techniques, where a content image and a style image are taken and blended. This paper implements the Style Transfer using three different Neural Networks in form of an application that is accessible to the general population.
  arXiv  Detail & Related papers  (2021-05-03T13:50:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.