Towards Artistic Image Aesthetics Assessment: a Large-scale Dataset and a New Method

• URL: http://arxiv.org/abs/2303.15166v1
• Date: Mon, 27 Mar 2023 12:59:15 GMT
• Title: Towards Artistic Image Aesthetics Assessment: a Large-scale Dataset and a New Method
• Authors: Ran Yi, Haoyuan Tian, Zhihao Gu, Yu-Kun Lai and Paul L. Rosin
• Abstract summary: We first introduce a large-scale AIAA dataset: Boldbrush Artistic Image dataset (BAID), which consists of 60,337 artistic images covering various art forms. We then propose a new method, SAAN, which can effectively extract and utilize style-specific and generic aesthetic information to evaluate artistic images. Experiments demonstrate that our proposed approach outperforms existing IAA methods on the proposed BAID dataset.
• Score: 64.40494830113286
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Image aesthetics assessment (IAA) is a challenging task due to its highly subjective nature. Most of the current studies rely on large-scale datasets (e.g., AVA and AADB) to learn a general model for all kinds of photography images. However, little light has been shed on measuring the aesthetic quality of artistic images, and the existing datasets only contain relatively few artworks. Such a defect is a great obstacle to the aesthetic assessment of artistic images. To fill the gap in the field of artistic image aesthetics assessment (AIAA), we first introduce a large-scale AIAA dataset: Boldbrush Artistic Image Dataset (BAID), which consists of 60,337 artistic images covering various art forms, with more than 360,000 votes from online users. We then propose a new method, SAAN (Style-specific Art Assessment Network), which can effectively extract and utilize style-specific and generic aesthetic information to evaluate artistic images. Experiments demonstrate that our proposed approach outperforms existing IAA methods on the proposed BAID dataset according to quantitative comparisons. We believe the proposed dataset and method can serve as a foundation for future AIAA works and inspire more research in this field. Dataset and code are available at: https://github.com/Dreemurr-T/BAID.git

Related papers

• AID-AppEAL: Automatic Image Dataset and Algorithm for Content Appeal Enhancement and Assessment Labeling [11.996211235559866]
  Image Content Appeal Assessment (ICAA) is a novel metric that quantifies the level of positive interest an image's content generates for viewers. ICAA is different from traditional Image-Aesthetics Assessment (IAA), which judges an image's artistic quality.
  arXiv  Detail & Related papers  (2024-07-08T01:40:32Z)
• Paintings and Drawings Aesthetics Assessment with Rich Attributes for Various Artistic Categories [47.705077586687196]
  The Aesthetics of Paintings and Drawings dataset comprises a total of 4985 images, with an annotation count exceeding 31100 entries. The construction of APDD received active participation from 28 professional artists worldwide, along with dozens of students specializing in the field of art. The final APDD dataset comprises a total of 4985 images, with an annotation count exceeding 31100 entries.
  arXiv  Detail & Related papers  (2024-05-05T16:05:56Z)
• Image Aesthetics Assessment via Learnable Queries [59.313054821874864]
  We propose the Image Aesthetics Assessment via Learnable Queries (IAA-LQ) approach. It adapts learnable queries to extract aesthetic features from pre-trained image features obtained from a frozen image encoder. Experiments on real-world data demonstrate the advantages of IAA-LQ, beating the best state-of-the-art method by 2.2% and 2.1% in terms of SRCC and PLCC, respectively.
  arXiv  Detail & Related papers  (2023-09-06T09:42:16Z)
• Learning to Evaluate the Artness of AI-generated Images [64.48229009396186]
  ArtScore is a metric designed to evaluate the degree to which an image resembles authentic artworks by artists. We employ pre-trained models for photo and artwork generation, resulting in a series of mixed models. This dataset is then employed to train a neural network that learns to estimate quantized artness levels of arbitrary images.
  arXiv  Detail & Related papers  (2023-05-08T17:58:27Z)
• VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining [53.470662123170555]
  We propose learning image aesthetics from user comments, and exploring vision-language pretraining methods to learn multimodal aesthetic representations. Specifically, we pretrain an image-text encoder-decoder model with image-comment pairs, using contrastive and generative objectives to learn rich and generic aesthetic semantics without human labels. Our results show that our pretrained aesthetic vision-language model outperforms prior works on image aesthetic captioning over the AVA-Captions dataset.
  arXiv  Detail & Related papers  (2023-03-24T23:57:28Z)
• Aesthetically Relevant Image Captioning [17.081262827258943]
  We study image AQA and IAC together and present a new IAC method termed Aesthetically Relevant Image Captioning (ARIC) ARIC includes an ARS weighted IAC loss function and an ARS based diverse aesthetic caption selector (DACS) We show that texts with higher ARS's can predict the aesthetic ratings more accurately and that the new ARIC model can generate more accurate, aesthetically more relevant and more diverse image captions.
  arXiv  Detail & Related papers  (2022-11-25T14:28:10Z)
• Distilling Knowledge from Object Classification to Aesthetics Assessment [68.317720070755]
  The major dilemma of image aesthetics assessment (IAA) comes from the abstract nature of aesthetic labels. We propose to distill knowledge on semantic patterns for a vast variety of image contents to an IAA model. By supervising an end-to-end single-backbone IAA model with the distilled knowledge, the performance of the IAA model is significantly improved.
  arXiv  Detail & Related papers  (2022-06-02T00:39:01Z)
• Personalized Image Aesthetics Assessment with Rich Attributes [35.61053167813472]
  We conduct the most comprehensive subjective study of personalized image aesthetics and introduce a new personalized image Aesthetics database with Rich Attributes (PARA) PARA features wealthy annotations, including 9 image-oriented objective attributes and 4 human-oriented subjective attributes. We also propose a conditional PIAA model by utilizing subject information as conditional prior.
  arXiv  Detail & Related papers  (2022-03-31T02:23:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.