Large-image Object Detection for Fine-grained Recognition of Punches Patterns in Medieval Panel Painting

• URL: http://arxiv.org/abs/2501.12489v1
• Date: Tue, 21 Jan 2025 20:30:51 GMT
• Title: Large-image Object Detection for Fine-grained Recognition of Punches Patterns in Medieval Panel Painting
• Authors: Josh Bruegger, Diana Ioana Catana, Vanja Macovaz, Matias Valdenegro-Toro, Matthia Sabatelli, Marco Zullich,
• Abstract summary: We train a Machine Learning pipeline to perform object detection on the punches contained in images. Our results indicate how art historians working in the field can reliably use our method for the identification and extraction of punches.
• Score: 6.762125776126245
• License:
• Abstract: The attribution of the author of an art piece is typically a laborious manual process, usually relying on subjective evaluations of expert figures. However, there are some situations in which quantitative features of the artwork can support these evaluations. The extraction of these features can sometimes be automated, for instance, with the use of Machine Learning (ML) techniques. An example of these features is represented by repeated, mechanically impressed patterns, called punches, present chiefly in 13th and 14th-century panel paintings from Tuscany. Previous research in art history showcased a strong connection between the shapes of punches and specific artists or workshops, suggesting the possibility of using these quantitative cues to support the attribution. In the present work, we first collect a dataset of large-scale images of these panel paintings. Then, using YOLOv10, a recent and popular object detection model, we train a ML pipeline to perform object detection on the punches contained in the images. Due to the large size of the images, the detection procedure is split across multiple frames by adopting a sliding-window approach with overlaps, after which the predictions are combined for the whole image using a custom non-maximal suppression routine. Our results indicate how art historians working in the field can reliably use our method for the identification and extraction of punches.

Related papers

• Visual Motif Identification: Elaboration of a Curated Comparative Dataset and Classification Methods [4.431754853927668]
  In cinema, visual motifs are recurrent iconographic compositions that carry artistic or aesthetic significance. Our goal is to recognise and classify these motifs by proposing a new machine learning model that uses a custom dataset to that end. We show how features extracted from a CLIP model can be leveraged by using a shallow network and an appropriate loss to classify images into 20 different motifs, with surprisingly good results.
  arXiv  Detail & Related papers  (2024-10-21T10:50:00Z)
• Leveraging Open-Vocabulary Diffusion to Camouflaged Instance Segmentation [59.78520153338878]
  Text-to-image diffusion techniques have shown exceptional capability of producing high-quality images from text descriptions. We propose a method built upon a state-of-the-art diffusion model, empowered by open-vocabulary to learn multi-scale textual-visual features for camouflaged object representations.
  arXiv  Detail & Related papers  (2023-12-29T07:59:07Z)
• Detecting Generated Images by Real Images Only [64.12501227493765]
  Existing generated image detection methods detect visual artifacts in generated images or learn discriminative features from both real and generated images by massive training. This paper approaches the generated image detection problem from a new perspective: Start from real images. By finding the commonality of real images and mapping them to a dense subspace in feature space, the goal is that generated images, regardless of their generative model, are then projected outside the subspace.
  arXiv  Detail & Related papers  (2023-11-02T03:09:37Z)
• Deep Image Matting: A Comprehensive Survey [85.77905619102802]
  This paper presents a review of recent advancements in image matting in the era of deep learning. We focus on two fundamental sub-tasks: auxiliary input-based image matting and automatic image matting. We discuss relevant applications of image matting and highlight existing challenges and potential opportunities for future research.
  arXiv  Detail & Related papers  (2023-04-10T15:48:55Z)
• Leveraging Computer Vision Application in Visual Arts: A Case Study on the Use of Residual Neural Network to Classify and Analyze Baroque Paintings [0.0]
  In this case study, we focus on the classification of a selected painting 'Portrait of the Painter Charles Bruni' by Johann Kupetzky. We show that the features extracted during residual network training can be useful for image retrieval within search systems in online art collections.
  arXiv  Detail & Related papers  (2022-10-27T10:15:36Z)
• Few-Shot Object Detection by Knowledge Distillation Using Bag-of-Visual-Words Representations [58.48995335728938]
  We design a novel knowledge distillation framework to guide the learning of the object detector. We first present a novel Position-Aware Bag-of-Visual-Words model for learning a representative bag of visual words. We then perform knowledge distillation based on the fact that an image should have consistent BoVW representations in two different feature spaces.
  arXiv  Detail & Related papers  (2022-07-25T10:40:40Z)
• An End-to-End Approach for Seam Carving Detection using Deep Neural Networks [0.0]
  Seam carving is a computational method capable of resizing images for both reduction and expansion based on its content, instead of the image geometry. We propose an end-to-end approach to cope with the problem of automatic seam carving detection.
  arXiv  Detail & Related papers  (2022-03-05T12:53:55Z)
• Museum Painting Retrieval [0.0]
  We implement a query by example retrieval system for finding paintings in a museum image collection using classic computer vision techniques. We study the performance of the color, texture, text and feature descriptors in datasets with different perturbations in the images.
  arXiv  Detail & Related papers  (2021-05-11T09:28:14Z)
• A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection [56.82077636126353]
  We take advantage of object-centric images to improve object detection in scene-centric images. We present a simple yet surprisingly effective framework to do so. Our approach can improve the object detection (and instance segmentation) accuracy of rare objects by 50% (and 33%) relatively.
  arXiv  Detail & Related papers  (2021-02-17T17:27:21Z)
• Instance Localization for Self-supervised Detection Pretraining [68.24102560821623]
  We propose a new self-supervised pretext task, called instance localization. We show that integration of bounding boxes into pretraining promotes better task alignment and architecture alignment for transfer learning. Experimental results demonstrate that our approach yields state-of-the-art transfer learning results for object detection.
  arXiv  Detail & Related papers  (2021-02-16T17:58:57Z)
• Insights From A Large-Scale Database of Material Depictions In Paintings [18.2193253052961]
  We examine the give-and-take relationship between visual recognition systems and the rich information available in the fine arts. We find that visual recognition systems designed for natural images can work surprisingly well on paintings. We show that learning from paintings can be beneficial for neural networks that are intended to be used on natural images.
  arXiv  Detail & Related papers  (2020-11-24T18:42:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.