State-of-the-Art Fails in the Art of Damage Detection

• URL: http://arxiv.org/abs/2408.12953v1
• Date: Fri, 23 Aug 2024 10:03:07 GMT
• Title: State-of-the-Art Fails in the Art of Damage Detection
• Authors: Daniela Ivanova, Marco Aversa, Paul Henderson, John Williamson,
• Abstract summary: We show that machine learning models fail to predict where damage is even after supervised training. We introduce DamBench, a dataset for damage detection in diverse analogue media.
• Score: 5.6872893893453105
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Accurately detecting and classifying damage in analogue media such as paintings, photographs, textiles, mosaics, and frescoes is essential for cultural heritage preservation. While machine learning models excel in correcting global degradation if the damage operator is known a priori, we show that they fail to predict where the damage is even after supervised training; thus, reliable damage detection remains a challenge. We introduce DamBench, a dataset for damage detection in diverse analogue media, with over 11,000 annotations covering 15 damage types across various subjects and media. We evaluate CNN, Transformer, and text-guided diffusion segmentation models, revealing their limitations in generalising across media types.

Related papers

• ARTeFACT: Benchmarking Segmentation Models on Diverse Analogue Media Damage [5.6872893893453105]
  ARTeFACT is a dataset for damage detection in diverse types analogue media. Over 11,000 annotations cover 15 kinds of damage across various subjects, media, and historical provenance. We evaluate CNN, Transformer, diffusion-based segmentation models, and foundation vision models in zero-shot, supervised, unsupervised and text-guided settings.
  arXiv  Detail & Related papers  (2024-12-05T19:52:25Z)
• Semi-Truths: A Large-Scale Dataset of AI-Augmented Images for Evaluating Robustness of AI-Generated Image detectors [62.63467652611788]
  We introduce SEMI-TRUTHS, featuring 27,600 real images, 223,400 masks, and 1,472,700 AI-augmented images. Each augmented image is accompanied by metadata for standardized and targeted evaluation of detector robustness. Our findings suggest that state-of-the-art detectors exhibit varying sensitivities to the types and degrees of perturbations, data distributions, and augmentation methods used.
  arXiv  Detail & Related papers  (2024-11-12T01:17:27Z)
• FaultGuard: A Generative Approach to Resilient Fault Prediction in Smart Electrical Grids [53.2306792009435]
  FaultGuard is the first framework for fault type and zone classification resilient to adversarial attacks. We propose a low-complexity fault prediction model and an online adversarial training technique to enhance robustness. Our model outclasses the state-of-the-art for resilient fault prediction benchmarking, with an accuracy of up to 0.958.
  arXiv  Detail & Related papers  (2024-03-26T08:51:23Z)
• Simulating analogue film damage to analyse and improve artefact restoration on high-resolution scans [10.871587311621974]
  Digital scans of analogue photographic film typically contain artefacts such as dust and scratches. Deep learning models have shown impressive results in general image inpainting and denoising, but film artefact removal is an understudied problem. There are no publicly available high-quality datasets of real-world analogue film damage for training and evaluation. We collect a dataset of 4K damaged analogue film scans paired with manually-restored versions produced by a human expert. We construct a larger synthetic dataset of damaged images with paired clean versions using a statistical model of artefact shape and occurrence learnt from real, heavily-damaged images.
  arXiv  Detail & Related papers  (2023-02-20T14:24:18Z)
• Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection [115.83992775004043]
  Recent advances in deep learning, particularly deep generative models, open the doors for producing perceptually convincing images and videos at a low cost. This paper provides a comprehensive review of the current media tampering detection approaches, and discusses the challenges and trends in this field for future research.
  arXiv  Detail & Related papers  (2022-12-12T02:54:08Z)
• Multi-view deep learning for reliable post-disaster damage classification [0.0]
  This study aims to enable more reliable automated post-disaster building damage classification using artificial intelligence (AI) and multi-view imagery. The proposed model is trained and validated on reconnaissance visual dataset containing expert-labeled, geotagged images of the inspected buildings following hurricane Harvey.
  arXiv  Detail & Related papers  (2022-08-06T01:04:13Z)
• A hierarchical semantic segmentation framework for computer vision-based bridge damage detection [3.8999448636733516]
  Computer vision-based damage detection using remote cameras and unmanned aerial vehicles (UAVs) enables efficient and low-cost bridge health monitoring. This paper introduces a semantic segmentation framework that imposes the hierarchical semantic relationship between component category and damage types. In this way, the damage detection model could focus on learning features from possible damaged regions only and avoid the effects of other irrelevant regions.
  arXiv  Detail & Related papers  (2022-07-18T18:42:54Z)
• Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection [97.93062818228015]
  We propose to integrate the reconstruction-based functionality into a novel self-supervised predictive architectural building block. Our block is equipped with a loss that minimizes the reconstruction error with respect to the masked area in the receptive field. We demonstrate the generality of our block by integrating it into several state-of-the-art frameworks for anomaly detection on image and video.
  arXiv  Detail & Related papers  (2021-11-17T13:30:31Z)
• Assessing out-of-domain generalization for robust building damage detection [78.6363825307044]
  Building damage detection can be automated by applying computer vision techniques to satellite imagery. Models must be robust to a shift in distribution between disaster imagery available for training and the images of the new event. We argue that future work should focus on the OOD regime instead.
  arXiv  Detail & Related papers  (2020-11-20T10:30:43Z)
• Stereopagnosia: Fooling Stereo Networks with Adversarial Perturbations [71.00754846434744]
  We show that imperceptible additive perturbations can significantly alter the disparity map. We show that, when used for adversarial data augmentation, our perturbations result in trained models that are more robust.
  arXiv  Detail & Related papers  (2020-09-21T19:20:09Z)
• Per-pixel Classification Rebar Exposures in Bridge Eye-inspection [0.0]
  We propose three damage detection methods of transfer learning which enables semantic segmentation in an image with low pixels. In this paper, we show the results applied using the 208 rebar exposed images on the 106 real-world bridges.
  arXiv  Detail & Related papers  (2020-04-22T17:28:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.