Synthetic Image Augmentation for Damage Region Segmentation using Conditional GAN with Structure Edge

• URL: http://arxiv.org/abs/2005.08628v1
• Date: Thu, 7 May 2020 06:04:02 GMT
• Title: Synthetic Image Augmentation for Damage Region Segmentation using Conditional GAN with Structure Edge
• Authors: Takato Yasuno, Michihiro Nakajima, Tomoharu Sekiguchi, Kazuhiro Noda, Kiyoshi Aoyanagi, Sakura Kato
• Abstract summary: We propose a synthetic augmentation procedure to generate damaged images using the image-to-image translation mapping. We apply popular per-pixel segmentation algorithms such as the FCN-8s, SegNet, and DeepLabv3+Xception-v2. We demonstrate that re-training a data set added with synthetic augmentation procedure make higher accuracy based on indices the mean IoU, damage region of interest IoU, precision, recall, BF score when we predict test images.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recently, social infrastructure is aging, and its predictive maintenance has become important issue. To monitor the state of infrastructures, bridge inspection is performed by human eye or bay drone. For diagnosis, primary damage region are recognized for repair targets. But, the degradation at worse level has rarely occurred, and the damage regions of interest are often narrow, so their ratio per image is extremely small pixel count, as experienced 0.6 to 1.5 percent. The both scarcity and imbalance property on the damage region of interest influences limited performance to detect damage. If additional data set of damaged images can be generated, it may enable to improve accuracy in damage region segmentation algorithm. We propose a synthetic augmentation procedure to generate damaged images using the image-to-image translation mapping from the tri-categorical label that consists the both semantic label and structure edge to the real damage image. We use the Sobel gradient operator to enhance structure edge. Actually, in case of bridge inspection, we apply the RC concrete structure with the number of 208 eye-inspection photos that rebar exposure have occurred, which are prepared 840 block images with size 224 by 224. We applied popular per-pixel segmentation algorithms such as the FCN-8s, SegNet, and DeepLabv3+Xception-v2. We demonstrates that re-training a data set added with synthetic augmentation procedure make higher accuracy based on indices the mean IoU, damage region of interest IoU, precision, recall, BF score when we predict test images.

Related papers

• BAND-2k: Banding Artifact Noticeable Database for Banding Detection and Quality Assessment [52.1640725073183]
  Banding, also known as staircase-like contours, frequently occurs in flat areas of images/videos processed by the compression or quantization algorithms. We build the largest banding IQA database so far, named Banding Artifact Noticeable Database (BAND-2k), which consists of 2,000 banding images. A dual convolutional neural network is employed to concurrently learn the feature representation from the high-frequency and low-frequency maps.
  arXiv  Detail & Related papers  (2023-11-29T15:56:31Z)
• Learning Heavily-Degraded Prior for Underwater Object Detection [59.5084433933765]
  This paper seeks transferable prior knowledge from detector-friendly images. It is based on statistical observations that, the heavily degraded regions of detector-friendly (DFUI) and underwater images have evident feature distribution gaps. Our method with higher speeds and less parameters still performs better than transformer-based detectors.
  arXiv  Detail & Related papers  (2023-08-24T12:32:46Z)
• PAIF: Perception-Aware Infrared-Visible Image Fusion for Attack-Tolerant Semantic Segmentation [50.556961575275345]
  We propose a perception-aware fusion framework to promote segmentation robustness in adversarial scenes. We show that our scheme substantially enhances the robustness, with gains of 15.3% mIOU, compared with advanced competitors.
  arXiv  Detail & Related papers  (2023-08-08T01:55:44Z)
• A hierarchical semantic segmentation framework for computer vision-based bridge damage detection [3.7642333932730634]
  Computer vision-based damage detection using remote cameras and unmanned aerial vehicles (UAVs) enables efficient and low-cost bridge health monitoring. This paper introduces a semantic segmentation framework that imposes the hierarchical semantic relationship between component category and damage types. In this way, the damage detection model could focus on learning features from possible damaged regions only and avoid the effects of other irrelevant regions.
  arXiv  Detail & Related papers  (2022-07-18T18:42:54Z)
• Operationalizing Convolutional Neural Network Architectures for Prohibited Object Detection in X-Ray Imagery [15.694880385913534]
  We explore the viability of two recent end-to-end object detection CNN architectures, Cascade R-CNN and FreeAnchor, for prohibited item detection. With fewer parameters and less training time, FreeAnchor achieves the highest detection inference speed of 13 fps (3.9 ms per image) The CNN models display substantial resilience to the lossy compression, resulting in only a 1.1% decrease in mAP at the JPEG compression level of 50.
  arXiv  Detail & Related papers  (2021-10-10T21:20:04Z)
• Spatially-Adaptive Image Restoration using Distortion-Guided Networks [51.89245800461537]
  We present a learning-based solution for restoring images suffering from spatially-varying degradations. We propose SPAIR, a network design that harnesses distortion-localization information and dynamically adjusts to difficult regions in the image.
  arXiv  Detail & Related papers  (2021-08-19T11:02:25Z)
• Vision Transformers for femur fracture classification [59.99241204074268]
  The Vision Transformer (ViT) was able to correctly predict 83% of the test images. Good results were obtained in sub-fractures with the largest and richest dataset ever.
  arXiv  Detail & Related papers  (2021-08-07T10:12:42Z)
• Automatic joint damage quantification using computer vision and deep learning [0.0]
  Joint raveled or spalled damage (henceforth called joint damage) can affect the safety and long-term performance of concrete pavements. It is important to assess and quantify the joint damage over time to assist in building action plans for maintenance, predicting maintenance costs, and maximize the concrete pavement service life. A framework for the accurate, autonomous, and rapid quantification of joint damage with a low-cost camera is proposed using a computer vision technique with a deep learning (DL) algorithm.
  arXiv  Detail & Related papers  (2020-10-29T01:41:20Z)
• Detection Of Concrete Cracks using Dual-channel Deep Convolutional Network [0.0]
  This study proposes a crack detection method based on deep convolutional neural network (CNN) for detection of concrete cracks. A database of 3200 labelled images with concrete cracks has been created, where the contrast, lighting conditions, orientations and severity of the cracks were extremely variable. We have designed a dual-channel deep CNN which shows high accuracy ( 92.25%) as well as robustness in finding concrete cracks in realis-tic situations.
  arXiv  Detail & Related papers  (2020-09-22T15:17:02Z)
• Per-pixel Classification Rebar Exposures in Bridge Eye-inspection [0.0]
  We propose three damage detection methods of transfer learning which enables semantic segmentation in an image with low pixels. In this paper, we show the results applied using the 208 rebar exposed images on the 106 real-world bridges.
  arXiv  Detail & Related papers  (2020-04-22T17:28:42Z)
• RescueNet: Joint Building Segmentation and Damage Assessment from Satellite Imagery [83.49145695899388]
  RescueNet is a unified model that can simultaneously segment buildings and assess the damage levels to individual buildings and can be trained end-to-end. RescueNet is tested on the large scale and diverse xBD dataset and achieves significantly better building segmentation and damage classification performance than previous methods.
  arXiv  Detail & Related papers  (2020-04-15T19:52:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.