A framework for the automation of testing computer vision systems
- URL: http://arxiv.org/abs/2105.04383v1
- Date: Mon, 10 May 2021 14:02:42 GMT
- Title: A framework for the automation of testing computer vision systems
- Authors: Franz Wotawa and Lorenz Klampfl and Ledio Jahaj
- Abstract summary: We contribute to the area of testing vision software, and present a framework for the automated generation of tests for systems based on vision and image recognition.
We show how such a framework can be used for testing a particular industrial application on identifying defects on riblet surfaces.
- Score: 17.360163137925998
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Vision systems, i.e., systems that allow to detect and track objects in
images, have gained substantial importance over the past decades. They are used
in quality assurance applications, e.g., for finding surface defects in
products during manufacturing, surveillance, but also automated driving,
requiring reliable behavior. Interestingly, there is only little work on
quality assurance and especially testing of vision systems in general. In this
paper, we contribute to the area of testing vision software, and present a
framework for the automated generation of tests for systems based on vision and
image recognition. The framework makes use of existing libraries allowing to
modify original images and to obtain similarities between the original and
modified images. We show how such a framework can be used for testing a
particular industrial application on identifying defects on riblet surfaces and
present preliminary results from the image classification domain.
Related papers
- KITTEN: A Knowledge-Intensive Evaluation of Image Generation on Visual Entities [93.74881034001312]
We conduct a systematic study on the fidelity of entities in text-to-image generation models.
We focus on their ability to generate a wide range of real-world visual entities, such as landmark buildings, aircraft, plants, and animals.
Our findings reveal that even the most advanced text-to-image models often fail to generate entities with accurate visual details.
arXiv Detail & Related papers (2024-10-15T17:50:37Z) - UNIT: Unifying Image and Text Recognition in One Vision Encoder [51.140564856352825]
UNIT is a novel training framework aimed at UNifying Image and Text recognition within a single model.
We show that UNIT significantly outperforms existing methods on document-related tasks.
Notably, UNIT retains the original vision encoder architecture, making it cost-free in terms of inference and deployment.
arXiv Detail & Related papers (2024-09-06T08:02:43Z) - A Feature-based Approach for the Recognition of Image Quality
Degradation in Automotive Applications [0.0]
This paper presents a feature-based algorithm to detect certain effects that can degrade image quality in automotive applications.
Experiments with different data sets show that the algorithm can detect soiling adhering to camera lenses and classify different types of image degradation.
arXiv Detail & Related papers (2023-03-13T13:40:09Z) - A Quality Index Metric and Method for Online Self-Assessment of
Autonomous Vehicles Sensory Perception [164.93739293097605]
We propose a novel evaluation metric, named as the detection quality index (DQI), which assesses the performance of camera-based object detection algorithms.
We have developed a superpixel-based attention network (SPA-NET) that utilizes raw image pixels and superpixels as input to predict the proposed DQI evaluation metric.
arXiv Detail & Related papers (2022-03-04T22:16:50Z) - Vision Checklist: Towards Testable Error Analysis of Image Models to
Help System Designers Interrogate Model Capabilities [26.177391265710362]
Vision Checklist is a framework aimed at interrogating the capabilities of a model in order to produce a report that can be used by a system designer for robustness evaluations.
Our framework is evaluated on multiple datasets like Tinyimagenet, CIFAR10, CIFAR100 and Camelyon17 and for models like ViT and Resnet.
arXiv Detail & Related papers (2022-01-27T17:20:16Z) - Cognitive Visual Inspection Service for LCD Manufacturing Industry [80.63336968475889]
This paper discloses a novel visual inspection system for liquid crystal display (LCD), which is currently a dominant type in the FPD industry.
System is based on two cornerstones: robust/high-performance defect recognition model and cognitive visual inspection service architecture.
arXiv Detail & Related papers (2021-01-11T08:14:35Z) - Unadversarial Examples: Designing Objects for Robust Vision [100.4627585672469]
We develop a framework that exploits the sensitivity of modern machine learning algorithms to input perturbations in order to design "robust objects"
We demonstrate the efficacy of the framework on a wide variety of vision-based tasks ranging from standard benchmarks to (in-simulation) robotics.
arXiv Detail & Related papers (2020-12-22T18:26:07Z) - SAFFIRE: System for Autonomous Feature Filtering and Intelligent ROI
Estimation [18.879707999761653]
This work introduces a new framework, named SAFFIRE, to automatically extract a dominant recurrent image pattern from a set of image samples.
The framework is specialized here in the context of a machine vision system for automated product inspection.
arXiv Detail & Related papers (2020-12-04T10:07:24Z) - Deep Learning Models for Visual Inspection on Automotive Assembling Line [2.594420805049218]
This paper proposes the use of deep learning-based methodologies to assist in visual inspection tasks.
The proposed approach is illustrated by four proofs of concept in a real automotive assembly line.
arXiv Detail & Related papers (2020-07-02T20:00:45Z) - Towards Coding for Human and Machine Vision: A Scalable Image Coding
Approach [104.02201472370801]
We come up with a novel image coding framework by leveraging both the compressive and the generative models.
By introducing advanced generative models, we train a flexible network to reconstruct images from compact feature representations and the reference pixels.
Experimental results demonstrate the superiority of our framework in both human visual quality and facial landmark detection.
arXiv Detail & Related papers (2020-01-09T10:37:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.