Meta Learning-Driven Iterative Refinement for Robust Anomaly Detection in Industrial Inspection

• URL: http://arxiv.org/abs/2503.01569v1
• Date: Mon, 03 Mar 2025 14:11:41 GMT
• Title: Meta Learning-Driven Iterative Refinement for Robust Anomaly Detection in Industrial Inspection
• Authors: Muhammad Aqeel, Shakiba Sharifi, Marco Cristani, Francesco Setti,
• Abstract summary: We propose to leverage the adaptation ability of meta learning approaches to identify and reject noisy training data to improve the learning process.<n>In our model, we employ Model Agnostic Meta Learning (MAML) and an iterative refinement process through an Inter-Quartile Range rejection scheme to enhance their adaptability and robustness.
• Score: 9.132399905884364
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: This study investigates the performance of robust anomaly detection models in industrial inspection, focusing particularly on their ability to handle noisy data. We propose to leverage the adaptation ability of meta learning approaches to identify and reject noisy training data to improve the learning process. In our model, we employ Model Agnostic Meta Learning (MAML) and an iterative refinement process through an Inter-Quartile Range rejection scheme to enhance their adaptability and robustness. This approach significantly improves the models capability to distinguish between normal and defective conditions. Our results of experiments conducted on well known MVTec and KSDD2 datasets demonstrate that the proposed method not only excels in environments with substantial noise but can also contribute in case of a clear training set, isolating those samples that are relatively out of distribution, thus offering significant improvements over traditional models.

Related papers

• Towards Building a Robust Knowledge Intensive Question Answering Model with Large Language Models [4.4849006637642805]
  Presence of noise and errors in retrieved information poses challenges to the robustness of LLMs. To address the issue of model accuracy decline caused by noisy external information, we propose a data augmentation-based fine-tuning method. We have conducted experiments on both existing LLMs and our approach, the results are evaluated by GPT-4.
  arXiv  Detail & Related papers  (2024-09-09T07:32:30Z)
• Relation Modeling and Distillation for Learning with Noisy Labels [4.556974104115929]
  This paper proposes a relation modeling and distillation framework that models inter-sample relationships via self-supervised learning. The proposed framework can learn discriminative representations for noisy data, which results in superior performance than the existing methods.
  arXiv  Detail & Related papers  (2024-05-30T01:47:27Z)
• Low-rank finetuning for LLMs: A fairness perspective [54.13240282850982]
  Low-rank approximation techniques have become the de facto standard for fine-tuning Large Language Models. This paper investigates the effectiveness of these methods in capturing the shift of fine-tuning datasets from the initial pre-trained data distribution. We show that low-rank fine-tuning inadvertently preserves undesirable biases and toxic behaviors.
  arXiv  Detail & Related papers  (2024-05-28T20:43:53Z)
• DDPM-MoCo: Advancing Industrial Surface Defect Generation and Detection with Generative and Contrastive Learning [3.789219860006095]
  We introduce a novel defect-generation method, named DDPM-MoCo, to address these issues. Firstly, we utilize the Denoising Diffusion Probabilistic Model (DDPM) to generate high-quality defect data samples. Secondly, we utilize the unsupervised learning Momentum Contrast model (MoCo) with an enhanced batch contrastive loss function for training the model on unlabeled data.
  arXiv  Detail & Related papers  (2024-05-09T17:17:53Z)
• Learning with Noisy Foundation Models [95.50968225050012]
  This paper is the first work to comprehensively understand and analyze the nature of noise in pre-training datasets. We propose a tuning method (NMTune) to affine the feature space to mitigate the malignant effect of noise and improve generalization.
  arXiv  Detail & Related papers  (2024-03-11T16:22:41Z)
• Take the Bull by the Horns: Hard Sample-Reweighted Continual Training Improves LLM Generalization [165.98557106089777]
  A key challenge is to enhance the capabilities of large language models (LLMs) amid a looming shortage of high-quality training data. Our study starts from an empirical strategy for the light continual training of LLMs using their original pre-training data sets. We then formalize this strategy into a principled framework of Instance-Reweighted Distributionally Robust Optimization.
  arXiv  Detail & Related papers  (2024-02-22T04:10:57Z)
• Analyze the Robustness of Classifiers under Label Noise [5.708964539699851]
  Label noise in supervised learning, characterized by erroneous or imprecise labels, significantly impairs model performance. This research focuses on the increasingly pertinent issue of label noise's impact on practical applications.
  arXiv  Detail & Related papers  (2023-12-12T13:51:25Z)
• QualEval: Qualitative Evaluation for Model Improvement [82.73561470966658]
  We propose QualEval, which augments quantitative scalar metrics with automated qualitative evaluation as a vehicle for model improvement. QualEval uses a powerful LLM reasoner and our novel flexible linear programming solver to generate human-readable insights. We demonstrate that leveraging its insights, for example, improves the absolute performance of the Llama 2 model by up to 15% points relative.
  arXiv  Detail & Related papers  (2023-11-06T00:21:44Z)
• Learning Objective-Specific Active Learning Strategies with Attentive Neural Processes [72.75421975804132]
  Learning Active Learning (LAL) suggests to learn the active learning strategy itself, allowing it to adapt to the given setting. We propose a novel LAL method for classification that exploits symmetry and independence properties of the active learning problem. Our approach is based on learning from a myopic oracle, which gives our model the ability to adapt to non-standard objectives.
  arXiv  Detail & Related papers  (2023-09-11T14:16:37Z)
• Meta-tuning Loss Functions and Data Augmentation for Few-shot Object Detection [7.262048441360132]
  Few-shot object detection is an emerging topic in the area of few-shot learning and object detection. We propose a training scheme that allows learning inductive biases that can boost few-shot detection. The proposed approach yields interpretable loss functions, as opposed to highly parametric and complex few-shot meta-models.
  arXiv  Detail & Related papers  (2023-04-24T15:14:16Z)
• Rectified Meta-Learning from Noisy Labels for Robust Image-based Plant Disease Diagnosis [64.82680813427054]
  Plant diseases serve as one of main threats to food security and crop production. One popular approach is to transform this problem as a leaf image classification task, which can be addressed by the powerful convolutional neural networks (CNNs) We propose a novel framework that incorporates rectified meta-learning module into common CNN paradigm to train a noise-robust deep network without using extra supervision information.
  arXiv  Detail & Related papers  (2020-03-17T09:51:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.