Vision-Language Models for Analog Gauge Reading: An Empirical Study of Specialization, Transfer and Reliability

• URL: http://arxiv.org/abs/2608.17723v1
• Date: Tue, 18 Aug 2026 12:47:14 GMT
• Title: Vision-Language Models for Analog Gauge Reading: An Empirical Study of Specialization, Transfer and Reliability
• Abstract summary: This study is a systematic evaluation of specialization, transfer, robustness and reliability for a general-purpose vision-language model (VLM)<n>The Qwen2.5-VL-7B-Instruct model is evaluated using zero-shot prompting, in-context learning (ICL) and parameter-efficient fine-tuning with Quantized Low-Rank Adaptation (QLoRA)<n>The best fine-tuned MPE values are 2.39% on the synthetic dataset, with a 95% confidence interval (CI) of 1.43-3.90%; 2.61% on the Pressure Gauge dataset, with a CI of 1.66-3.80%; and 4.4
• Score: 3.112410411428948
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Analog gauges remain common in industrial environments where manual inspection is costly or hazardous. The engineering application addressed here is direct numerical reading of single-target analog-gauge images, while the artificial-intelligence contribution is a systematic evaluation of specialization, transfer, robustness and reliability for a general-purpose vision-language model (VLM) without an explicit pointer-segmentation and geometric-reading pipeline. The Qwen2.5-VL-7B-Instruct model is evaluated using zero-shot prompting, in-context learning (ICL) and parameter-efficient fine-tuning with Quantized Low-Rank Adaptation (QLoRA) on a public synthetic dataset, a video-derived Pressure Gauge dataset and a proprietary industrial dataset. All fine-tuning experiments use a fixed 20-epoch protocol with the final epoch used for analysis; separate models with and without supplied gauge ranges remove prompt-setting confounds. The primary metric is range-normalized mean percentage error (MPE). The best fine-tuned MPE values are 2.39% on the synthetic dataset, with a 95% bootstrap confidence interval (CI) of 1.43-3.90%; 2.61% on the Pressure Gauge dataset, with a CI of 1.66-3.80%; and 4.43% on the proprietary industrial dataset, with a CI of 2.31-7.14%. Leave-one-dataset-out experiments reveal substantial transfer degradation on held-out synthetic and proprietary data, while robustness tests identify Gaussian blur as the strongest tested corruption. Reliability analysis shows that high-confidence errors remain possible, motivating abstention and independent validation in safety-critical use. These results support QLoRA-specialized VLMs for direct single-gauge reading but not yet a deployment-ready plant-monitoring pipeline.

Related papers

• IPM-FM: A Foundation Model with Consensus Feature Selection for Industrial Process Monitoring [59.59850511287819]
  We propose the industrial process monitoring foundation model (IPM-FM)<n>It first learns general-purpose representations from unlabeled industrial process data through self-supervised pretraining.<n>It adapts to specific monitoring tasks using a small amount of task-labeled data, and finally produces calibrated predictions.
  arXiv  Detail & Related papers  (2026-09-08T07:43:04Z)
• Evaluating a 4B open-weights local LLM for agentic DFT workflows: a literature reproducibility audit [0.0]
  This work evaluates an openweights Qwen3:4B model executing an autonomous scientific pipeline across varying hardware constraints.<n>The system extracts parameters from unstructured text, translates them into density functional theory (DFT) inputs, and drives simulations to convergence.
  arXiv  Detail & Related papers  (2026-08-30T08:59:05Z)
• Can You Trust the Confidence? ConfBench for Vision-Language Models on Document Extraction [13.176724997257802]
  Existing document benchmarks are dominated by clean, high-quality samples.<n>We introduce ConfBench, the first calibration-specific benchmark for key information extraction.<n>We evaluate four proprietary and three open-weight VLMs under verbalized and log-probability confidence estimation methods.
  arXiv  Detail & Related papers  (2026-08-03T07:03:51Z)
• TimeLAVA: Learning-Agnostic Data Valuation for Time Series [48.76711740818533]
  TimeLAVA is a learning-agnostic framework that values temporal segments by their marginal contribution to minimize distributional discrepancy between evaluated and reference data.<n>We provide theoretical guarantees linking valuation to model-agnostic generalization and prove bounded sensitivity to contamination.
  arXiv  Detail & Related papers  (2026-06-17T06:16:16Z)
• Joint Model and Data Sparsification via the Marginal Likelihood [53.29070892356214]
  We propose jointly learning individual feature and sample relevancies, enabling simultaneous model and data sparsification.<n>This symmetric pruning of model and data offers a natural extension that preserves conjugacy.<n> Empirical results across diverse regression tasks affirm that a joint ARD approach consistently yields both sparse and robust prediction models.
  arXiv  Detail & Related papers  (2026-05-28T13:26:53Z)
• Benchmarking Large Language Models for Safety Data Extraction [0.0]
  This study benchmarks state-of-the-art Large Language Models (LLMs) for automated SDS data extraction.<n>We evaluate four models: Gemini 1.5 Pro, GPT-4o, Claude 3.7 Sonnet, and Llama 3.1-70B, across three prompting strategies.<n>Results show that text-based extraction consistently outperforms multimodal processing across all metrics.
  arXiv  Detail & Related papers  (2026-04-22T12:12:25Z)
• Flexible Gravitational-Wave Parameter Estimation with Transformers [73.44614054040267]
  We introduce a flexible transformer-based architecture paired with a training strategy that enables adaptation to diverse analysis settings at inference time.<n>We demonstrate that a single flexible model -- called Dingo-T1 -- can analyze 48 gravitational-wave events from the third LIGO-Virgo-KAGRA Observing Run.
  arXiv  Detail & Related papers  (2025-12-02T17:49:08Z)
• IAD-R1: Reinforcing Consistent Reasoning in Industrial Anomaly Detection [11.178131621535261]
  IAD-R1, a universal post-training framework, substantially enhances anomaly detection capabilities.<n>IAD-R1 achieves significant improvements across 7 Vision-Language Models (VLMs)<n>IAD-R1 surpasses commercial models including GPT-4.1 and Claude-Sonnet-4 in zero-shot settings.
  arXiv  Detail & Related papers  (2025-08-07T09:34:45Z)
• Semi-Supervised Defect Detection via Conditional Diffusion and CLIP-Guided Noise Filtering [8.132909775584395]
  This paper introduces a semi-supervised defect detection framework based on conditional diffusion (DSYM)<n>A conditional diffusion model synthesizes multi-scale pseudo-defect samples, while a CLIP cross-modal feature-based noise filtering mechanism mitigates label contamination.<n>This research provides a high-precision, low-labeling-dependent solution for defect detection in industrial quality inspection scenarios.
  arXiv  Detail & Related papers  (2025-07-08T01:53:34Z)
• Conservative Prediction via Data-Driven Confidence Minimization [70.93946578046003]
  In safety-critical applications of machine learning, it is often desirable for a model to be conservative. We propose the Data-Driven Confidence Minimization framework, which minimizes confidence on an uncertainty dataset.
  arXiv  Detail & Related papers  (2023-06-08T07:05:36Z)
• Leveraging Unlabeled Data to Predict Out-of-Distribution Performance [63.740181251997306]
  Real-world machine learning deployments are characterized by mismatches between the source (training) and target (test) distributions. In this work, we investigate methods for predicting the target domain accuracy using only labeled source data and unlabeled target data. We propose Average Thresholded Confidence (ATC), a practical method that learns a threshold on the model's confidence, predicting accuracy as the fraction of unlabeled examples.
  arXiv  Detail & Related papers  (2022-01-11T23:01:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.