A Model-Driven Pipeline for Data Quality Specification and Operationalization: A No-Code Approach for Domain Experts

• URL: http://arxiv.org/abs/2607.24245v1
• Date: Mon, 27 Jul 2026 10:32:26 GMT
• Title: A Model-Driven Pipeline for Data Quality Specification and Operationalization: A No-Code Approach for Domain Experts
• Abstract summary: We present a pipeline for formalizing and operationalizing data quality constraints.<n>We support this pipeline using QPM, a metamodel for defining templates for reusable quality analyses.<n> Constrainify enables tailoring templates to specific conceptual requirements and translating them into executable quality analyses.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: High-quality data is essential for reliable analysis, decision-making, and research across domains. This is especially relevant in areas such as cultural heritage, where data is collected and curated manually, making it prone to quality issues like inconsistencies. To improve data quality, the data must be analyzed regularly using systematic quality analyses. Quality analyses validate the conformance of data to domain-specific expectations. These expectations are best understood by domain experts, who can express them using natural language. However, they rarely possess the technical expertise to formalize these expectations into executable quality analyses. Consequently, this process requires domain experts and data engineers, making it time-consuming and technically demanding. The required technical expertise and the resulting dependencies pose a significant challenge. To address this challenge, we present a pipeline for formalizing and operationalizing data quality constraints. We support this pipeline using QPM, a metamodel for defining templates for reusable quality analyses. The web application Constrainify enables tailoring templates to specific conceptual requirements and translating them into executable quality analyses via a tool-chain based on model-driven engineering subpipelines. The result is a set of reusable, repeatable, and domain-specific quality analyses.

Related papers

• A Framework for Generating Valid Context-Specific Benchmarks through Expert Guidance [8.655727081754241]
  This paper presents an end-to-end approach for generating context-specific large language model (LLM) benchmark datasets.<n>We introduce a schema eliciting key information about the goals, scope, and context of an evaluation task, and use this information to guide synthetic data generation.<n>We show how expert-informed scaffolds can guide synthetic data generation toward more valid benchmarks.
  arXiv  Detail & Related papers  (2026-09-15T03:36:35Z)
• Domain-Specific Data Quality Analysis Using Technology-Independent Query Templates [0.0]
  Quality analysis is a central aspect of data quality management.<n> domain experts often lack the query language expertise needed to implement quality analyses.<n>We present the Quality Pattern Model framework (QPM), a model-driven approach to define templates for data quality analyses.
  arXiv  Detail & Related papers  (2026-07-27T08:31:13Z)
• AIDABench: AI Data Analytics Benchmark [62.45908988324612]
  AIDABench is a benchmark for evaluating AI systems on complex data analytics tasks in an end-to-end manner.<n>AIDABench encompasses 600+ diverse document analysis tasks across three core capability dimensions: question answering, data visualization, and file generation.<n>We evaluate 11 state-of-the-art models on AIDABench, spanning both proprietary (e.g., Claude Sonnet 4.5, Gemini 3 Pro Preview) and open-source (e.g., Qwen3-Max-2026-01-23-Thinking) families.
  arXiv  Detail & Related papers  (2026-02-27T08:58:05Z)
• QualiRAG: Retrieval-Augmented Generation for Visual Quality Understanding [80.66379018208568]
  Visual quality assessment is shifting from prediction to interpretable quality understanding.<n>Current approaches rely on supervised fine-tuning or reinforcement learning on curated instruction.<n>We propose VbfQualiRAG, a framework that systematically leverages latent perceptual knowledge of large multimodal models for visual quality perception.
  arXiv  Detail & Related papers  (2026-01-26T06:27:03Z)
• OIDA-QA: A Multimodal Benchmark for Analyzing the Opioid Industry Documents Archive [50.468138755368805]
  Opioid crisis represents a significant moment in public health.<n>Data and documents disclosed in the UCSF-JHU Opioid Industry Documents Archive (OIDA)<n>In this paper, we tackle this challenge by organizing the original dataset according to document attributes.
  arXiv  Detail & Related papers  (2025-11-13T03:27:32Z)
• Think Less, Label Better: Multi-Stage Domain-Grounded Synthetic Data Generation for Fine-Tuning Large Language Models in Telecommunications [0.0]
  We present a retrieval-augmented pipeline for generating synthetic question-answer pairs grounded in structured domain knowledge.<n>Our framework integrates a retriever, base generator, and refinement model to synthesize and enhance QA pairs.<n>We demonstrate our approach in a real-world telecom scenario focused on radio access network (RAN) troubleshooting.
  arXiv  Detail & Related papers  (2025-09-30T03:49:57Z)
• Empowering Time Series Analysis with Synthetic Data: A Survey and Outlook in the Era of Foundation Models [104.17057231661371]
  Time series analysis is crucial for understanding dynamics of complex systems.<n>Recent advances in foundation models have led to task-agnostic Time Series Foundation Models (TSFMs) and Large Language Model-based Time Series Models (TSLLMs)<n>Their success depends on large, diverse, and high-quality datasets, which are challenging to build due to regulatory, diversity, quality, and quantity constraints.<n>This survey provides a comprehensive review of synthetic data for TSFMs and TSLLMs, analyzing data generation strategies, their role in model pretraining, fine-tuning, and evaluation, and identifying future research directions.
  arXiv  Detail & Related papers  (2025-03-14T13:53:46Z)
• From Data Quality for AI to AI for Data Quality: A Systematic Review of Tools for AI-Augmented Data Quality Management in Data Warehouses [0.0]
  High data quality (DQ) is critical for analytics, compliance, and AI performance.<n>This study investigates the extent to which existing tools support AI-augmented data quality management (DQM) in data warehouses.
  arXiv  Detail & Related papers  (2024-06-16T13:43:04Z)
• DeepFMEA -- A Scalable Framework Harmonizing Process Expertise and Data-Driven PHM [0.0]
  In most industrial settings, data is often limited in quantity, and its quality can be inconsistent. To bridge this gap in practice, successfully industrialized PHM tools rely on the introduction of domain expertise as a prior. DeepFMEA draws inspiration from the Failure Mode and Effects Analysis (FMEA) in its structured approach to the analysis of any technical system.
  arXiv  Detail & Related papers  (2024-05-13T09:41:34Z)
• Enhancing Data Quality in Federated Fine-Tuning of Foundation Models [54.757324343062734]
  We propose a data quality control pipeline for federated fine-tuning of foundation models. This pipeline computes scores reflecting the quality of training data and determines a global threshold for a unified standard. Our experiments show that the proposed quality control pipeline facilitates the effectiveness and reliability of the model training, leading to better performance.
  arXiv  Detail & Related papers  (2024-03-07T14:28:04Z)
• Quality Assurance of A GPT-based Sentiment Analysis System: Adversarial Review Data Generation and Detection [10.567108680774782]
  GPT-based sentiment analysis model is first constructed and studied as the reference in AI quality analysis. Quality analysis related to data adequacy is implemented, including employing the content-based approach to generate reasonable adversarial review comments. Experiments based on Amazon.com review data and a fine-tuned GPT model were implemented.
  arXiv  Detail & Related papers  (2023-10-09T00:01:05Z)
• Analyzing Dataset Annotation Quality Management in the Wild [63.07224587146207]
  Even popular datasets used to train and evaluate state-of-the-art models contain a non-negligible amount of erroneous annotations, biases, or artifacts. While practices and guidelines regarding dataset creation projects exist, large-scale analysis has yet to be performed on how quality management is conducted.
  arXiv  Detail & Related papers  (2023-07-16T21:22:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.