Domain-Specific Data Quality Analysis Using Technology-Independent Query Templates
- URL: http://arxiv.org/abs/2607.24151v1
- Date: Mon, 27 Jul 2026 08:31:13 GMT
- Title: Domain-Specific Data Quality Analysis Using Technology-Independent Query Templates
- Abstract summary: Quality analysis is a central aspect of data quality management.<n> domain experts often lack the query language expertise needed to implement quality analyses.<n>We present the Quality Pattern Model framework (QPM), a model-driven approach to define templates for data quality analyses.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In an increasingly data-driven world, effectively working with data depends heavily on its quality. Quality analysis is a central aspect of data quality management. As data quality is typically domain- and context-specific, the definition of quality requirements is primarily the responsibility of domain experts. However, domain experts often lack the query language expertise needed to implement quality analyses. Therefore, the process of defining quality analyses results in a resource-intensive workflow that requires the involvement of technical experts, effectively excluding domain experts from independently managing data quality. To address this challenge, we present the Quality Pattern Model framework (QPM), a model-driven approach to define templates for data quality analyses that are independent of specific database technologies and application domains. QPM can eliminate the need for deep technical expertise and prevent the need for defining quality analyses several times for different database technologies. We present a proof-of-concept implementation of this approach for three database technologies: XML, RDF, and Neo4j. We evaluate the expressiveness of our approach, its applicability in the cultural heritage domain, and its usability by domain experts. For this purpose, we conducted a qualitative user study and empirically collected quality problems in a catalog. Our findings suggest that QPM matches and even exceeds the expressiveness of common database query languages. Furthermore, the results indicate that our tool enables domain experts to define template-based quality analyses independently, without requiring support of IT experts.
Related papers
- A Framework for Generating Valid Context-Specific Benchmarks through Expert Guidance [8.655727081754241]
This paper presents an end-to-end approach for generating context-specific large language model (LLM) benchmark datasets.<n>We introduce a schema eliciting key information about the goals, scope, and context of an evaluation task, and use this information to guide synthetic data generation.<n>We show how expert-informed scaffolds can guide synthetic data generation toward more valid benchmarks.
arXiv Detail & Related papers (2026-09-15T03:36:35Z) - A Model-Driven Pipeline for Data Quality Specification and Operationalization: A No-Code Approach for Domain Experts [0.0]
We present a pipeline for formalizing and operationalizing data quality constraints.<n>We support this pipeline using QPM, a metamodel for defining templates for reusable quality analyses.<n> Constrainify enables tailoring templates to specific conceptual requirements and translating them into executable quality analyses.
arXiv Detail & Related papers (2026-07-27T10:32:26Z) - Heterogeneous Multi-Agent Modeling for Measurement and Network Analysis of the Data Service Market [50.00393065059756]
This paper proposes a data service market measurement and network analysis method based on heterogeneous multi-agent modeling.<n>By introducing the service ecosystem theory, we clarify the participants and external factors of the data service market.<n>Furthermore, an analytical methodology is devised to precisely assess the influence of heterogeneous networks on utility.
arXiv Detail & Related papers (2026-05-22T08:44:56Z) - DepthCharge: A Domain-Agnostic Framework for Measuring Depth-Dependent Knowledge in Large Language Models [51.56484100374058]
Large Language Models appear competent when answering general questions but often fail when pushed into domain-specific details.<n>We present DepthCharge, a domain-agnostic framework that measures knowledge depth through three innovations.<n> adaptive probing that generates follow-up questions based on concepts the model actually mentions, on-demand fact verification from authoritative sources, and survival statistics with constant sample sizes at every depth level.
arXiv Detail & Related papers (2026-03-05T20:49:11Z) - QualiRAG: Retrieval-Augmented Generation for Visual Quality Understanding [80.66379018208568]
Visual quality assessment is shifting from prediction to interpretable quality understanding.<n>Current approaches rely on supervised fine-tuning or reinforcement learning on curated instruction.<n>We propose VbfQualiRAG, a framework that systematically leverages latent perceptual knowledge of large multimodal models for visual quality perception.
arXiv Detail & Related papers (2026-01-26T06:27:03Z) - Data Therapist: Eliciting Domain Knowledge from Subject Matter Experts Using Large Language Models [25.633548292173643]
Data Therapist is a web-based system that helps domain experts externalize tacit knowledge through a mixed-initiative process.<n>The resulting structured knowledge base can inform both human and automated visualization design.
arXiv Detail & Related papers (2025-05-01T11:10:17Z) - ExpertGenQA: Open-ended QA generation in Specialized Domains [9.412082058055823]
ExpertGenQA is a protocol that combines few-shot learning with structured topic and style categorization to generate comprehensive domain-specific QA pairs.<n>We show that ExpertGenQA achieves twice the efficiency of baseline few-shot approaches while maintaining $94.4%$ topic coverage.
arXiv Detail & Related papers (2025-03-04T19:09:48Z) - From Data Quality for AI to AI for Data Quality: A Systematic Review of Tools for AI-Augmented Data Quality Management in Data Warehouses [0.0]
High data quality (DQ) is critical for analytics, compliance, and AI performance.<n>This study investigates the extent to which existing tools support AI-augmented data quality management (DQM) in data warehouses.
arXiv Detail & Related papers (2024-06-16T13:43:04Z) - Enhancing Data Quality in Federated Fine-Tuning of Foundation Models [54.757324343062734]
We propose a data quality control pipeline for federated fine-tuning of foundation models.
This pipeline computes scores reflecting the quality of training data and determines a global threshold for a unified standard.
Our experiments show that the proposed quality control pipeline facilitates the effectiveness and reliability of the model training, leading to better performance.
arXiv Detail & Related papers (2024-03-07T14:28:04Z) - Analyzing Dataset Annotation Quality Management in the Wild [63.07224587146207]
Even popular datasets used to train and evaluate state-of-the-art models contain a non-negligible amount of erroneous annotations, biases, or artifacts.
While practices and guidelines regarding dataset creation projects exist, large-scale analysis has yet to be performed on how quality management is conducted.
arXiv Detail & Related papers (2023-07-16T21:22:40Z) - Unsupervised Quality Estimation for Neural Machine Translation [63.38918378182266]
Existing approaches require large amounts of expert annotated data, computation and time for training.
We devise an unsupervised approach to QE where no training or access to additional resources besides the MT system itself is required.
We achieve very good correlation with human judgments of quality, rivalling state-of-the-art supervised QE models.
arXiv Detail & Related papers (2020-05-21T12:38:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.