Evaluating Design Conformance Through Trace Comparison

• URL: http://arxiv.org/abs/2605.07909v1
• Date: Fri, 08 May 2026 15:48:03 GMT
• Title: Evaluating Design Conformance Through Trace Comparison
• Abstract summary: The design of a system and its implementation are two tasks often carried out by different individuals on a development team.<n>This creates a potential for divergence between real behavior and the designed model that an implementation is intended to match.<n>This paper proposes an approach to ensure that the key implementation details match the design and that adherence to a particular strategy is not lost over time.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The design of a system and its implementation are two tasks often carried out by different individuals on a development team, and can occur weeks or months apart. This creates a potential for divergence between real behavior and the designed model that an implementation is intended to match. Particularly as time passes and individuals who were present for the original conception of the design leave, a system can lose coherence and drift from intended design principles. Even with a robust system design, more is needed to ensure that the key implementation details match the design and that adherence to a particular strategy is not lost over time. This paper proposes an approach to address that concern for distributed systems using conformance checking, a methodology borrowed from process mining. Distributed traces produced by instrumented applications are evaluated for conformance by comparison to design traces. The resulting conformance percentage is a quantitative metric that can be tracked over time to determine how closely a concrete implementation corresponds to the key attributes of the expected design model. This analysis is done using the dominant industry standard, OpenTelemetry, and so should apply to a wide range of distributed systems.

Related papers

• Interpreting Object-Dependent Concept Brittleness in Text-to-Image Diffusion Models [105.53190946111586]
  We term this phenomenon object-dependent concept brittleness.<n>We present an interpretability-oriented framework to audit and minimally correct these failures.<n>We evaluate the proposed framework on style and attribute failure cases across multiple diffusion backbones.
  arXiv  Detail & Related papers  (2026-09-09T09:07:40Z)
• Design Methodology and Performance Trade-offs Management for Distributed and Compound AI Systems [1.1470070927586018]
  Compound AI systems realize this shift by orchestrating multiple models, algorithms, and tools as distributed AI systems through explicit control logic.<n>We present a design methodology that organizes this space along two dimensions, workflow topology and configuration selection, and identifies eight design patterns.
  arXiv  Detail & Related papers  (2026-06-12T11:09:57Z)
• SynQ: An Embedded DSL for Synchronous System Design with Quantitative Types [2.758944775979243]
  SynQ is an embedded domain specification language (EDSL) targeting the design of systems obeying the perfect synchrony hypothesis.<n>It enables a semantically coherent design process, including formal specification and verification, modelling, simulation and code generation.
  arXiv  Detail & Related papers  (2025-05-05T12:44:13Z)
• Reliable algorithm selection for machine learning-guided design [2.9158689853305693]
  This paper proposes a method for design algorithm selection.<n>It aims to select design algorithms that will produce a distribution of design labels satisfying a user-specified success criterion.<n>We demonstrate the method's effectiveness in simulated protein and RNA design tasks.
  arXiv  Detail & Related papers  (2025-03-26T17:52:19Z)
• A Top-down Graph-based Tool for Modeling Classical Semantic Maps: A Crosslinguistic Case Study of Supplementary Adverbs [50.982315553104975]
  Semantic map models (SMMs) construct a network-like conceptual space from cross-linguistic instances or forms.<n>Most SMMs are manually built by human experts using bottom-up procedures.<n>We propose a novel graph-based algorithm that automatically generates conceptual spaces and SMMs in a top-down manner.
  arXiv  Detail & Related papers  (2024-12-02T12:06:41Z)
• Draft Model Knows When to Stop: Self-Verification Speculative Decoding for Long-Form Generation [64.59292053188264]
  Experimental results on mainstream SD benchmarks as well as reasoning-heavy benchmarks demonstrate the superior performance of SVIP.<n>SVIP is a training-free dynamic length policy for speculative decoding systems that adaptively determines the lengths of draft sequences by referring to the draft entropy.
  arXiv  Detail & Related papers  (2024-11-27T15:53:17Z)
• Object-Centric Conformance Alignments with Synchronization (Extended Version) [57.76661079749309]
  We present a new formalism that combines the ability of object-centric Petri nets to capture one-to-many relations and the one of Petri nets with identifiers to compare and synchronize objects based on their identity. We propose a conformance checking approach for such nets based on an encoding in satisfiability modulo theories (SMT)
  arXiv  Detail & Related papers  (2023-12-13T21:53:32Z)
• Beyond the training set: an intuitive method for detecting distribution shift in model-based optimization [0.4188114563181614]
  A common scenario involves using a fixed training set to train models, with the goal of designing new samples that outperform those present in the training data. A major challenge in this setting is distribution shift, where the distributions of training and design samples are different. We propose a straightforward method for design practitioners that detects distribution shifts.
  arXiv  Detail & Related papers  (2023-11-09T13:44:28Z)
• Representation Learning for Sequential Volumetric Design Tasks [11.702880690338677]
  We propose to encode the design knowledge from a collection of expert or high-performing design sequences.<n>We develop the preference model by estimating the density of the learned representations.<n>We train an autoregressive transformer model for sequential design generation.
  arXiv  Detail & Related papers  (2023-09-05T21:21:06Z)
• Design Space Exploration and Explanation via Conditional Variational Autoencoders in Meta-model-based Conceptual Design of Pedestrian Bridges [52.77024349608834]
  This paper provides a performance-driven design exploration framework to augment the human designer through a Conditional Variational Autoencoder (CVAE) The CVAE is trained on 18'000 synthetically generated instances of a pedestrian bridge in Switzerland.
  arXiv  Detail & Related papers  (2022-11-29T17:28:31Z)
• Robust Learning Through Cross-Task Consistency [92.42534246652062]
  We propose a broadly applicable and fully computational method for augmenting learning with Cross-Task Consistency. We observe that learning with cross-task consistency leads to more accurate predictions and better generalization to out-of-distribution inputs.
  arXiv  Detail & Related papers  (2020-06-07T09:24:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.