The Substrate Collapse: AI Code Generation Invalidates Authorship-Based Knowledge Metrics
- URL: http://arxiv.org/abs/2606.20882v1
- Date: Thu, 18 Jun 2026 19:17:24 GMT
- Title: The Substrate Collapse: AI Code Generation Invalidates Authorship-Based Knowledge Metrics
- Abstract summary: Software engineering has long inferred where a system's knowledge resides from who authored its code.<n>This paper argues that AI code generation severs that inference at its root.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Software engineering has long inferred where a system's knowledge resides from who authored its code. The truck factor, the Degree-of-Authorship metric, and the degree-of-knowledge model all rest on one inference -- that authoring a region of code is evidence of understanding it -- and for most of software's history it was a workable proxy, because code entered a repository only when a human wrote it, which forced at least transient understanding. This paper argues that AI code generation severs that inference at its root, and that the consequence is not the degradation of the authorship-based metrics but their invalidation as a class. When an agent generates a module and a human merges it, the version-control record still attributes authorship, but the attribution no longer licenses any conclusion about comprehension: the same footprint is now compatible with full, partial, or no understanding. The metric still returns a number; the number measures a substrate that has come uncoupled from the quantity it was used to estimate. The collapse is corroborated by the field's own measurement failures, and the methodological corollary is load-bearing: the instrument the comprehension-debt era needs cannot be built by refining the knowledge-concentration metrics, because no function of an authorship footprint recovers an inference the footprint no longer supports. The replacement must be grounded in evidence of comprehension rather than authorship. I state a falsifiable prediction that discriminates the two -- that systems with a healthy authorship-derived truck factor but low comprehension-measured retention will suffer incident-resolution failures the authorship metric does not predict -- and argue that building the comprehension-grounded instrument at the scale of a system and a team is the field's open measurement problem, left open here.
Related papers
- Semantic Knowledge Technologies: what the Semantic Web lost sight of, and what it never had [0.0]
The Semantic Web set out to give information a machine-interpretable form so that software could integrate and reason over it.<n>Its standards became scientific knowledge infrastructure, but the machine competence it promised did not follow.<n>This paper argues the original goal was right and the technical programme incomplete.
arXiv Detail & Related papers (2026-09-12T19:55:46Z) - Watermarks Without Verification: AI Text Watermarking After the EU AI Act [49.51124343181601]
Article 50 of the EU AI Act requires generative AI providers to mark the content their systems produce and ensure it can be detected as AI-generated.<n>Anthropic disclosed that every Claude model released after that date embeds a watermark based on SynthID-Text in all generated text, enabled by default with no user opt-out.<n>We argue that neither the objections nor the assurances can currently be verified and that this unverifiability, rather than watermarking itself, is the substantive governance failure.
arXiv Detail & Related papers (2026-09-09T01:56:17Z) - AUDITA: certified auditing and causal attribution of adverse outcomes in autonomous multi-agent systems [6.628624625332095]
AUDITA is an audit layer pairing a tamper-evident record of every inter-agent command with a graded causal-attribution engine.<n>It reduces the standard judge baseline's responsibility error roughly threefold.<n>On live language-model pipelines it reduces the standard judge baseline's responsibility error roughly threefold.
arXiv Detail & Related papers (2026-08-23T01:22:09Z) - Fantastic Adaptive Taxonomies and How to Use Them [100.20614173157708]
AdaMAST converts execution traces into a compact, evidence-grounded failure taxonomy.<n>No code is hand-authored, no trace human-annotated.<n>In agent-system search, taxonomy-coded diagnoses of failed candidates outperform free-form.
arXiv Detail & Related papers (2026-07-17T17:41:16Z) - Who Grades the Grader? Co-Evolving Evaluation Metrics and Skills for Self-Improving LLM Agents [9.989306175511238]
Self-evolving agent systems improve by creating, revising, and retiring their own skills, but every such loop rests on a hidden assumption: a reliable evaluation metric already exists.<n>We make three claims. First, metrics can be emphevolved: our metric loop searches compositions of small detectors under a full evolutionary lifecycle.<n>Second, since no metric exists to beat, the yardstick is recovering what an accurate metric would have enabled, and emphDouble Ratchet, our co-evolution of the metric with a lifecycle-managed skill loop.
arXiv Detail & Related papers (2026-07-14T14:02:50Z) - No Accidental Software Agent First Canonical Code for Human Code Entropy Reduction and 30 to 500 times Lower Frontier Model Requirements [0.0]
We propose a proof-carrying substrate that rewrites routine product software into canonical behavior profiles.<n>The proposed limit is a No-Accident Horizon: removable accident decreases until residual novelty, evidence, governance, risk, and future optionality dominate.<n>Preliminary QLoRA experiments on Qwen2.5-Coder-14B show that 64,088 canonical trajectories are learnable and suppress tested forbidden-language markers.
arXiv Detail & Related papers (2026-06-12T11:35:54Z) - The End of Code Review: Coding Agents Supersede Human Inspection [7.017303286271101]
We argue that coding agents have crossed a threshold of capability at which traditional human code review is no longer a necessary component of a software quality pipeline.<n>Our argument rests on two claims: every stated goal of code review can be served by agents at lower cost and higher throughput.
arXiv Detail & Related papers (2026-06-11T10:43:48Z) - Interpretation, Learning, and Empathy as One Constraint: A Residual-Adequacy Architecture with Accountable Abstention [0.0]
We develop a small cognitive architecture in which limits arise from a single quantity.<n>An Interpretation-Decision Unit (IDU) interprets a content vector through a family of regimes and decides which actions it licenses.<n>We prove the unit is total and deterministic: for any content and fixed configuration it halts in finitely many bounded-cost steps with a unique terminal witness.
arXiv Detail & Related papers (2026-05-24T10:57:28Z) - What Really Improves Mathematical Reasoning: Structured Reasoning Signals Beyond Pure Code [72.9921566968371]
We revisit the claim that code improves reasoning through controlled pretraining experiments on a 10T-token corpus with fine-grained domain separation.<n>Code substantially improves programming ability but does not act as a general reasoning enhancer.<n>Cross-domain structured reasoning traces, such as code-text and math-text mixtures, are better explained.
arXiv Detail & Related papers (2026-05-19T12:37:01Z) - The Khipu Problem: Institutional Legibility Under Distributed Cognition [0.0]
This paper introduces the khipu problem for distributed AI: the record can survive while the reading practice needed to interpret it decays.<n>Logs, traces, model versions, tool calls, outputs, and approval artifacts may remain available while the institutional capacity to read them as parts of one coherent cognitive episode disappears.<n>We argue that this failure is better understood as loss of interpretive continuity than as ordinary lack of observability.
arXiv Detail & Related papers (2026-05-06T16:51:52Z) - IMPACT-CYCLE: A Contract-Based Multi-Agent System for Claim-Level Supervisory Correction of Long-Video Semantic Memory [73.22944697933603]
Existing pipelines produce opaque, end-to-end outputs that expose no intermediate state for inspection.<n>We present IMPACT-Cycle, a supervisory multi-agent system that reformulates long-video understanding as a multimodal iterative claim-level maintenance.
arXiv Detail & Related papers (2026-04-22T03:03:33Z) - Scaling Human-AI Coding Collaboration Requires a Governable Consensus Layer [22.42181408084751]
Vibe coding produces correct, executable code at speed, but leaves no record of the structural commitments, dependencies, or evidence behind it.<n>We propose Agentic Consensus: a paradigm in which the consensus layer C, an operable world model, replaces code as the primary artifact of engineering.<n>We propose benchmark task families designed to measure whether consensus-based reduce human intervention compared to chat-driven baselines.
arXiv Detail & Related papers (2026-04-20T06:53:32Z) - The Medium Is Not the Message: Deconfounding Document Embeddings via Linear Concept Erasure [98.71456610527598]
Embedding-based similarity metrics can be influenced by spurious attributes like the text's source or language.<n>This paper shows that a debiasing algorithm that removes information about observed confounders from the encoder representations substantially reduces these biases at a minimal computational cost.
arXiv Detail & Related papers (2025-07-01T23:17:12Z) - Is the Top Still Spinning? Evaluating Subjectivity in Narrative Understanding [40.78154629252038]
Forcing binary labels upon ambiguous claims lowers the reliability of evaluation.<n>We introduce LLM-generated edits of summaries as a method of providing a nuanced evaluation of claims.<n>We show that ARM produces a absolute 21% improvement in annotator agreement on claim faithfulness.
arXiv Detail & Related papers (2025-04-01T19:08:24Z) - Evaluating Factuality in Generation with Dependency-level Entailment [57.5316011554622]
We propose a new formulation of entailment that decomposes it at the level of dependency arcs.
We show that our dependency arc entailment model trained on this data can identify factual inconsistencies in paraphrasing and summarization better than sentence-level methods.
arXiv Detail & Related papers (2020-10-12T06:43:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.