Scaling Author Identity Disambiguation to the World of Code: A Methodology
- URL: http://arxiv.org/abs/2607.06920v1
- Date: Wed, 08 Jul 2026 02:30:26 GMT
- Title: Scaling Author Identity Disambiguation to the World of Code: A Methodology
- Abstract summary: We describe the methodology used to alias the World of Code (WoC) collection (version V2604, 107M distinct author strings over 6B commits) into canonical persons.<n>At this scale the central problem is over-merge, not missed merges.<n>We report the full experimental record (more than twenty experiments, including unsuccessful ones) behind the deployed design.
- Score: 2.788646205877688
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We describe the methodology used to alias the free-text author/committer identities of the entire World of Code (WoC) collection (version V2604, ~107M distinct author strings over ~6B commits) into canonical persons, extending the fingerprint-based anti-aliasing of ALFAA and the 38M-identity resolution of Fry et al. by an order of magnitude. At this scale the central problem is over-merge, not missed merges: a few bridge identities (bots, role accounts, placeholder emails, multi-author commit fields) transitively weld unrelated clusters through the global union step into million-member "mega-clusters." We report the full experimental record (more than twenty experiments, including unsuccessful ones) behind the deployed design. Node-level gates (information score, project spread, degree) preserve recall but cannot dissolve the mega-cluster; per-value blocklists of high-quality-but-shared attributes are recall-safe but cannot break a redundant mesh; the working composition is a betweenness cut over the exact union graph plus a per-edge classifier trained on 2.6M labels mined from GitHub no-reply identifiers. That classifier, filtering dormant cross-project shingle groups and joined by GitHub's own account assertions, then recovers the recall the precision work had foregone. Against human-adjudicated pairs the per-edge model transfers at AUC 0.99; end to end the largest cluster falls from 170,431 (and a predecessor's 3.0M) to under 7,000 w hile gold recall rises from 0.44 to 0.70 at increasing precision, and on an independent 21M-alias GitHub ground truth the final map outscores its predecessors and the published state of the art among global, privacy-preserving resolvers. The record doubles as a catalog of scale lessons: structural cuts do not transfer to edge sets they never saw, and recall-only and precision-only benchmarks invert verdicts unless read together.
Related papers
- Codebook Agent: Amortized Topology Design for LLM Multi-Agent Systems [67.04448659688579]
We develop a query-independent 16-entry codebook that ranks the top decoded candidates in a single batched forward pass.<n>With no iterative search and no message passing at test time, Codebook Agent is the most accurate method on all six benchmarks.
arXiv Detail & Related papers (2026-09-02T08:10:22Z) - GRAND-HC: Graph-Refined Author Name Disambiguation [58.02589236670033]
From-Scratch Name Disambiguation (SND) groups papers sharing an ambiguous name into clusters of distinct real-world authors.<n>We propose textbfGRAND-HC, a complete end-to-end SND framework.
arXiv Detail & Related papers (2026-08-24T08:21:28Z) - Stylometric Defenses Against Author Impersonation in Software Repositories [0.0]
Cross-modal patch-level embeddings can support behavioral triage against author impersonation in real-world repositories.<n>We fine-tune a cross-modal transformer on more than 20 years of Linux kernel commit history to embed code diffs and commit messages into a unified stylometric space.
arXiv Detail & Related papers (2026-08-03T11:02:13Z) - Claimed or Attested? A Commit-Signature Dataset and Identity Trust Tiers across the World of Code [2.788646205877688]
We release the first commit-signature axis for the World of Code (WoC)<n>Over the V2604 corpus of 5,866,595,698 commits, 17.59% carry a signature.<n>All artifacts are released as a self-contained, in dependently hosted replication package keyed to the WoC V2604 collection.
arXiv Detail & Related papers (2026-07-07T12:19:25Z) - A Global Author-Identity Map for the World of Code:62.7M Developer Identities from 106.8M Author Strings over 5.87B Commits [2.788646205877688]
We release a curated author-identity map for World of Code (WoC) version V2604 covering all 5,866,595,698 commits.<n>The map is mega-cluster free, its largest cluster 6,910 ids (one GitHub noreply identity), and it resolves 73.5% of six billion commits into multi-id identities.<n>We report both error families, splitting and clumping, and show the high precision claimed by global-scale union maps can be an artifact of never measuring the conflated region.
arXiv Detail & Related papers (2026-07-07T12:09:45Z) - Efficient Visual Pointing for Embodied AI:Agent-Driven Data Synthesis, Cross-Block Attention, and Iterative Correction [55.11480729304395]
We describe our PointArena 2026 solution, which achieves 77.2% overall accuracy and ranks second on the benchmark.<n>The ap proach targets three failure modes. First, agent-driven syn thesis builds large semantic and anchor-relative candidate pools.<n>Second, a determinis tic steerable-data pipeline creates a verified 10,000-sample main set, plus reserve samples, using masks, templates, and path verification.
arXiv Detail & Related papers (2026-06-29T06:39:03Z) - Deforking the World of Code: A Project-Provenance Map that Recovers Cross-Forge Fork Families that Platform Graphs Cannot See [2.788646205877688]
We release a curated deforking map for the World of Code (WoC) version V2604: p2PFull.<n>It collapses every raw repository p into the deforked project P to which it belongs.<n>We validate the map against GitHub's declared fork graph reconstructed from GH ForkEvents.
arXiv Detail & Related papers (2026-06-28T18:25:17Z) - Control-Plane Placement Shapes Forgetting: An Architectural Study of Agent Memory Across Thirteen System Configurations [1.2763567932588586]
ForgetEval is a 1000-case templated suite plus a 385-case adversarial layer (132 hand-crafted + 253 LLM-drafted oracle-validated)<n>We observe three placement regimes with partly complementary coverage: deterministic primitives suffice for lexical/temporal categories but fail canonicalization.<n>We expose the trade-off via ForgetEval, a 1000-case templated suite plus a 385-case adversarial layer.
arXiv Detail & Related papers (2026-06-14T16:32:15Z) - TwinGate: Stateful Defense against Decompositional Jailbreaks in Untraceable Traffic via Asymmetric Contrastive Learning [60.68349524623048]
Decompositional jailbreaks pose a critical threat to large language models.<n>We present TwinGate, a stateful dual-encoder defense framework.<n>We construct a comprehensive dataset of over 3.62 million instructions spanning 8,600 distinct malicious intents.
arXiv Detail & Related papers (2026-04-30T13:44:01Z) - Reducing Maintenance Burden in Behaviour-Driven Development: A Paraphrase-Robust Duplicate-Step Detector with a 1.1M-Step Open Benchmark [1.9537983097153042]
Behaviour-Driven Development suites accumulate step-duplicate duplication with documented maintenance cost.<n>We release the largest cross-organisational BDD step corpus to date.
arXiv Detail & Related papers (2026-04-22T11:44:05Z) - NearID: Identity Representation Learning via Near-identity Distractors [116.71529576796605]
Existing vision encoders entangle object identity with background context, leading to unreliable representations and metrics.<n>We introduce the first principled framework to address this vulnerability using Near-identity distractors.<n>We present the NearID dataset (19K identities, 316K matched-context distractors) together with a strict margin-based evaluation protocol.
arXiv Detail & Related papers (2026-04-02T12:33:14Z) - Meta Clustering Learning for Large-scale Unsupervised Person
Re-identification [124.54749810371986]
We propose a "small data for big task" paradigm dubbed Meta Clustering Learning (MCL)
MCL only pseudo-labels a subset of the entire unlabeled data via clustering to save computing for the first-phase training.
Our method significantly saves computational cost while achieving a comparable or even better performance compared to prior works.
arXiv Detail & Related papers (2021-11-19T04:10:18Z) - Improving Face Recognition by Clustering Unlabeled Faces in the Wild [77.48677160252198]
We propose a novel identity separation method based on extreme value theory.
It greatly reduces the problems caused by overlapping-identity label noise.
Experiments on both controlled and real settings demonstrate our method's consistent improvements.
arXiv Detail & Related papers (2020-07-14T12:26:50Z) - Mutual Mean-Teaching: Pseudo Label Refinery for Unsupervised Domain
Adaptation on Person Re-identification [56.97651712118167]
Person re-identification (re-ID) aims at identifying the same persons' images across different cameras.
domain diversities between different datasets pose an evident challenge for adapting the re-ID model trained on one dataset to another one.
We propose an unsupervised framework, Mutual Mean-Teaching (MMT), to learn better features from the target domain via off-line refined hard pseudo labels and on-line refined soft pseudo labels.
arXiv Detail & Related papers (2020-01-06T12:42:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.