Automated Recovery of Issue-Commit Links Leveraging Both Textual and
Non-textual Data
- URL: http://arxiv.org/abs/2107.01894v1
- Date: Mon, 5 Jul 2021 09:38:44 GMT
- Title: Automated Recovery of Issue-Commit Links Leveraging Both Textual and
Non-textual Data
- Abstract summary: Current state-of-the-art approaches for automated commit-issue linking suffer from low precision, leading to unreliable results.
We propose Hybrid-Linker to overcome such limitations by exploiting two information channels.
We evaluate Hybrid-Linker against competing approaches, namely FRLink and DeepLink on a dataset of 12 projects.
- Score: 2.578242050187029
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: An issue documents discussions around required changes in issue-tracking
systems, while a commit contains the change itself in the version control
systems. Recovering links between issues and commits can facilitate many
software evolution tasks such as bug localization, and software documentation.
A previous study on over half a million issues from GitHub reports only about
42.2% of issues are manually linked by developers to their pertinent commits.
Automating the linking of commit-issue pairs can contribute to the improvement
of the said tasks. By far, current state-of-the-art approaches for automated
commit-issue linking suffer from low precision, leading to unreliable results,
sometimes to the point that imposes human supervision on the predicted links.
The low performance gets even more severe when there is a lack of textual
information in either commits or issues. Current approaches are also proven
computationally expensive.
We propose Hybrid-Linker to overcome such limitations by exploiting two
information channels; (1) a non-textual-based component that operates on
non-textual, automatically recorded information of the commit-issue pairs to
predict a link, and (2) a textual-based one which does the same using textual
information of the commit-issue pairs. Then, combining the results from the two
classifiers, Hybrid-Linker makes the final prediction. Thus, every time one
component falls short in predicting a link, the other component fills the gap
and improves the results. We evaluate Hybrid-Linker against competing
approaches, namely FRLink and DeepLink on a dataset of 12 projects.
Hybrid-Linker achieves 90.1%, 87.8%, and 88.9% based on recall, precision, and
F-measure, respectively. It also outperforms FRLink and DeepLink by 31.3%, and
41.3%, regarding the F-measure. Moreover, Hybrid-Linker exhibits extensive
improvements in terms of performance as well.
Related papers
- SemLink: A Semantic-Aware Automated Test Oracle for Hyperlink Verification using Siamese Sentence-BERT [1.5984927623688912]
Web applications rely heavily on hyperlinks to connect disparate information resources.<n>Traditional verification tools, which primarily function as crash oracles by checking HTTP status codes, often fail to detect semantic inconsistencies.<n>We propose SemLink, a novel automated test oracle for semantic hyperlink verification.
arXiv Detail & Related papers (2026-04-07T11:10:33Z) - What Papers Don't Tell You: Recovering Tacit Knowledge for Automated Paper Reproduction [57.86097956633207]
method is a graph-based agent framework for generating executable code from academic papers.<n>On an extended ReproduceBench spanning 3 domains, 10 tasks, and 40 recent papers, method achieves an average performance gap of 10.04% against official implementations.
arXiv Detail & Related papers (2026-03-02T12:33:31Z) - Establishing Traceability Links between Release Notes & Software Artifacts: Practitioners' Perspectives [5.70062525101025]
In open-source environments where contributors work remotely and asynchronously, establishing and maintaining traceability links is often error-prone.<n>Our empirical study of GitHub repositories revealed that 47% of release artifacts lacked traceability links, and 12% contained broken links.<n>We implemented LLM-based approaches to automatically establish traceability links of three pairs between release note contents & PRs, release note contents & PRs and release note contents & issues.
arXiv Detail & Related papers (2025-11-22T20:45:24Z) - ABCD-LINK: Annotation Bootstrapping for Cross-Document Fine-Grained Links [57.514511353084565]
We introduce a new domain-agnostic framework for selecting a best-performing approach and annotating cross-document links.<n>We apply our framework in two distinct domains -- peer review and news.<n>The resulting novel datasets lay foundation for numerous cross-document tasks like media framing and peer review.
arXiv Detail & Related papers (2025-09-01T11:32:24Z) - LinkAnchor: An Autonomous LLM-Based Agent for Issue-to-Commit Link Recovery [1.5399429731150376]
A study on GitHub shows that only 42.2% of the issues are correctly linked to their commits.<n>We present LinkAnchor, the first autonomous LLM-based agent designed for issue-to-commit link recovery.
arXiv Detail & Related papers (2025-08-17T04:21:44Z) - Back to the Basics: Rethinking Issue-Commit Linking with LLM-Assisted Retrieval [12.213080309713574]
Issue-commit linking, which connects issues with commits that fix them, is crucial for software maintenance.<n>We propose EasyLink, which utilizes a vector database as a modern Information Retrieval technique.<n>Under our evaluation, EasyLink achieves an average Precision@1 of 75.91%, improving over the state-of-the-art by over four times.
arXiv Detail & Related papers (2025-07-12T08:42:10Z) - Localizing Factual Inconsistencies in Attributable Text Generation [91.981439746404]
We introduce QASemConsistency, a new formalism for localizing factual inconsistencies in attributable text generation.
We first demonstrate the effectiveness of the QASemConsistency methodology for human annotation.
We then implement several methods for automatically detecting localized factual inconsistencies.
arXiv Detail & Related papers (2024-10-09T22:53:48Z) - Relation Rectification in Diffusion Model [64.84686527988809]
We introduce a novel task termed Relation Rectification, aiming to refine the model to accurately represent a given relationship it initially fails to generate.
We propose an innovative solution utilizing a Heterogeneous Graph Convolutional Network (HGCN)
The lightweight HGCN adjusts the text embeddings generated by the text encoder, ensuring the accurate reflection of the textual relation in the embedding space.
arXiv Detail & Related papers (2024-03-29T15:54:36Z) - EALink: An Efficient and Accurate Pre-trained Framework for Issue-Commit
Link Recovery [54.34661595290837]
We propose an efficient and accurate pre-trained framework called EALink for issue-commit link recovery.
We construct a large-scale dataset and conduct extensive experiments to demonstrate the power of EALink.
Results show that EALink outperforms the state-of-the-art methods by a large margin (15.23%-408.65%) on various evaluation metrics.
arXiv Detail & Related papers (2023-08-21T14:46:43Z) - CONVERT:Contrastive Graph Clustering with Reliable Augmentation [110.46658439733106]
We propose a novel CONtrastiVe Graph ClustEring network with Reliable AugmenTation (CONVERT)
In our method, the data augmentations are processed by the proposed reversible perturb-recover network.
To further guarantee the reliability of semantics, a novel semantic loss is presented to constrain the network.
arXiv Detail & Related papers (2023-08-17T13:07:09Z) - Delving into Commit-Issue Correlation to Enhance Commit Message
Generation Models [13.605167159285374]
Commit message generation is a challenging task in automated software engineering.
tool is a novel paradigm that can introduce the correlation between commits and issues into the training phase of models.
The results show that compared with the original models, the performance of tool-enhanced models is significantly improved.
arXiv Detail & Related papers (2023-07-31T20:35:00Z) - Beyond Duplicates: Towards Understanding and Predicting Link Types in
Issue Tracking Systems [8.916420423563478]
We studied 607,208 links connecting 698,790 issues in 15 public repositories.
General Relation links have a significantly higher transitivity score than Duplication and Temporal / Causal links.
arXiv Detail & Related papers (2022-04-27T12:57:12Z) - Sketch and Refine: Towards Faithful and Informative Table-to-Text
Generation [58.320248632121476]
We propose a novel two-stage method that combines both Autoregressive and Non-Autoregressive generations (SANA)
Our approach includes: (1) skeleton generation with an autoregressive pointer network to select key tokens from the source table; (2) edit-based non-autoregressive generation model to produce texts via iterative insertion and deletion operations.
By integrating hard constraints from the skeleton, the non-autoregressive model improves the generation's coverage over the source table and thus enhances its faithfulness.
arXiv Detail & Related papers (2021-05-31T08:18:13Z) - Predicting Links on Wikipedia with Anchor Text Information [0.571097144710995]
We study the transductive and the inductive tasks of link prediction on several subsets of the English Wikipedia.
We propose an appropriate evaluation sampling methodology and compare several algorithms.
arXiv Detail & Related papers (2021-05-25T07:57:57Z) - Automated Mapping of Vulnerability Advisories onto their Fix Commits in
Open Source Repositories [7.629717457706326]
We present an approach that combines practical experience and machine-learning (ML)
An advisory record containing key information about a vulnerability is extracted from an advisory.
A subset of candidate fix commits is obtained from the source code repository of the affected project.
arXiv Detail & Related papers (2021-03-24T17:50:35Z) - Conditioned Text Generation with Transfer for Closed-Domain Dialogue
Systems [65.48663492703557]
We show how to optimally train and control the generation of intent-specific sentences using a conditional variational autoencoder.
We introduce a new protocol called query transfer that allows to leverage a large unlabelled dataset.
arXiv Detail & Related papers (2020-11-03T14:06:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.