[not Rp] Reproducibility of 'Poincare dodecahedral space parameter estimates'

• URL: http://arxiv.org/abs/2008.07380v1
• Date: Thu, 23 Jul 2020 21:56:21 GMT
• Title: [not Rp] Reproducibility of 'Poincare dodecahedral space parameter estimates'
• Abstract summary: This paper attempts to reproduce a cosmic topology observational paper published in 2008. The reproduction steps are defined formally in a free-licensed git repository package "0807.4260"
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Is a scientific research paper based on (i) public, online observational data files and (ii) providing free-licensed software for reproducing its results easy to reproduce by the same author a decade later? This paper attempts to reproduce a cosmic topology observational paper published in 2008 and satisfying both criteria (i) and (ii). The reproduction steps are defined formally in a free-licensed git repository package "0807.4260" and qualitatively in the current paper. It was found that the effort in upgrading the Fortran 77 code at the heart of the software, interfaced with a C front end, and originally compiled with g77, in the content of the contemporary gfortran compiler, risked being too great to be justified on any short time scale. In this sense, the results of RBG08 are not as reproducible as they appeared to be, despite both (i) data availability and (ii) free-licensing and public availability of the software. The software and a script to reproduce the steps of this incomplete reproduction are combined in a new git repository named 0807.4260, following the ArXiv identity code (arXiv:0807.4260) of RBG08.

Related papers

• DeepRepro: State-Aware Subplanning for Paper-to-Code Reproduction in Evolving Repositories [116.27249583403871]
  We propose a state-aware framework for paper-to-code reproduction based on execution-state-aware subplanning.<n>DeepRepro transforms evolving repository states and runtime feedback into fine-grained implementation subplans.<n>Experiments on PaperBench Code-Dev show that DeepRepro consistently outperforms strong scientific and commercial code-agent baselines.
  arXiv  Detail & Related papers  (2026-08-27T02:54:30Z)
• ReproRepo: Scaling Reproducibility Audits with GitHub Repository Issues [54.98461672730087]
  We introduce ReproRepo, a scalable framework for evaluation that leverages human-raised GitHub issues as naturally occurring supervision on realistic reproduction blockers.<n>We instantiate ReproRepo on 1,149 recent machine learning papers from major conferences and evaluate four frontier model-agent configurations.<n>Our results show that LLM agents, even without executing code, can identify many real-world problems from paper-repository pairs.
  arXiv  Detail & Related papers  (2026-06-16T17:58:05Z)
• AI Coding Agents Can Reproduce Social Science Findings [5.410553210073652]
  Recent evidence suggests that AI coding agents can reproduce published findings when provided with original data and code.<n>We introduce SocSci-Repro-Bench, a benchmark of 221 tasks spanning four disciplines and 13 substantive domains.<n>We find that both can reproduce a large share of social science findings, with Claude Code substantially outperforming Codex.
  arXiv  Detail & Related papers  (2026-06-09T21:00:05Z)
• NERFIFY: A Multi-Agent Framework for Turning NeRF Papers into Code [49.610331036334316]
  We introduce NERFIFY, a framework that reliably converts NeRF research papers into trainable Nerfstudio plugins.<n>Code, data and implementations will be publicly released.
  arXiv  Detail & Related papers  (2026-02-28T20:57:32Z)
• Assessing Reproducibility in Evolutionary Computation: A Case Study using Human- and LLM-based Assessment [2.0365636651755263]
  We study the practices in papers published in the Combinatorial Optimization and Metaheuristics track of the Evolutionary Computation Conference over a ten-year period.<n>We introduce a structured checklist and apply it through a systematic manual assessment of the selected corpus.<n>In addition, we propose RECAP (REproducibility Checklist Automation Pipeline), an automated system that automatically evaluates signals from paper text and associated code.
  arXiv  Detail & Related papers  (2026-02-05T08:32:29Z)
• SciCoQA: Quality Assurance for Scientific Paper--Code Alignment [53.70401063640645]
  We present SciCoQA, a dataset for detecting discrepancies between scientific publications and theirs.<n>Our dataset consists of 611 paper-code discrepancies (81 real, 530 synthetic), spanning diverse computational science disciplines.<n>The best performing model in our evaluation, GPT-5, can only detect 45.7% of real-world paper-code discrepancies.
  arXiv  Detail & Related papers  (2026-01-19T10:04:33Z)
• A Retrieval-Augmented Generation Approach to Extracting Algorithmic Logic from Neural Networks [48.83701310501069]
  We introduce NN-RAG, a retrieval-augmented generation system that converts large, heterogeneous PyTorchs into a searchable library of validated neural modules.<n>Applying to 19 major repositories, the pipeline extracted 1,289 candidate blocks, validated 941 (73.0%), and demonstrated that over 80% are structurally unique.
  arXiv  Detail & Related papers  (2025-12-03T23:28:30Z)
• Large Language Models for Software Engineering: A Reproducibility Crisis [4.730658148470817]
  This paper presents the first large-scale, empirical study of practices in large language model (LLM)-based software engineering research.<n>We systematically mined and analyzed 640 papers published between 2017 and 2025 across premier software engineering, machine learning, and natural language processing venues.<n>Our analysis reveals persistent gaps in artifact availability, environment specification, versioning rigor, and documentation clarity.
  arXiv  Detail & Related papers  (2025-11-29T22:16:47Z)
• An Empirical Study on the Amount of Changes Required for Merge Request Acceptance [2.5999037208435705]
  Up to 71% of GitLab Requests require adjustments after submission, and 28% involve changes to more than 200 lines of code.<n>We train an interpretable machine learning model using metrics across multiple dimensions: text features, code complexity, developer experience, review history, and branching.<n>Our model achieves strong performance (AUC 0.84-0.88) and reveals that complexity, experience, and text features are key predictors.
  arXiv  Detail & Related papers  (2025-07-31T15:18:46Z)
• Computational Reproducibility of R Code Supplements on OSF [0.0]
  Many published code supplements lack the necessary documentation to recreate their computational environments.<n>In this work, we assess the computational of 296 R projects using the StatCodeSearch dataset.<n>We developed an automated pipeline that reconstructs computational environments directly from project source code.
  arXiv  Detail & Related papers  (2025-05-27T13:06:38Z)
• AutoReproduce: Automatic AI Experiment Reproduction with Paper Lineage [62.049868205196425]
  AutoReproduce is a framework capable of automatically reproducing experiments described in research papers in an end-to-end manner.<n>Results show that AutoReproduce achieves an average performance gap of $22.1%$ on $89.74%$ of the executable experiment runs.
  arXiv  Detail & Related papers  (2025-05-27T03:15:21Z)
• Paper2Code: Automating Code Generation from Scientific Papers in Machine Learning [57.09163579304332]
  We introduce PaperCoder, a framework that transforms machine learning papers into functional code repositories. PaperCoder operates in three stages: planning, designs the system architecture with diagrams, identifies file dependencies, and generates configuration files. We then evaluate PaperCoder on generating code implementations from machine learning papers based on both model-based and human evaluations.
  arXiv  Detail & Related papers  (2025-04-24T01:57:01Z)
• CodeRAG-Bench: Can Retrieval Augment Code Generation? [78.37076502395699]
  We conduct a systematic, large-scale analysis of code generation using retrieval-augmented generation. We first curate a comprehensive evaluation benchmark, CodeRAG-Bench, encompassing three categories of code generation tasks. We examine top-performing models on CodeRAG-Bench by providing contexts retrieved from one or multiple sources.
  arXiv  Detail & Related papers  (2024-06-20T16:59:52Z)
• VersiCode: Towards Version-controllable Code Generation [58.82709231906735]
  Large Language Models (LLMs) have made tremendous strides in code generation, but existing research fails to account for the dynamic nature of software development. We propose two novel tasks aimed at bridging this gap: version-specific code completion (VSCC) and version-aware code migration (VACM) We conduct an extensive evaluation on VersiCode, which reveals that version-controllable code generation is indeed a significant challenge.
  arXiv  Detail & Related papers  (2024-06-11T16:15:06Z)
• Investigating Reproducibility in Deep Learning-Based Software Fault Prediction [16.25827159504845]
  With the rapid adoption of increasingly complex machine learning models, it becomes more and more difficult for scholars to reproduce the results that are reported in the literature. This is in particular the case when the applied deep learning models and the evaluation methodology are not properly documented and when code and data are not shared. We have conducted a systematic review of the current literature and examined the level of 56 research articles that were published between 2019 and 2022 in top-tier software engineering conferences.
  arXiv  Detail & Related papers  (2024-02-08T13:00:18Z)
• The Software Heritage Open Science Ecosystem [0.0]
  Software Heritage is the largest public archive of software source code and associated development history. It has archived more than 16 billion unique source code files coming from more than 250 million collaborative development projects. It supports empirical research on software by materializing in a single Merkle direct acyclic graph the development history of public code. It ensures availability and guarantees integrity of the source code of software artifacts used in any field that relies on software to conduct experiments.
  arXiv  Detail & Related papers  (2023-10-16T11:32:03Z)
• How do software citation formats evolve over time? A longitudinal analysis of R programming language packages [12.082972614614413]
  This study compares and analyzes a longitudinal dataset of citation formats of all R packages collected in 2021 and 2022. We investigate the different document types underlying the citations and what metadata elements in the citation formats changed over time.
  arXiv  Detail & Related papers  (2023-07-17T09:18:57Z)
• A Study on Reproducibility and Replicability of Table Structure Recognition Methods [3.8366337377024298]
  We examine both and replicability of a corpus of 16 papers on table structure recognition (TSR) We reproduce results consistent with the original in only four of the 16 papers studied. No paper is identified as replicable using the new dataset.
  arXiv  Detail & Related papers  (2023-04-20T16:30:58Z)
• Deconstructing Self-Supervised Monocular Reconstruction: The Design Decisions that Matter [63.5550818034739]
  This paper presents a framework to evaluate state-of-the-art contributions to self-supervised monocular depth estimation. It includes pretraining, backbone, architectural design choices and loss functions. We re-implement, validate and re-evaluate 16 state-of-the-art contributions and introduce a new dataset.
  arXiv  Detail & Related papers  (2022-08-02T14:38:53Z)
• Long-term Reproducibility for Neural Architecture Search [4.301276597844756]
  There is no academic 'kudos' for bug fixes / maintenance. Code is often unavailable or, if available, contains bugs, is incomplete, or relies on out-of-date / unavailable libraries.
  arXiv  Detail & Related papers  (2022-07-11T12:40:26Z)
• Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code [74.28810048824519]
  Repro is an open-source library which aims at improving the usability of research code. It provides a lightweight Python API for running software released by researchers within Docker containers.
  arXiv  Detail & Related papers  (2022-04-29T01:54:54Z)
• FRUIT: Faithfully Reflecting Updated Information in Text [106.40177769765512]
  We introduce the novel generation task of *faithfully reflecting updated information in text*(FRUIT) Our analysis shows that developing models that can update articles faithfully requires new capabilities for neural generation models.
  arXiv  Detail & Related papers  (2021-12-16T05:21:24Z)
• Enhancing Scientific Papers Summarization with Citation Graph [78.65955304229863]
  We redefine the task of scientific papers summarization by utilizing their citation graph. We construct a novel scientific papers summarization dataset Semantic Scholar Network (SSN) which contains 141K research papers in different domains. Our model can achieve competitive performance when compared with the pretrained models.
  arXiv  Detail & Related papers  (2021-04-07T11:13:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.