Machine Learning Research Has Outpaced Its Communication Norms and NeurIPS Should Act

• URL: http://arxiv.org/abs/2605.08889v1
• Date: Sat, 09 May 2026 11:13:21 GMT
• Title: Machine Learning Research Has Outpaced Its Communication Norms and NeurIPS Should Act
• Abstract summary: Machine learning research has grown exponentially while its communication norms have not.<n>We argue NeurIPS should adopt explicit, measurable writing standards.<n>We analyze 2.8 million arXiv papers (1991-2025), 24,772 NeurIPS papers (1987-2024), and 24.5 million PubMed papers (1990-2025)<n>We propose seven standards NeurIPS could pilot at NeurIPS 2027.
• Score: 4.3801110894274
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Machine learning research has grown exponentially while its communication norms have not. We argue NeurIPS should adopt explicit, measurable writing standards. We analyze 2.8 million arXiv papers (1991-2025), 24,772 NeurIPS papers (1987-2024), and 24.5 million PubMed papers (1990-2025), applying classical readability scores, the Hohmann writing style suite (including sensational language), acronym density and reuse, an LLM as judge readability protocol, and citations from OpenAlex and Semantic Scholar. Four patterns emerge. First, NeurIPS abstracts score harder to read on every classical readability metric: Flesch Reading Ease falls from about 24 in 1987 to 13 in 2024, and sensational language rises by about 50 percent in NeurIPS abstracts between 2015 and 2024. Second, acronym density in NeurIPS titles has grown from 0.33 per 100 words in 1987 to 3.21 in 2024, and about 89 percent of NeurIPS acronyms are used fewer than ten times, ten points above the science-wide baseline. Third, more readable NeurIPS papers tend to receive more citations, suggesting readability and impact are correlated and that less readable papers risk remaining fragmented. LLM as judge scores rate NeurIPS abstracts as roughly stable from 1987 to 2022, with early signs of improvement thereafter, a pattern that disagrees with every classical readability metric and raises a design question for enforcement: is the target reader a human or an LLM? Lastly, NeurIPS volume has grown roughly 50-fold between 1987 and 2024. Assuming the goal is to optimise for human readers, we propose seven standards NeurIPS could pilot at NeurIPS 2027: an acronym budget with a venue-approved term list, a human readability threshold, stricter citation standards, standalone visual elements, a plain language summary, a pre-registered acronym glossary, and open source audit tooling.

Related papers

• Testing Our Foundations: Citation Trends, Errors, and Emerging Hallucinations in the Computing Education Literature [3.299067446425981]
  We analyze referencing trends across 24,751 computing education papers and compare them with the broader ACM corpus of more than 723,000 papers and 15 million references.<n>In 2025, hallucinated references appeared across five SIGCSE-sponsored or LLM-cooperation venues.<n>Although still relatively rare for now, this growth poses an integrity risk our community should not ignore.
  arXiv  Detail & Related papers  (2026-09-15T03:18:20Z)
• From Interpretability to Control: Insights from Six Years of the TrustNLP Workshop [63.00693129203923]
  The Workshop on Trustworthy Natural Language Processing has grown from 8 proceedings papers to 41 over six editions.<n>We synthesize insights from all 144 proceedings papers, classifying them along six trust dimensions grounded in established frameworks.<n>Analysis from the classification study reveals that truthfulness is the fastest-growing dimension (absent in 2021-2022, comprising 37% of papers by 2025-2026)
  arXiv  Detail & Related papers  (2026-08-11T17:30:16Z)
• Paper Espresso: From Paper Overload to Research Insight [53.45135239997754]
  We present Paper Espresso, an open-source platform that automatically discovers, summarizes, and analyzes trending arXiv papers.<n>The system uses large language models (LLMs) to generate structured summaries with topical labels and keywords.<n>Over 35 months of continuous deployment, Paper Espresso has processed over 13,300 papers and publicly released all structured metadata.
  arXiv  Detail & Related papers  (2026-04-06T09:45:21Z)
• Rewrite the News: Tracing Editorial Reuse Across News Agencies [2.108916445920616]
  We present a weakly supervised method for detecting sentence-level cross-lingual reuse without requiring full translations.<n>The study compares English-language articles from the Slovenian Press Agency with reports from 15 foreign agencies.<n>Reused content tends to appear in the middle and end of English articles, while leads are more often original.
  arXiv  Detail & Related papers  (2026-03-31T16:10:26Z)
• SciZoom: A Large-scale Benchmark for Hierarchical Scientific Summarization across the LLM Era [2.2090506971647144]
  SciZoom is a benchmark comprising 44,946 papers from four top-tier ML venues spanning 2020 to 2025.<n>Our linguistic analysis reveals striking shifts in phrase patterns (up to 10x for formulaic expressions) and rhetorical style (23% decline in hedging)<n>SciZoom serves as both a challenging benchmark and a unique resource for mining the evolution of scientific discourse in the generative AI era.
  arXiv  Detail & Related papers  (2026-03-17T05:34:46Z)
• Exploring the change in scientific readability following the release of ChatGPT [2.7195102129095003]
  This dataset consists of all abstracts posted on arXiv between 2010 and June 7th, 2024.<n>The results show a steady annual decrease in readability, suggesting that abstracts are likely becoming increasingly complex.<n>Following the release of ChatGPT, a significant change in readability is observed for 2023 and the analyzed months of 2024.
  arXiv  Detail & Related papers  (2025-06-26T23:57:12Z)
• Usefulness of LLMs as an Author Checklist Assistant for Scientific Papers: NeurIPS'24 Experiment [59.09144776166979]
  Large language models (LLMs) represent a promising, but controversial, tool in aiding scientific peer review. This study evaluates the usefulness of LLMs in a conference setting as a tool for vetting paper submissions against submission standards.
  arXiv  Detail & Related papers  (2024-11-05T18:58:00Z)
• Mapping the Increasing Use of LLMs in Scientific Papers [99.67983375899719]
  We conduct the first systematic, large-scale analysis across 950,965 papers published between January 2020 and February 2024 on the arXiv, bioRxiv, and Nature portfolio journals. Our findings reveal a steady increase in LLM usage, with the largest and fastest growth observed in Computer Science papers.
  arXiv  Detail & Related papers  (2024-04-01T17:45:15Z)
• Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews [51.453135368388686]
  We present an approach for estimating the fraction of text in a large corpus which is likely to be substantially modified or produced by a large language model (LLM) Our maximum likelihood model leverages expert-written and AI-generated reference texts to accurately and efficiently examine real-world LLM-use at the corpus level.
  arXiv  Detail & Related papers  (2024-03-11T21:51:39Z)
• Native Language Identification with Large Language Models [60.80452362519818]
  We show that GPT models are proficient at NLI classification, with GPT-4 setting a new performance record of 91.7% on the benchmark11 test set in a zero-shot setting. We also show that unlike previous fully-supervised settings, LLMs can perform NLI without being limited to a set of known classes.
  arXiv  Detail & Related papers  (2023-12-13T00:52:15Z)
• NLLG Quarterly arXiv Report 06/23: What are the most influential current AI Papers? [15.830129136642755]
  The objective is to offer a quick guide to the most relevant and widely discussed research, aiding both newcomers and established researchers in staying abreast of current trends. We observe the dominance of papers related to Large Language Models (LLMs) and specifically ChatGPT during the first half of 2023. NLP related papers are the most influential (around 60% of top papers) even though there are twice as many ML related papers in our data.
  arXiv  Detail & Related papers  (2023-07-31T11:53:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.