Beyond Via: Analysis and Estimation of the Impact of Large Language Models in Academic Papers

• URL: http://arxiv.org/abs/2603.25638v2
• Date: Thu, 02 Apr 2026 17:45:24 GMT
• Title: Beyond Via: Analysis and Estimation of the Impact of Large Language Models in Academic Papers
• Abstract summary: We report several shifts in word usage that are likely driven by large language models (LLMs)<n>Experiments show that current classifiers struggle to accurately determine which specific model generated a given text in multi-class classification tasks.
• Score: 10.297544444218685
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Through an analysis of arXiv papers, we report several shifts in word usage that are likely driven by large language models (LLMs) but have not previously received sufficient attention, such as the increased frequency of "beyond" and "via" in titles and the decreased frequency of "the" and "of" in abstracts. Due to the similarities among different LLMs, experiments show that current classifiers struggle to accurately determine which specific model generated a given text in multi-class classification tasks. Meanwhile, variations across LLMs also result in evolving patterns of word usage in academic papers. By adopting a direct and highly interpretable linear approach and accounting for differences between models and prompts, we quantitatively assess these effects and show that real-world LLM usage is heterogeneous and dynamic.

Related papers

• On the Persistent Effects of Lexicality in Large Language Models [19.762746965467635]
  We quantify the effect of lexical overlap relative to semantic content in large language models (LLMs)<n>We find that lexical influence extends across the depth of models, consistently across architectures, training regimes, and objective functions.<n>We observe a mid-depth region in which both lexical and semantic signals degrade simultaneously, indicating a transitional regime where representations are poor for both surface form and meaning.
  arXiv  Detail & Related papers  (2026-06-01T18:15:45Z)
• How Do LLM-Generated Texts Impact Term-Based Retrieval Models? [76.92519309816008]
  This paper investigates the influence of large language models (LLMs) on term-based retrieval models.<n>Our linguistic analysis reveals that LLM-generated texts exhibit smoother high-frequency and steeper low-frequency Zipf slopes.<n>Our study further explores whether term-based retrieval models demonstrate source bias, concluding that these models prioritize documents whose term distributions closely correspond to those of the queries.
  arXiv  Detail & Related papers  (2025-08-25T06:43:27Z)
• Revisiting Word Embeddings in the LLM Era [0.2999888908665658]
  Large Language Models (LLMs) have recently shown remarkable advancement in various NLP tasks.<n>We compare classical decontextualized and contextualized word embeddings with the same for LLM-induced embeddings.<n>Our results show that LLMs cluster semantically related words more tightly and perform better on analogy tasks in decontextualized settings.
  arXiv  Detail & Related papers  (2025-02-26T22:45:08Z)
• ExpliCa: Evaluating Explicit Causal Reasoning in Large Language Models [75.05436691700572]
  We introduce ExpliCa, a new dataset for evaluating Large Language Models (LLMs) in explicit causal reasoning.<n>We tested seven commercial and open-source LLMs on ExpliCa through prompting and perplexity-based metrics.<n>Surprisingly, models tend to confound temporal relations with causal ones, and their performance is also strongly influenced by the linguistic order of the events.
  arXiv  Detail & Related papers  (2025-02-21T14:23:14Z)
• Human-LLM Coevolution: Evidence from Academic Writing [0.0]
  We report a marked drop in the frequency of several words previously identified as overused by ChatGPT, such as "delve"<n>The frequency of certain other words favored by ChatGPT, such as "significant", has instead kept increasing.
  arXiv  Detail & Related papers  (2025-02-13T18:55:56Z)
• PoLLMgraph: Unraveling Hallucinations in Large Language Models via State Transition Dynamics [51.17512229589]
  PoLLMgraph is a model-based white-box detection and forecasting approach for large language models. We show that hallucination can be effectively detected by analyzing the LLM's internal state transition dynamics. Our work paves a new way for model-based white-box analysis of LLMs, motivating the research community to further explore, understand, and refine the intricate dynamics of LLM behaviors.
  arXiv  Detail & Related papers  (2024-04-06T20:02:20Z)
• Revisiting Word Embeddings in the LLM Era [5.122866382023337]
  Large Language Models (LLMs) have recently shown remarkable advancement in various NLP tasks.<n>We compare classical decontextualized and contextualized word embeddings with the same for LLM-induced embeddings.<n>Our results show that LLMs cluster semantically related words more tightly and perform better on analogy tasks in decontextualized settings.
  arXiv  Detail & Related papers  (2024-02-16T21:47:30Z)
• Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context Learning [104.58874584354787]
  In recent years, pre-trained large language models (LLMs) have demonstrated remarkable efficiency in achieving an inference-time few-shot learning capability known as in-context learning. This study aims to examine the in-context learning phenomenon through a Bayesian lens, viewing real-world LLMs as latent variable models.
  arXiv  Detail & Related papers  (2023-01-27T18:59:01Z)
• Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledge [59.22170796793179]
  Transformers Language Models (TLMs) were tested on a benchmark for the textitdynamic estimation of thematic fit Our results show that TLMs can reach performances that are comparable to those achieved by SDM. However, additional analysis consistently suggests that TLMs do not capture important aspects of event knowledge.
  arXiv  Detail & Related papers  (2021-07-22T20:52:26Z)
• A Comparative Study of Lexical Substitution Approaches based on Neural Language Models [117.96628873753123]
  We present a large-scale comparative study of popular neural language and masked language models. We show that already competitive results achieved by SOTA LMs/MLMs can be further improved if information about the target word is injected properly.
  arXiv  Detail & Related papers  (2020-05-29T18:43:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.