Semantic Novelty at Scale: Narrative Shape Taxonomy and Readership Prediction in 28,606 Books

• URL: http://arxiv.org/abs/2602.20647v1
• Date: Tue, 24 Feb 2026 07:52:35 GMT
• Title: Semantic Novelty at Scale: Narrative Shape Taxonomy and Readership Prediction in 28,606 Books
• Abstract summary: I introduce semantic novelty--cosine distance between each paragraph's sentence embedding and the running centroid of all preceding paragraphs--as an information-theoretic measure of narrative structure at corpus scale.<n>Applying it to 28,606 books in PG19 (pre-1920 English literature), I compute paragraph-level novelty curves using 768-dimensional SBERT embeddings, then reduce each to a 16-segment Piecewise Aggregate Approximation (PAA)<n>Ward-linkage clustering on PAA vectors reveals eight canonical narrative shape archetypes, from Steep Descent (rapid convergence) to Steep Ascent (escalating unpredictability)
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: I introduce semantic novelty--cosine distance between each paragraph's sentence embedding and the running centroid of all preceding paragraphs--as an information-theoretic measure of narrative structure at corpus scale. Applying it to 28,606 books in PG19 (pre-1920 English literature), I compute paragraph-level novelty curves using 768-dimensional SBERT embeddings, then reduce each to a 16-segment Piecewise Aggregate Approximation (PAA). Ward-linkage clustering on PAA vectors reveals eight canonical narrative shape archetypes, from Steep Descent (rapid convergence) to Steep Ascent (escalating unpredictability). Volume--variance of the novelty trajectory--is the strongest length-independent predictor of readership (partial rho = 0.32), followed by speed (rho = 0.19) and Terminal/Initial ratio (rho = 0.19). Circuitousness shows strong raw correlation (rho = 0.41) but is 93 percent correlated with length; after control, partial rho drops to 0.11--demonstrating that naive correlations in corpus studies can be dominated by length confounds. Genre strongly constrains narrative shape (chi squared = 2121.6, p < 10 to the power negative 242), with fiction maintaining plateau profiles while nonfiction front-loads information. Historical analysis shows books became progressively more predictable between 1840 and 1910 (T/I ratio trend r = negative 0.74, p = 0.037). SAX analysis reveals 85 percent signature uniqueness, suggesting each book traces a nearly unique path through semantic space. These findings demonstrate that information-density dynamics, distinct from sentiment or topic, constitute a fundamental dimension of narrative structure with measurable consequences for reader engagement. Dataset: https://huggingface.co/datasets/wfzimmerman/pg19-semantic-novelty

Related papers

• Flesch-Kincaid Readability Depends Only on the Topic Distribution in Long Texts under Topic Models [0.0]
  Flesch Reading Ease (FRE) and the Flesch-Kincaid Grade Level (FKGL) are widely used readability scores for English computed from the same two document statistics.<n>Under a topic model with an explicit sentence-boundary token, both scores converge almost surely to deterministic functions of the document topic distribution.<n>All score variation is mediated by topical composition rather than any residual readability signal.
  arXiv  Detail & Related papers  (2026-08-24T14:41:06Z)
• PHASE-Tree: Modeling Character-State Evolution in Long-Horizon Role-Playing Dialogue [37.64180837016861]
  PHASE-Tree is a multi-timescale character-state tree with an immutable identity root and mutable persona, session, and moment layers.<n>It conditions generation through explicit textual provision or implicit parametric adaptation.<n>On the long-dialogue core, PHASE-Tree ranks first in 11 of 12 dataset-metric cells against internal variants and all 12 cells against external textual baselines.
  arXiv  Detail & Related papers  (2026-08-07T08:50:14Z)
• ATLAS: All-round Testing of Long-context Abilities across Scales [42.83200405769639]
  ATLAS is a benchmarking framework that redefines long-context evaluation as length-dependent capability profiling.<n> ATLAS contributes three methodological principles: (i) a layered taxonomy separating foundational operations from application workloads so failures can be attributed, (ii) length-aware AUC scoring that integrates score-length curves over a fixed 8K-1M grid, replacing single-point metrics with full degradation profiles, and (iii) ATLAScore, a harmonic-mean aggregate over taxonomy categories that penalizes imbalanced profiles.
  arXiv  Detail & Related papers  (2026-05-27T07:33:47Z)
• Amplifying, Not Learning: Fine-Tuned AI Text Detectors Amplify a Pretrained Direction [51.56484100374058]
  Text detectors amplify a pretrained typicality axis; they do not construct an AI-vs-human boundary.<n>On raw encoders before any task supervision, projecting onto centroid(AI)-centroid(HC3) achieves NYT-vs-HC3 AUROC 0.806/0.944/0.834 across three architectures.<n>On RoBERTa-base, raw projection exceeds fine-tuning; on RoBERTa-base, full fine-tuning reduces discrimination below raw on both fluent-formal populations tested.
  arXiv  Detail & Related papers  (2026-05-20T19:08:38Z)
• Embeddings for Preferences, Not Semantics [42.35314862635723]
  Modern AI is opening the door to collective decision-making in which participants express their views as free-form text.<n>Standard text embeddings measure semantic similarity, whereas distances in facility location problems and fair clustering require what we call textitpreferential similarity<n>We show that synthetic training data designed to break this correlation provably shifts the optimal scorer away from nuisance-dominated cosine and significantly improves preference prediction across 11 online deliberation datasets.
  arXiv  Detail & Related papers  (2026-05-08T18:15:14Z)
• Do BERT Embeddings Encode Narrative Dimensions? A Token-Level Probing Analysis of Time, Space, Causality, and Character in Fiction [2.9769545727805813]
  This study investigates whether BERT embeddings encode dimensions of fictional narrative semantics.<n>A linear probe on BERT embeddings significantly outperforms a control probe on variance-matched random embeddings.
  arXiv  Detail & Related papers  (2026-04-12T19:23:48Z)
• Semantic Novelty Trajectories in 80,000 Books: A Cross-Corpus Embedding Analysis [0.0]
  I analyze semantic novelty trajectories in more than 80,000 books spanning two centuries of English-language publishing.<n> mean paragraph-level novelty is roughly 10% higher in modern books.<n> convergent narrative curves, in which novelty declines toward a settled semantic register, are 2.3x more common in pre-1920 literature.
  arXiv  Detail & Related papers  (2026-03-02T12:20:24Z)
• Surprisal and Metaphor Novelty: Moderate Correlations and Divergent Scaling Effects [9.85813493536013]
  This study investigates whether surprisal, a probabilistic measure of predictability in language models, correlates with metaphor novelty datasets.<n>We analyse surprisal from 16 LM variants on corpus-based and synthetic metaphor novelty datasets.
  arXiv  Detail & Related papers  (2026-01-05T11:24:33Z)
• Context-Aware Hierarchical Merging for Long Document Summarization [56.96619074316232]
  We propose different approaches to enrich hierarchical merging with context from the source document.<n> Experimental results on datasets representing legal and narrative domains show that contextual augmentation consistently outperforms zero-shot and hierarchical merging baselines.
  arXiv  Detail & Related papers  (2025-02-03T01:14:31Z)
• Understanding writing style in social media with a supervised contrastively pre-trained transformer [57.48690310135374]
  Online Social Networks serve as fertile ground for harmful behavior, ranging from hate speech to the dissemination of disinformation. We introduce the Style Transformer for Authorship Representations (STAR), trained on a large corpus derived from public sources of 4.5 x 106 authored texts. Using a support base of 8 documents of 512 tokens, we can discern authors from sets of up to 1616 authors with at least 80% accuracy.
  arXiv  Detail & Related papers  (2023-10-17T09:01:17Z)
• A multiple k-means cluster ensemble framework for clustering citation trajectories [0.11951741880981505]
  This paper proposes a feature based multiple k means cluster ensemble framework. 1,95,783 and 41,732 well cited articles from the Microsoft Academic Graph data are considered. Individual trajectory differences for two different spans are studied.
  arXiv  Detail & Related papers  (2023-09-10T07:10:31Z)
• Understanding and Mitigating Spurious Correlations in Text Classification with Neighborhood Analysis [69.07674653828565]
  Machine learning models have a tendency to leverage spurious correlations that exist in the training set but may not hold true in general circumstances. In this paper, we examine the implications of spurious correlations through a novel perspective called neighborhood analysis. We propose a family of regularization methods, NFL (doN't Forget your Language) to mitigate spurious correlations in text classification.
  arXiv  Detail & Related papers  (2023-05-23T03:55:50Z)
• The distribution of syntactic dependency distances [0.13812010983144798]
  We contribute to the characterization of the actual distribution of syntactic dependency distances.<n>We propose a new model with two exponential regimes in which the probability decay is allowed to change after a break-point.<n>We find that a two-regime model is the most likely one in all 20 languages we considered, independently of sentence length and annotation style.
  arXiv  Detail & Related papers  (2022-11-26T17:31:25Z)
• A decomposition of book structure through ousiometric fluctuations in cumulative word-time [1.181206257787103]
  We look at how words change over the course of a book as a function of the number of words, rather than the fraction of the book. We find that shorter books exhibit only a general trend, while longer books have fluctuations in addition to the general trend. Our findings suggest that, in the ousiometric sense, longer books are not expanded versions of shorter books, but are more similar in structure to a concatenation of shorter texts.
  arXiv  Detail & Related papers  (2022-08-19T18:17:27Z)
• DisenHCN: Disentangled Hypergraph Convolutional Networks for Spatiotemporal Activity Prediction [53.76601630407521]
  We propose a hypergraph network model called DisenHCN to bridge the gaps in existing solutions. In particular, we first unify fine-grained user similarity and the complex matching between user preferences andtemporal activity into a heterogeneous hypergraph. We then disentangle the user representations into different aspects (location-aware, time-aware, and activity-aware) and aggregate corresponding aspect's features on the constructed hypergraph.
  arXiv  Detail & Related papers  (2022-08-14T06:51:54Z)
• Relation Clustering in Narrative Knowledge Graphs [71.98234178455398]
  relational sentences in the original text are embedded (with SBERT) and clustered in order to merge together semantically similar relations. Preliminary tests show that such clustering might successfully detect similar relations, and provide a valuable preprocessing for semi-supervised approaches.
  arXiv  Detail & Related papers  (2020-11-27T10:43:04Z)
• Paragraph-level Commonsense Transformers with Recurrent Memory [77.4133779538797]
  We train a discourse-aware model that incorporates paragraph-level information to generate coherent commonsense inferences from narratives. Our results show that PARA-COMET outperforms the sentence-level baselines, particularly in generating inferences that are both coherent and novel.
  arXiv  Detail & Related papers  (2020-10-04T05:24:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.