HistLens: Mapping Idea Change across Concepts and Corpora

• URL: http://arxiv.org/abs/2604.11749v1
• Date: Mon, 13 Apr 2026 17:22:02 GMT
• Title: HistLens: Mapping Idea Change across Concepts and Corpora
• Abstract summary: HistLens is a unified, SAE-based framework for multi-concept, multi-corpus conceptual-history analysis.<n>We show that HistLens supports cross-concept, cross-corpus of patterns of idea evolution and enables implicit concept computation.
• Score: 23.935379969646394
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Language change both reflects and shapes social processes, and the semantic evolution of foundational concepts provides a measurable trace of historical and social transformation. Despite recent advances in diachronic semantics and discourse analysis, existing computational approaches often (i) concentrate on a single concept or a single corpus, making findings difficult to compare across heterogeneous sources, and (ii) remain confined to surface lexical evidence, offering insufficient computational and interpretive granularity when concepts are expressed implicitly. We propose HistLens, a unified, SAE-based framework for multi-concept, multi-corpus conceptual-history analysis. The framework decomposes concept representations into interpretable features and tracks their activation dynamics over time and across sources, yielding comparable conceptual trajectories within a shared coordinate system. Experiments on long-span press corpora show that HistLens supports cross-concept, cross-corpus computation of patterns of idea evolution and enables implicit concept computation. By bridging conceptual modeling with interpretive needs, HistLens broadens the analytical perspectives and methodological repertoire available to social science and the humanities for diachronic text analysis.

Related papers

• A Geometric View for Understanding Concept Learning and Neuron Interpretation in Sparse Autoencoders [17.913861279194663]
  We formalize concepts as sets of data points and cast concept learning as a set-alignment problem between human-defined and model-induced concepts.<n>This formulation distinguishes three increasingly strong notions of learning -- detection, separation, and approximation.<n>It also yields geometric conditions, error bounds, and capacity constraints for when concepts can be represented by individual neurons or multi-neuron units.
  arXiv  Detail & Related papers  (2026-06-05T07:52:43Z)
• ConceptSeg-R1: Segment Any Concept via Meta-Reinforcement Learning [134.61875033137514]
  Recent progress in promptable segmentation has shifted visual perception from object-level localization toward concept-level understanding.<n>We formalize concept segmentation through a three-level taxonomy consisting of context-independent (CI), context-dependent (CD), and context-reasoning (CR) concepts.<n>We propose ConceptSeg-R1, a unified framework that reformulates concept segmentation as rule-induced concept grounding.
  arXiv  Detail & Related papers  (2026-05-19T18:35:38Z)
• Concept frustration: Aligning human concepts and machine representations [39.50576817657001]
  We introduce a framework for comparing supervised human concepts with unsupervised intermediate representations extracted from foundation model embeddings.<n>Motivated by the role of conceptual leaps in scientific discovery, we formalise the notion of concept frustration.<n>We develop task-aligned similarity measures that detect concept frustration between supervised concept-based models and unsupervised representations.
  arXiv  Detail & Related papers  (2026-03-31T12:17:21Z)
• Abstract Concept Modelling in Conceptual Spaces: A Study on Chess Strategies [0.3093890460224435]
  We present a conceptual space framework for modelling abstract concepts that unfold over time, demonstrated through a chess-based proof-of-concept.<n>Strategy concepts, such as attack or sacrifice, are represented as geometric regions across interpretable quality dimensions.<n>This approach also supports dual-perspective modelling, capturing how players interpret identical situations differently.
  arXiv  Detail & Related papers  (2026-01-29T14:22:43Z)
• Concept Component Analysis: A Principled Approach for Concept Extraction in LLMs [51.378834857406325]
  Mechanistic interpretability seeks to mitigate the issues through extracts from large language models.<n>Sparse autoencoders (SAEs) have emerged as a popular approach for extracting interpretable and monosemantic concepts.<n>We show that SAEs suffer from a fundamental theoretical ambiguity: the well-defined correspondence between LLM representations and human-interpretable concepts remains unclear.
  arXiv  Detail & Related papers  (2026-01-28T09:27:05Z)
• A Geometric Unification of Concept Learning with Concept Cones [58.70836885177496]
  Two traditions of interpretability have evolved side by side but seldom spoken to each other: Concept Bottleneck Models (CBMs) and Sparse Autoencoders (SAEs)<n>We show that both paradigms instantiate the same geometric structure.<n>CBMs provide human-defined reference geometries, while SAEs can be evaluated by how well their learned cones approximate or contain those of CBMs.
  arXiv  Detail & Related papers  (2025-12-08T09:51:46Z)
• FaCT: Faithful Concept Traces for Explaining Neural Network Decisions [56.796533084868884]
  Deep networks have shown remarkable performance across a wide range of tasks, yet getting a global concept-level understanding of how they function remains a key challenge.<n>We put emphasis on the faithfulness of concept-based explanations and propose a new model with model-inherent mechanistic concept-explanations.<n>Our concepts are shared across classes and, from any layer, their contribution to the logit and their input-visualization can be faithfully traced.
  arXiv  Detail & Related papers  (2025-10-29T13:35:46Z)
• Analyzing Latent Concepts in Code Language Models [10.214183897113118]
  We propose Code Concept Analysis (CoCoA): a global post-hoc interpretability framework.<n>CoCoA uncovers emergent lexical, syntactic, and semantic structures in a code language model's representation space.<n>We propose a hybrid annotation pipeline that combines static analysis tool-based syntactic alignment with prompt-engineered large language models.
  arXiv  Detail & Related papers  (2025-10-01T03:53:21Z)
• MindCraft: How Concept Trees Take Shape In Deep Models [15.113541622429084]
  We introduce the MindCraft framework built upon Concept Trees.<n> Concept Trees reconstruct the hierarchical emergence of concepts, revealing exactly when they diverge from shared representations into linearly separable subspaces.<n> Empirical evaluations show that Concept Trees recover semantic hierarchies, disentangle latent concepts, and can be widely applied across multiple domains.
  arXiv  Detail & Related papers  (2025-09-26T20:39:52Z)
• Revealing emergent human-like conceptual representations from language prediction [90.73285317321312]
  Large language models (LLMs) trained solely through next-token prediction on text exhibit strikingly human-like behaviors.<n>Are these models developing concepts akin to those of humans?<n>We found that LLMs can flexibly derive concepts from linguistic descriptions in relation to contextual cues about other concepts.
  arXiv  Detail & Related papers  (2025-01-21T23:54:17Z)
• Analyzing Encoded Concepts in Transformer Language Models [21.76062029833023]
  ConceptX analyses how latent concepts are encoded in representations learned within pre-trained language models. It uses clustering to discover the encoded concepts and explains them by aligning with a large set of human-defined concepts.
  arXiv  Detail & Related papers  (2022-06-27T13:32:10Z)
• Concept Learners for Few-Shot Learning [76.08585517480807]
  We propose COMET, a meta-learning method that improves generalization ability by learning to learn along human-interpretable concept dimensions. We evaluate our model on few-shot tasks from diverse domains, including fine-grained image classification, document categorization and cell type annotation.
  arXiv  Detail & Related papers  (2020-07-14T22:04:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.