Real-time News Story Identification

• URL: http://arxiv.org/abs/2508.08272v1
• Date: Wed, 30 Jul 2025 16:21:00 GMT
• Title: Real-time News Story Identification
• Authors: Tadej Škvorc, Nikola Ivačič, Sebastjan Hribar, Marko Robnik-Šikonja,
• Abstract summary: We present an approach for implementing real-time story identification for a news monitoring system.<n>Story identification aims to assign each news article to a specific story that the article is covering.<n>We combine text representation techniques, clustering algorithms, and online topic modeling methods.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: To improve the reading experience, many news sites organize news into topical collections, called stories. In this work, we present an approach for implementing real-time story identification for a news monitoring system that automatically collects news articles as they appear online and processes them in various ways. Story identification aims to assign each news article to a specific story that the article is covering. The process is similar to text clustering and topic modeling, but requires that articles be grouped based on particular events, places, and people, rather than general text similarity (as in clustering) or general (predefined) topics (as in topic modeling). We present an approach to story identification that is capable of functioning in real time, assigning articles to stories as they are published online. In the proposed approach, we combine text representation techniques, clustering algorithms, and online topic modeling methods. We combine various text representation methods to extract specific events and named entities necessary for story identification, showing that a mixture of online topic-modeling approaches such as BERTopic, DBStream, and TextClust can be adapted for story discovery. We evaluate our approach on a news dataset from Slovene media covering a period of 1 month. We show that our real-time approach produces sensible results as judged by human evaluators.

Related papers

• DiscoSum: Discourse-aware News Summarization [79.4884227574627]
  We introduce a novel approach to integrating discourse structure into summarization processes.<n>We present a novel summarization dataset where news articles are summarized multiple times in different ways across different social media platforms.<n>We develop a novel news discourse schema to describe summarization structures and a novel algorithm, DiscoSum, which employs beam search technique for structure-aware summarization.
  arXiv  Detail & Related papers  (2025-06-07T22:00:30Z)
• A Novel Method for News Article Event-Based Embedding [8.183446952097528]
  We propose a novel lightweight method that optimized news embedding generation by focusing on entities and themes mentioned in articles. We leveraged over 850,000 news articles and 1,000,000 events from the GDELT project to test and evaluate our method. Our experiments demonstrate that our approach can both improve and outperform state-of-the-art methods on shared event detection tasks.
  arXiv  Detail & Related papers  (2024-05-20T20:55:07Z)
• TARN-VIST: Topic Aware Reinforcement Network for Visual Storytelling [14.15543866199545]
  As a cross-modal task, visual storytelling aims to generate a story for an ordered image sequence automatically. We propose a novel method, Topic Aware Reinforcement Network for VIsual StoryTelling (TARN-VIST) In particular, we pre-extracted the topic information of stories from both visual and linguistic perspectives.
  arXiv  Detail & Related papers  (2024-03-18T08:01:23Z)
• SCStory: Self-supervised and Continual Online Story Discovery [53.72745249384159]
  SCStory helps people digest rapidly published news article streams in real-time without human annotations. SCStory employs self-supervised and continual learning with a novel idea of story-indicative adaptive modeling of news article streams.
  arXiv  Detail & Related papers  (2023-11-27T04:50:01Z)
• Text-Only Training for Visual Storytelling [107.19873669536523]
  We formulate visual storytelling as a visual-conditioned story generation problem. We propose a text-only training method that separates the learning of cross-modality alignment and story generation.
  arXiv  Detail & Related papers  (2023-08-17T09:32:17Z)
• Unsupervised Story Discovery from Continuous News Streams via Scalable Thematic Embedding [37.62597275581973]
  Unsupervised discovery of stories with correlated news articles in real-time helps people digest massive news streams without expensive human annotations. We propose a novel thematic embedding with an off-the-shelf pretrained sentence encoder to dynamically represent articles and stories. A thorough evaluation with real news data sets demonstrates that USTORY achieves higher story discovery performances than baselines.
  arXiv  Detail & Related papers  (2023-04-08T20:41:15Z)
• Focus! Relevant and Sufficient Context Selection for News Image Captioning [69.36678144800936]
  News Image Captioning requires describing an image by leveraging additional context from a news article. We propose to use the pre-trained vision and language retrieval model CLIP to localize the visually grounded entities in the news article. Our experiments demonstrate that by simply selecting a better context from the article, we can significantly improve the performance of existing models.
  arXiv  Detail & Related papers  (2022-12-01T20:00:27Z)
• Cue Me In: Content-Inducing Approaches to Interactive Story Generation [74.09575609958743]
  We focus on the task of interactive story generation, where the user provides the model mid-level sentence abstractions. We present two content-inducing approaches to effectively incorporate this additional information. Experimental results from both automatic and human evaluations show that these methods produce more topically coherent and personalized stories.
  arXiv  Detail & Related papers  (2020-10-20T00:36:15Z)
• Multi-View Sequence-to-Sequence Models with Conversational Structure for Abstractive Dialogue Summarization [72.54873655114844]
  Text summarization is one of the most challenging and interesting problems in NLP. This work proposes a multi-view sequence-to-sequence model by first extracting conversational structures of unstructured daily chats from different views to represent conversations. Experiments on a large-scale dialogue summarization corpus demonstrated that our methods significantly outperformed previous state-of-the-art models via both automatic evaluations and human judgment.
  arXiv  Detail & Related papers  (2020-10-04T20:12:44Z)
• Generating Representative Headlines for News Stories [31.67864779497127]
  Grouping articles that are reporting the same event into news stories is a common way of assisting readers in their news consumption. It remains a challenging research problem to efficiently and effectively generate a representative headline for each story. We develop a distant supervision approach to train large-scale generation models without any human annotation.
  arXiv  Detail & Related papers  (2020-01-26T02:08:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.