Clash of the models: Comparing performance of BERT-based variants for generic news frame detection

• URL: http://arxiv.org/abs/2603.26156v1
• Date: Fri, 27 Mar 2026 08:15:47 GMT
• Title: Clash of the models: Comparing performance of BERT-based variants for generic news frame detection
• Abstract summary: This study comparatively performs generic news frame detection and compares the performance of five BERT-based variants.<n>Second, it introduces various fine-tuned models capable of robustly performing generic news frame detection.<n>Third, it provides the scholarly community with a labelled generic news frames dataset based on the Swiss electoral context.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Framing continues to remain one of the most extensively applied theories in political communication. Developments in computation, particularly with the introduction of transformer architecture and more so with large language models (LLMs), have naturally prompted scholars to explore various novel computational approaches, especially for deductive frame detection, in recent years. While many studies have shown that different transformer models outperform their preceding models that use bag-of-words features, the debate continues to evolve regarding how these models compare with each other on classification tasks. By placing itself at this juncture, this study makes three key contributions: First, it comparatively performs generic news frame detection and compares the performance of five BERT-based variants (BERT, RoBERTa, DeBERTa, DistilBERT and ALBERT) to add to the debate on best practices around employing computational text analysis for political communication studies. Second, it introduces various fine-tuned models capable of robustly performing generic news frame detection. Third, building upon numerous previous studies that work with US-centric data, this study provides the scholarly community with a labelled generic news frames dataset based on the Swiss electoral context that aids in testing the contextual robustness of these computational approaches to framing analysis.

Related papers

• scTranslation: A Comprehensive Benchmark for Single-Cell Multi-Omics Modality Translation [61.97613474494102]
  scTranslation is a comprehensive benchmark for single-cell multi-omics modality translation tasks.<n>It includes diverse translation datasets, integrates state-of-the-art models, and provides a comprehensive evaluation metrics.
  arXiv  Detail & Related papers  (2026-06-02T17:00:49Z)
• Assessing Classical Machine Learning and Transformer-based Approaches for Detecting AI-Generated Research Text [0.0]
  Machine learning approaches can distinguish ChatGPT-3.5-generated texts from human-written texts.<n>DistilBERT achieves the overall best performance, while Logistic Regression and BERT-Custom offer solid, balanced alternatives.
  arXiv  Detail & Related papers  (2025-09-20T04:36:21Z)
• Limited Generalizability in Argument Mining: State-Of-The-Art Models Learn Datasets, Not Arguments [3.4163020595590106]
  This study offers the first large-scale re-evaluation of such state-of-the-art models.<n>We evaluate four transformers, three standard and one enhanced with contrastive pre-training for better generalization.<n>Our findings show that, to varying degrees, these models tend to rely on lexical shortcuts tied to content words.
  arXiv  Detail & Related papers  (2025-05-28T09:00:56Z)
• BERTopic for Topic Modeling of Hindi Short Texts: A Comparative Study [1.1650821883155187]
  This study investigates the performance of BERTopic in modeling Hindi short texts.<n>Using contextual embeddings, BERTopic can capture semantic relationships in data, making it potentially more effective than traditional models.
  arXiv  Detail & Related papers  (2025-01-07T14:53:35Z)
• Unveiling the Potential of BERTopic for Multilingual Fake News Analysis -- Use Case: Covid-19 [0.562479170374811]
  BERTopic consists of sentence embedding, dimension reduction, clustering, and topic extraction. This paper aims to analyse the technical application of BERTopic in practice. It also aims to analyse the results of topic modeling on real world data as a use case.
  arXiv  Detail & Related papers  (2024-07-11T11:47:43Z)
• Explaining Text Similarity in Transformer Models [52.571158418102584]
  Recent advances in explainable AI have made it possible to mitigate limitations by leveraging improved explanations for Transformers. We use BiLRP, an extension developed for computing second-order explanations in bilinear similarity models, to investigate which feature interactions drive similarity in NLP models. Our findings contribute to a deeper understanding of different semantic similarity tasks and models, highlighting how novel explainable AI methods enable in-depth analyses and corpus-level insights.
  arXiv  Detail & Related papers  (2024-05-10T17:11:31Z)
• Continual Learning with Pre-Trained Models: A Survey [61.97613090666247]
  Continual Learning aims to overcome the catastrophic forgetting of former knowledge when learning new ones. This paper presents a comprehensive survey of the latest advancements in PTM-based CL.
  arXiv  Detail & Related papers  (2024-01-29T18:27:52Z)
• A quantitative study of NLP approaches to question difficulty estimation [0.30458514384586394]
  This work quantitatively analyzes several approaches proposed in previous research, and comparing their performance on datasets from different educational domains. We find that Transformer based models are the best performing across different educational domains, with DistilBERT performing almost as well as BERT. As for the other models, the hybrid ones often outperform the ones based on a single type of features, the ones based on linguistic features perform well on reading comprehension questions, while frequency based features (TF-IDF) and word embeddings (word2vec) perform better in domain knowledge assessment.
  arXiv  Detail & Related papers  (2023-05-17T14:26:00Z)
• PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrieval [87.68667887072324]
  We propose a novel approach that leverages query-centric and PAssage-centric sImilarity Relations (called PAIR) for dense passage retrieval. To implement our approach, we make three major technical contributions by introducing formal formulations of the two kinds of similarity relations. Our approach significantly outperforms previous state-of-the-art models on both MSMARCO and Natural Questions datasets.
  arXiv  Detail & Related papers  (2021-08-13T02:07:43Z)
• Few-Shot Named Entity Recognition: A Comprehensive Study [92.40991050806544]
  We investigate three schemes to improve the model generalization ability for few-shot settings. We perform empirical comparisons on 10 public NER datasets with various proportions of labeled data. We create new state-of-the-art results on both few-shot and training-free settings.
  arXiv  Detail & Related papers  (2020-12-29T23:43:16Z)
• Improving Neural Topic Models using Knowledge Distillation [84.66983329587073]
  We use knowledge distillation to combine the best attributes of probabilistic topic models and pretrained transformers. Our modular method can be straightforwardly applied with any neural topic model to improve topic quality.
  arXiv  Detail & Related papers  (2020-10-05T22:49:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.