Policies and Evaluation for Online Meeting Summarization

• URL: http://arxiv.org/abs/2502.03111v1
• Date: Wed, 05 Feb 2025 12:15:00 GMT
• Title: Policies and Evaluation for Online Meeting Summarization
• Authors: Felix Schneider, Marco Turchi, Alex Waibel,
• Abstract summary: We perform the first systematic study of online meeting summarization.<n>For this purpose, we propose several policies for conducting online summarization.<n>Experiments on the AutoMin dataset show that online models can produce strong summaries.
• Score: 19.377659178660636
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: With more and more meetings moving to a digital domain, meeting summarization has recently gained interest in both academic and commercial research. However, prior academic research focuses on meeting summarization as an offline task, performed after the meeting concludes. In this paper, we perform the first systematic study of online meeting summarization. For this purpose, we propose several policies for conducting online summarization. We discuss the unique challenges of this task compared to the offline setting and define novel metrics to evaluate latency and partial summary quality. The experiments on the AutoMin dataset show that 1) online models can produce strong summaries, 2) our metrics allow a detailed analysis of different systems' quality-latency trade-off, also taking into account intermediate outputs and 3) adaptive policies perform better than fixed scheduled ones. These findings provide a starting point for the wider research community to explore this important task.

Related papers

• From Speech to Summary: A Comprehensive Survey of Speech Summarization [52.97157554560492]
  Speech summarization has become an essential tool for efficiently managing and accessing the growing volume of spoken and audiovisual content. Despite its increasing importance, speech summarization is still not clearly defined and intersects with several research areas, including speech recognition, text summarization, and specific applications like meeting summarization.
  arXiv  Detail & Related papers  (2025-04-10T17:50:53Z)
• A Modular Approach for Multimodal Summarization of TV Shows [55.20132267309382]
  We present a modular approach where separate components perform specialized sub-tasks. Our modules involve detecting scene boundaries, reordering scenes so as to minimize the number of cuts between different events, converting visual information to text, summarizing the dialogue in each scene, and fusing the scene summaries into a final summary for the entire episode. We also present a new metric, PRISMA, to measure both precision and recall of generated summaries, which we decompose into atomic facts.
  arXiv  Detail & Related papers  (2024-03-06T16:10:01Z)
• Investigating Consistency in Query-Based Meeting Summarization: A Comparative Study of Different Embedding Methods [0.0]
  Text Summarization is one of famous applications in Natural Language Processing (NLP) field. It aims to automatically generate summary with important information based on a given context. In this paper, we are inspired by "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization" proposed by Microsoft. We also propose our Locater model designed to extract relevant spans based on given transcript and query, which are then summarized by Summarizer model.
  arXiv  Detail & Related papers  (2024-02-10T08:25:30Z)
• Meeting Summarization: A Survey of the State of the Art [0.0]
  There is an overload of dialogue data due to the rise of virtual communication platforms. The rise of Covid-19 has led people to rely on online communication platforms like Zoom, Slack, Microsoft Teams, Discord, etc. to conduct their company meetings. There is a lack of comprehensive surveys in the field of meeting summarizers.
  arXiv  Detail & Related papers  (2022-12-16T00:21:30Z)
• Abstractive Meeting Summarization: A Survey [15.455647477995306]
  A system that could reliably identify and sum up the most important points of a conversation would be valuable in a wide variety of real-world contexts. Recent advances in deep learning has significantly improved language generation systems, opening the door to improved forms of abstractive summarization. We provide an overview of the challenges raised by the task of abstractive meeting summarization and of the data sets, models and evaluation metrics that have been used to tackle the problems.
  arXiv  Detail & Related papers  (2022-08-08T14:04:38Z)
• An Empirical Survey on Long Document Summarization: Datasets, Models and Metrics [33.655334920298856]
  We provide a comprehensive overview of the research on long document summarization. We conduct an empirical analysis to broaden the perspective on current research progress.
  arXiv  Detail & Related papers  (2022-07-03T02:57:22Z)
• Automatic Text Summarization Methods: A Comprehensive Review [1.6114012813668934]
  This study provides a detailed analysis of text summarization concepts such as summarization approaches, techniques used, standard datasets, evaluation metrics and future scopes for research.
  arXiv  Detail & Related papers  (2022-03-03T10:45:00Z)
• ConvoSumm: Conversation Summarization Benchmark and Improved Abstractive Summarization with Argument Mining [61.82562838486632]
  We crowdsource four new datasets on diverse online conversation forms of news comments, discussion forums, community question answering forums, and email threads. We benchmark state-of-the-art models on our datasets and analyze characteristics associated with the data.
  arXiv  Detail & Related papers  (2021-06-01T22:17:13Z)
• QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization [45.83402681068943]
  QMSum consists of 1,808 query-summary pairs over 232 meetings in multiple domains. We investigate a locate-then-summarize method and evaluate a set of strong summarization baselines on the task.
  arXiv  Detail & Related papers  (2021-04-13T05:00:35Z)
• Benchmarks for Deep Off-Policy Evaluation [152.28569758144022]
  We present a collection of policies that can be used for benchmarking off-policy evaluation. The goal of our benchmark is to provide a standardized measure of progress that is motivated from a set of principles. We provide open-source access to our data and code to foster future research in this area.
  arXiv  Detail & Related papers  (2021-03-30T18:09:33Z)
• From Standard Summarization to New Tasks and Beyond: Summarization with Manifold Information [77.89755281215079]
  Text summarization is the research area aiming at creating a short and condensed version of the original document. In real-world applications, most of the data is not in a plain text format. This paper focuses on the survey of these new summarization tasks and approaches in the real-world application.
  arXiv  Detail & Related papers  (2020-05-10T14:59:36Z)
• A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining [52.11221075687124]
  We propose a novel abstractive summary network that adapts to the meeting scenario. We design a hierarchical structure to accommodate long meeting transcripts and a role vector to depict the difference among speakers. Our model outperforms previous approaches in both automatic metrics and human evaluation.
  arXiv  Detail & Related papers  (2020-04-04T21:00:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.