Representation Learning for Resource-Constrained Keyphrase Generation

• URL: http://arxiv.org/abs/2203.08118v1
• Date: Tue, 15 Mar 2022 17:48:04 GMT
• Title: Representation Learning for Resource-Constrained Keyphrase Generation
• Authors: Di Wu, Wasi Uddin Ahmad, Sunipa Dev, Kai-Wei Chang
• Abstract summary: We introduce salient span recovery and salient span prediction as guided denoising language modeling objectives. We show the effectiveness of the proposed approach for low-resource and zero-shot keyphrase generation.
• Score: 78.02577815973764
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: State-of-the-art keyphrase generation methods generally depend on large annotated datasets, limiting their performance in domains with constrained resources. To overcome this challenge, we investigate strategies to learn an intermediate representation suitable for the keyphrase generation task. We introduce salient span recovery and salient span prediction as guided denoising language modeling objectives that condense the domain-specific knowledge essential for keyphrase generation. Through experiments on multiple scientific keyphrase generation benchmarks, we show the effectiveness of the proposed approach for facilitating low-resource and zero-shot keyphrase generation. Furthermore, we observe that our method especially benefits the generation of absent keyphrases, approaching the performance of SOTA methods trained with large training sets.

Related papers

• Self-Compositional Data Augmentation for Scientific Keyphrase Generation [28.912937922090038]
  We present a self-compositional data augmentation method for keyphrase generation. We measure the relatedness of training documents based on their shared keyphrases, and combine similar documents to generate synthetic samples.
  arXiv  Detail & Related papers  (2024-11-05T12:22:51Z)
• Key Algorithms for Keyphrase Generation: Instruction-Based LLMs for Russian Scientific Keyphrases [2.8402080392117757]
  Keyphrase selection is a challenging task in natural language processing that has a wide range of applications. Adapting existing supervised and unsupervised solutions for the Russian language faces several limitations. Recent studies conducted on English texts show that large language models (LLMs) successfully address the task of generating keyphrases.
  arXiv  Detail & Related papers  (2024-10-23T17:07:32Z)
• MetaKP: On-Demand Keyphrase Generation [52.48698290354449]
  We introduce on-demand keyphrase generation, a novel paradigm that requires keyphrases that conform to specific high-level goals or intents. We present MetaKP, a large-scale benchmark comprising four datasets, 7500 documents, and 3760 goals across news and biomedical domains with human-annotated keyphrases. We demonstrate the potential of our method to serve as a general NLP infrastructure, exemplified by its application in epidemic event detection from social media.
  arXiv  Detail & Related papers  (2024-06-28T19:02:59Z)
• Data Augmentation for Low-Resource Keyphrase Generation [46.52115499306222]
  Keyphrase generation is the task of summarizing the contents of any given article into a few salient phrases (or keyphrases) Existing works for the task mostly rely on large-scale annotated datasets, which are not easy to acquire. We present data augmentation strategies specifically to address keyphrase generation in purely resource-constrained domains.
  arXiv  Detail & Related papers  (2023-05-29T09:20:34Z)
• Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Study [76.52997424694767]
  We present an in-depth empirical study of keyphrase extraction and keyphrase generation using pre-trained language models. We show that PLMs have competitive high-resource performance and state-of-the-art low-resource performance. Further results show that in-domain BERT-like PLMs can be used to build strong and data-efficient keyphrase generation models.
  arXiv  Detail & Related papers  (2022-12-20T13:20:21Z)
• Improving Keyphrase Extraction with Data Augmentation and Information Filtering [67.43025048639333]
  Keyphrase extraction is one of the essential tasks for document understanding in NLP. We present a novel corpus and method for keyphrase extraction from the videos streamed on the Behance platform.
  arXiv  Detail & Related papers  (2022-09-11T22:38:02Z)
• Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Training [66.64843711515341]
  Keyphrase generation is the task of automatically predicting keyphrases given a piece of long text. We call attention to a new setting named multilingual keyphrase generation. We propose a retrieval-augmented method for multilingual keyphrase generation to mitigate the data shortage problem in non-English languages.
  arXiv  Detail & Related papers  (2022-05-21T00:45:21Z)
• Unsupervised Keyphrase Extraction via Interpretable Neural Networks [27.774524511005172]
  Keyphrases that are most useful for predicting the topic of a text are important keyphrases. InSPECT is a self-explaining neural framework for identifying influential keyphrases. We show that INSPECT achieves state-of-the-art results in unsupervised key extraction across four diverse datasets.
  arXiv  Detail & Related papers  (2022-03-15T04:30:47Z)
• UniKeyphrase: A Unified Extraction and Generation Framework for Keyphrase Prediction [20.26899340581431]
  Keyphrase Prediction task aims at predicting several keyphrases that can summarize the main idea of the given document. Mainstream KP methods can be categorized into purely generative approaches and integrated models with extraction and generation. We propose UniKeyphrase, a novel end-to-end learning framework that jointly learns to extract and generate keyphrases.
  arXiv  Detail & Related papers  (2021-06-09T07:09:51Z)
• Keyphrase Extraction with Dynamic Graph Convolutional Networks and Diversified Inference [50.768682650658384]
  Keyphrase extraction (KE) aims to summarize a set of phrases that accurately express a concept or a topic covered in a given document. Recent Sequence-to-Sequence (Seq2Seq) based generative framework is widely used in KE task, and it has obtained competitive performance on various benchmarks. In this paper, we propose to adopt the Dynamic Graph Convolutional Networks (DGCN) to solve the above two problems simultaneously.
  arXiv  Detail & Related papers  (2020-10-24T08:11:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.