A Question Type Driven and Copy Loss Enhanced Frameworkfor
Answer-Agnostic Neural Question Generation
- URL: http://arxiv.org/abs/2005.11665v1
- Date: Sun, 24 May 2020 07:09:04 GMT
- Title: A Question Type Driven and Copy Loss Enhanced Frameworkfor
Answer-Agnostic Neural Question Generation
- Authors: Xiuyu Wu, Nan Jiang and Yunfang Wu
- Abstract summary: We propose two new strategies to deal with the answer-agnostic question generation task: question type prediction and copy loss mechanism.
The question type module is to predict the types of questions that should be asked, which allows our model to generate multiple types of questions for the same source sentence.
The new copy loss enhances the original copy mechanism to make sure that every important word in the source sentence has been copied when generating questions.
- Score: 17.819949636876018
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The answer-agnostic question generation is a significant and challenging
task, which aims to automatically generate questions for a given sentence but
without an answer. In this paper, we propose two new strategies to deal with
this task: question type prediction and copy loss mechanism. The question type
module is to predict the types of questions that should be asked, which allows
our model to generate multiple types of questions for the same source sentence.
The new copy loss enhances the original copy mechanism to make sure that every
important word in the source sentence has been copied when generating
questions. Our integrated model outperforms the state-of-the-art approach in
answer-agnostic question generation, achieving a BLEU-4 score of 13.9 on SQuAD.
Human evaluation further validates the high quality of our generated questions.
We will make our code public available for further research.
Related papers
- Don't Just Say "I don't know"! Self-aligning Large Language Models for Responding to Unknown Questions with Explanations [70.6395572287422]
Self-alignment method is capable of not only refusing to answer but also providing explanation to the unanswerability of unknown questions.
We conduct disparity-driven self-curation to select qualified data for fine-tuning the LLM itself for aligning the responses to unknown questions as desired.
arXiv Detail & Related papers (2024-02-23T02:24:36Z) - "What makes a question inquisitive?" A Study on Type-Controlled
Inquisitive Question Generation [35.87102025753666]
We propose a type-controlled framework for inquisitive question generation.
We generate a variety of questions that adhere to specific types while drawing from the source texts.
We also investigate strategies for selecting a single question from a generated set.
arXiv Detail & Related papers (2022-05-17T02:05:50Z) - MixQG: Neural Question Generation with Mixed Answer Types [54.23205265351248]
We propose a neural question generator, MixQG, to bridge this gap.
We combine 9 question answering datasets with diverse answer types, including yes/no, multiple-choice, extractive, and abstractive answers.
Our model outperforms existing work in both seen and unseen domains.
arXiv Detail & Related papers (2021-10-15T16:03:40Z) - Controllable Open-ended Question Generation with A New Question Type
Ontology [6.017006996402699]
We investigate the less-explored task of generating open-ended questions that are typically answered by multiple sentences.
We first define a new question type ontology which differentiates the nuanced nature of questions better than widely used question words.
We then propose a novel question type-aware question generation framework, augmented by a semantic graph representation.
arXiv Detail & Related papers (2021-07-01T00:02:03Z) - Answering Ambiguous Questions through Generative Evidence Fusion and
Round-Trip Prediction [46.38201136570501]
We present a model that aggregates and combines evidence from multiple passages to adaptively predict a single answer or a set of question-answer pairs for ambiguous questions.
Our model, named Refuel, achieves a new state-of-the-art performance on the AmbigQA dataset, and shows competitive performance on NQ-Open and TriviaQA.
arXiv Detail & Related papers (2020-11-26T05:48:55Z) - Inquisitive Question Generation for High Level Text Comprehension [60.21497846332531]
We introduce INQUISITIVE, a dataset of 19K questions that are elicited while a person is reading through a document.
We show that readers engage in a series of pragmatic strategies to seek information.
We evaluate question generation models based on GPT-2 and show that our model is able to generate reasonable questions.
arXiv Detail & Related papers (2020-10-04T19:03:39Z) - Tell Me How to Ask Again: Question Data Augmentation with Controllable
Rewriting in Continuous Space [94.8320535537798]
Controllable Rewriting based Question Data Augmentation (CRQDA) for machine reading comprehension (MRC), question generation, and question-answering natural language inference tasks.
We treat the question data augmentation task as a constrained question rewriting problem to generate context-relevant, high-quality, and diverse question data samples.
arXiv Detail & Related papers (2020-10-04T03:13:46Z) - Reinforced Multi-task Approach for Multi-hop Question Generation [47.15108724294234]
We take up Multi-hop question generation, which aims at generating relevant questions based on supporting facts in the context.
We employ multitask learning with the auxiliary task of answer-aware supporting fact prediction to guide the question generator.
We demonstrate the effectiveness of our approach through experiments on the multi-hop question answering dataset, HotPotQA.
arXiv Detail & Related papers (2020-04-05T10:16:59Z) - Unsupervised Question Decomposition for Question Answering [102.56966847404287]
We propose an algorithm for One-to-N Unsupervised Sequence Sequence (ONUS) that learns to map one hard, multi-hop question to many simpler, single-hop sub-questions.
We show large QA improvements on HotpotQA over a strong baseline on the original, out-of-domain, and multi-hop dev sets.
arXiv Detail & Related papers (2020-02-22T19:40:35Z) - Asking Questions the Human Way: Scalable Question-Answer Generation from
Text Corpus [23.676748207014903]
We propose Answer-Clue-Style-aware Question Generation (ACS-QG)
It aims at automatically generating high-quality and diverse question-answer pairs from unlabeled text corpus at scale.
We can generate 2.8 million quality-assured question-answer pairs from a million sentences found in Wikipedia.
arXiv Detail & Related papers (2020-01-27T05:27:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.