UNCC Biomedical Semantic Question Answering Systems. BioASQ: Task-7B, Phase-B

• URL: http://arxiv.org/abs/2002.01984v1
• Date: Wed, 5 Feb 2020 20:43:14 GMT
• Title: UNCC Biomedical Semantic Question Answering Systems. BioASQ: Task-7B, Phase-B
• Authors: Sai Krishna Telukuntla, Aditya Kapri and Wlodek Zadrozny
• Abstract summary: We present our approach for Task-7b, Phase B, Exact Answering Task. These Question Answering (QA) tasks include Factoid, Yes/No, List Type Question answering. Our system is based on a contextual word embedding model.
• Score: 1.976652238476722
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we detail our submission to the 2019, 7th year, BioASQ competition. We present our approach for Task-7b, Phase B, Exact Answering Task. These Question Answering (QA) tasks include Factoid, Yes/No, List Type Question answering. Our system is based on a contextual word embedding model. We have used a Bidirectional Encoder Representations from Transformers(BERT) based system, fined tuned for biomedical question answering task using BioBERT. In the third test batch set, our system achieved the highest MRR score for Factoid Question Answering task. Also, for List type question answering task our system achieved the highest recall score in the fourth test batch set. Along with our detailed approach, we present the results for our submissions, and also highlight identified downsides for our current approach and ways to improve them in our future experiments.

Related papers

• Using Pretrained Large Language Model with Prompt Engineering to Answer Biomedical Questions [1.0742675209112622]
  We propose a two-level information retrieval and question-answering system based on pre-trained large language models (LLM) We construct prompts with in-context few-shot examples and utilize post-processing techniques like resampling and malformed response detection. Our best-performing system achieved 0.14 MAP score on document retrieval, 0.05 MAP score on snippet retrieval, 0.96 F1 score for yes/no questions, 0.38 MRR score for factoid questions and 0.50 F1 score for list questions in Task 12b.
  arXiv  Detail & Related papers  (2024-07-09T11:48:49Z)
• Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision [53.692793122749414]
  We introduce a medical question understanding and answering system with knowledge grounding and semantic self-supervision. Our system is a pipeline that first summarizes a long, medical, user-written question, using a supervised summarization loss. The system first matches the summarized user question with an FAQ from a trusted medical knowledge base, and then retrieves a fixed number of relevant sentences from the corresponding answer document.
  arXiv  Detail & Related papers  (2022-09-30T08:20:32Z)
• Query-focused Extractive Summarisation for Biomedical and COVID-19 Complex Question Answering [0.0]
  This paper presents Macquarie University's participation in the two most recent BioASQ Synergy Tasks. We apply query-focused extractive summarisation techniques to generate complex answers to biomedical questions. For the Synergy task, we selected the candidate sentences following two phases: document retrieval and snippet retrieval. We observed an improvement of results when the system was trained on the second half of the BioASQ10b training data.
  arXiv  Detail & Related papers  (2022-09-05T07:56:44Z)
• Double Retrieval and Ranking for Accurate Question Answering [120.69820139008138]
  We show that an answer verification step introduced in Transformer-based answer selection models can significantly improve the state of the art in Question Answering. The results on three well-known datasets for AS2 show consistent and significant improvement of the state of the art.
  arXiv  Detail & Related papers  (2022-01-16T06:20:07Z)
• Transformer-based Language Models for Factoid Question Answering at BioASQ9b [0.0]
  We describe our experiments and participating systems in the BioASQ Task 9b Phase B challenge of biomedical question answering. For factoid questions, our ALBERT-based systems ranked first in test batch 1 and fourth in test batch 2. Our DistilBERT systems outperformed the ALBERT variants in test batches 4 and 5 despite having 81% fewer parameters than ALBERT.
  arXiv  Detail & Related papers  (2021-09-15T10:01:06Z)
• Will this Question be Answered? Question Filtering via Answer Model Distillation for Efficient Question Answering [99.66470885217623]
  We propose a novel approach towards improving the efficiency of Question Answering (QA) systems by filtering out questions that will not be answered by them. This is based on an interesting new finding: the answer confidence scores of state-of-the-art QA systems can be approximated well by models solely using the input question text.
  arXiv  Detail & Related papers  (2021-09-14T23:07:49Z)
• Query-Focused Extractive Summarisation for Finding Ideal Answers to Biomedical and COVID-19 Questions [7.6997148655751895]
  Macquarie University participated in the BioASQ Synergy Task and BioASQ9b Phase B. We used a query-focused summarisation system that was trained with the BioASQ8b training data set. Considering the poor quality of the documents and snippets retrieved by our system, we observed reasonably good quality in the answers returned.
  arXiv  Detail & Related papers  (2021-08-27T09:19:42Z)
• Answer Generation for Retrieval-based Question Answering Systems [80.28727681633096]
  We train a sequence to sequence transformer model to generate an answer from a candidate set. Our tests on three English AS2 datasets show improvement up to 32 absolute points in accuracy over the state of the art.
  arXiv  Detail & Related papers  (2021-06-02T05:45:49Z)
• ISCAS at SemEval-2020 Task 5: Pre-trained Transformers for Counterfactual Statement Modeling [48.3669727720486]
  ISCAS participated in two subtasks of SemEval 2020 Task 5: detecting counterfactual statements and detecting antecedent and consequence. This paper describes our system which is based on pre-trained transformers.
  arXiv  Detail & Related papers  (2020-09-17T09:28:07Z)
• Transferability of Natural Language Inference to Biomedical Question Answering [17.38537039378825]
  We focus on applying BioBERT to transfer the knowledge of natural language inference (NLI) to biomedical question answering (QA) We observe that BioBERT trained on the NLI dataset obtains better performance on Yes/No (+5.59%), Factoid (+0.53%), List type (+13.58%) questions. We present a sequential transfer learning method that significantly performed well in the 8th BioASQ Challenge (Phase B)
  arXiv  Detail & Related papers  (2020-07-01T04:05:48Z)
• Harvesting and Refining Question-Answer Pairs for Unsupervised QA [95.9105154311491]
  We introduce two approaches to improve unsupervised Question Answering (QA) First, we harvest lexically and syntactically divergent questions from Wikipedia to automatically construct a corpus of question-answer pairs (named as RefQA) Second, we take advantage of the QA model to extract more appropriate answers, which iteratively refines data over RefQA.
  arXiv  Detail & Related papers  (2020-05-06T15:56:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.