Towards More Robust Natural Language Understanding

• URL: http://arxiv.org/abs/2112.02992v1
• Date: Wed, 1 Dec 2021 17:27:19 GMT
• Title: Towards More Robust Natural Language Understanding
• Authors: Xinliang Frederick Zhang
• Abstract summary: Natural Language Understanding (NLU) is branch of Natural Language Processing (NLP) Recent years have witnessed notable progress across various NLU tasks with deep learning techniques. It's worth noting that the human ability of understanding natural language is flexible and robust.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Natural Language Understanding (NLU) is a branch of Natural Language Processing (NLP) that uses intelligent computer software to understand texts that encode human knowledge. Recent years have witnessed notable progress across various NLU tasks with deep learning techniques, especially with pretrained language models. Besides proposing more advanced model architectures, constructing more reliable and trustworthy datasets also plays a huge role in improving NLU systems, without which it would be impossible to train a decent NLU model. It's worth noting that the human ability of understanding natural language is flexible and robust. On the contrary, most of existing NLU systems fail to achieve desirable performance on out-of-domain data or struggle on handling challenging items (e.g., inherently ambiguous items, adversarial items) in the real world. Therefore, in order to have NLU models understand human language more effectively, it is expected to prioritize the study on robust natural language understanding. In this thesis, we deem that NLU systems are consisting of two components: NLU models and NLU datasets. As such, we argue that, to achieve robust NLU, the model architecture/training and the dataset are equally important. Specifically, we will focus on three NLU tasks to illustrate the robustness problem in different NLU tasks and our contributions (i.e., novel models and new datasets) to help achieve more robust natural language understanding. Moving forward, the ultimate goal for robust natural language understanding is to build NLU models which can behave humanly. That is, it's expected that robust NLU systems are capable to transfer the knowledge from training corpus to unseen documents more reliably and survive when encountering challenging items even if the system doesn't know a priori of users' inputs.

Related papers

• SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understanding [103.34092301324425]
  Large language models (LLMs) have shown impressive ability for open-domain NLP tasks. We present SeqGPT, a bilingual (i.e., English and Chinese) open-source autoregressive model specially enhanced for open-domain natural language understanding.
  arXiv  Detail & Related papers  (2023-08-21T07:31:19Z)
• Understanding Natural Language Understanding Systems. A Critical Analysis [91.81211519327161]
  The development of machines that guillemotlefttalk like usguillemotright, also known as Natural Language Understanding (NLU) systems, is the Holy Grail of Artificial Intelligence (AI) But never has the trust that we can build guillemotlefttalking machinesguillemotright been stronger than the one engendered by the last generation of NLU systems. Are we at the dawn of a new era, in which the Grail is finally closer to us?
  arXiv  Detail & Related papers  (2023-03-01T08:32:55Z)
• Reliable Natural Language Understanding with Large Language Models and Answer Set Programming [0.0]
  Large language models (LLMs) are able to leverage patterns in the text to solve a variety of NLP tasks, but fall short in problems that require reasoning. We propose STAR, a framework that combines LLMs with Answer Set Programming (ASP) Goal-directed ASP is then employed to reliably reason over this knowledge.
  arXiv  Detail & Related papers  (2023-02-07T22:37:21Z)
• The Massively Multilingual Natural Language Understanding 2022 (MMNLU-22) Workshop and Competition [0.0]
  It is common to have Natural Language Understanding systems limited to a subset of languages due to lack of available data. We launch a three-phase approach to address the limitations in NLU and help propel NLU technology to new heights. We release a 52 language dataset called the Multilingual Amazon SLU resource package (SLURP) for Slot-filling, Intent classification, and Virtual assistant Evaluation. We organize the Massively Multilingual NLU 2022 Challenge to provide a competitive environment and push the state-of-the art in the transferability of models into other languages.
  arXiv  Detail & Related papers  (2022-12-13T03:00:36Z)
• A Survey of Knowledge Enhanced Pre-trained Language Models [78.56931125512295]
  We present a comprehensive review of Knowledge Enhanced Pre-trained Language Models (KE-PLMs) For NLU, we divide the types of knowledge into four categories: linguistic knowledge, text knowledge, knowledge graph (KG) and rule knowledge. The KE-PLMs for NLG are categorized into KG-based and retrieval-based methods.
  arXiv  Detail & Related papers  (2022-11-11T04:29:02Z)
• Finstreder: Simple and fast Spoken Language Understanding with Finite State Transducers using modern Speech-to-Text models [69.35569554213679]
  In Spoken Language Understanding (SLU) the task is to extract important information from audio commands. This paper presents a simple method for embedding intents and entities into Finite State Transducers.
  arXiv  Detail & Related papers  (2022-06-29T12:49:53Z)
• NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue [53.54788957697192]
  NLU++ is a novel dataset for natural language understanding (NLU) in task-oriented dialogue (ToD) systems. NLU++ is divided into two domains (BANKING and HOTELS) and brings several crucial improvements over current commonly used NLU datasets.
  arXiv  Detail & Related papers  (2022-04-27T16:00:23Z)
• Knowledge-driven Natural Language Understanding of English Text and its Applications [8.417188296231059]
  We introduce a knowledge driven semantic representation approach for English text. We present two NLU applications: SQuARE (Semantic-based Question Answering and Reasoning Engine) and StaCACK (Stateful Conversational Agent using Commonsense Knowledge)
  arXiv  Detail & Related papers  (2021-01-27T22:02:50Z)
• Language Model is All You Need: Natural Language Understanding as Question Answering [75.26830242165742]
  We study the use of a specific family of transfer learning, where the target domain is mapped to the source domain. We show that our approach could reduce the amount of required data for the same performance by up to a factor of 10.
  arXiv  Detail & Related papers  (2020-11-05T18:31:22Z)
• Dual Inference for Improving Language Understanding and Generation [35.251935231914366]
  Natural language understanding (NLU) and Natural language generation (NLG) tasks hold a strong dual relationship. NLU aims at predicting semantic labels based on natural language utterances and NLG does the opposite. This paper proposes to leverage the duality in the inference stage without the need of retraining.
  arXiv  Detail & Related papers  (2020-10-08T20:14:41Z)
• A Generative Model for Joint Natural Language Understanding and Generation [9.810053382574017]
  We propose a generative model which couples NLU and NLG through a shared latent variable. Our model achieves state-of-the-art performance on two dialogue datasets with both flat and tree-structured formal representations. We also show that the model can be trained in a semi-supervised fashion by utilising unlabelled data to boost its performance.
  arXiv  Detail & Related papers  (2020-06-12T22:38:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.