Iterative Data Programming for Expanding Text Classification Corpora

• URL: http://arxiv.org/abs/2002.01412v1
• Date: Tue, 4 Feb 2020 17:12:43 GMT
• Title: Iterative Data Programming for Expanding Text Classification Corpora
• Authors: Neil Mallinar, Abhishek Shah, Tin Kam Ho, Rajendra Ugrani, Ayush Gupta
• Abstract summary: Real-world text classification tasks often require many labeled training examples that are expensive to obtain. Recent advancements in machine teaching, specifically the data programming paradigm, facilitate the creation of training data sets quickly. We present a fast, simple data programming method for augmenting text data sets by generating neighborhood-based weak models.
• Score: 9.152045698511506
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Real-world text classification tasks often require many labeled training examples that are expensive to obtain. Recent advancements in machine teaching, specifically the data programming paradigm, facilitate the creation of training data sets quickly via a general framework for building weak models, also known as labeling functions, and denoising them through ensemble learning techniques. We present a fast, simple data programming method for augmenting text data sets by generating neighborhood-based weak models with minimal supervision. Furthermore, our method employs an iterative procedure to identify sparsely distributed examples from large volumes of unlabeled data. The iterative data programming techniques improve newer weak models as more labeled data is confirmed with human-in-loop. We show empirical results on sentence classification tasks, including those from a task of improving intent recognition in conversational agents.

Related papers

Err

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.