Multi-Task Learning based Online Dialogic Instruction Detection with Pre-trained Language Models

• URL: http://arxiv.org/abs/2107.07119v1
• Date: Thu, 15 Jul 2021 04:57:57 GMT
• Title: Multi-Task Learning based Online Dialogic Instruction Detection with Pre-trained Language Models
• Authors: Yang Hao, Hang Li, Wenbiao Ding, Zhongqin Wu, Jiliang Tang, Rose Luckin, Zitao Liu
• Abstract summary: We propose a multi-task paradigm which enhances the ability to distinguish instances of different classes by enlarging the margin between categories via contrastive loss. Experiments on a real-world online educational data set demonstrate that our approach achieves superior performance compared to representative baselines.
• Score: 34.66425105076059
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this work, we study computational approaches to detect online dialogic instructions, which are widely used to help students understand learning materials, and build effective study habits. This task is rather challenging due to the widely-varying quality and pedagogical styles of dialogic instructions. To address these challenges, we utilize pre-trained language models, and propose a multi-task paradigm which enhances the ability to distinguish instances of different classes by enlarging the margin between categories via contrastive loss. Furthermore, we design a strategy to fully exploit the misclassified examples during the training stage. Extensive experiments on a real-world online educational data set demonstrate that our approach achieves superior performance compared to representative baselines. To encourage reproducible results, we make our implementation online available at \url{https://github.com/AIED2021/multitask-dialogic-instruction}.

Related papers

• Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning [49.92517970237088]
  We tackle the problem of training a robot to understand multimodal prompts. This type of task poses a major challenge to robots' capability to understand the interconnection and complementarity between vision and language signals. We introduce an effective framework that learns a policy to perform robot manipulation with multimodal prompts.
  arXiv  Detail & Related papers  (2023-10-14T22:24:58Z)
• On the Effectiveness of Offline RL for Dialogue Response Generation [33.23689417744758]
  We study the efficacy of various offline reinforcement learning (RL) methods to maximize such objectives. offline RL shows a clear performance improvement over teacher forcing while not inducing training instability or sacrificing practical training budgets.
  arXiv  Detail & Related papers  (2023-07-23T20:43:21Z)
• Opportunities and Challenges in Neural Dialog Tutoring [54.07241332881601]
  We rigorously analyze various generative language models on two dialog tutoring datasets for language learning. We find that although current approaches can model tutoring in constrained learning scenarios, they perform poorly in less constrained scenarios. Our human quality evaluation shows that both models and ground-truth annotations exhibit low performance in terms of equitable tutoring.
  arXiv  Detail & Related papers  (2023-01-24T11:00:17Z)
• Multimodal Lecture Presentations Dataset: Understanding Multimodality in Educational Slides [57.86931911522967]
  We test the capabilities of machine learning models in multimodal understanding of educational content. Our dataset contains aligned slides and spoken language, for 180+ hours of video and 9000+ slides, with 10 lecturers from various subjects. We introduce PolyViLT, a multimodal transformer trained with a multi-instance learning loss that is more effective than current approaches.
  arXiv  Detail & Related papers  (2022-08-17T05:30:18Z)
• Wide & Deep Learning for Judging Student Performance in Online One-on-one Math Classes [27.07952179997629]
  We build a framework to learn fine-grained predictive representations from a limited amount of noisy classroom conversation data. We conducted experiments on the task of predicting students' levels of mastery of example questions.
  arXiv  Detail & Related papers  (2022-07-13T01:38:57Z)
• DialogID: A Dialogic Instruction Dataset for Improving Teaching Effectiveness in Online Environments [24.094249468028664]
  We present a dataset of online dialogic instruction detection, textscDialogID, which contains 30,431 effective dialogic instructions. We propose a simple yet effective adversarial training learning paradigm to improve the quality and generalization of dialogic instruction detection.
  arXiv  Detail & Related papers  (2022-06-24T02:07:12Z)
• Findings from Experiments of On-line Joint Reinforcement Learning of Semantic Parser and Dialogue Manager with real Users [3.9686445409447617]
  On-line learning is pursued in this paper as a convenient way to alleviate these difficulties. A new challenge is to control the cost of the on-line learning borne by the user.
  arXiv  Detail & Related papers  (2021-10-25T18:51:41Z)
• Continual Learning in Task-Oriented Dialogue Systems [49.35627673523519]
  Continual learning in task-oriented dialogue systems can allow us to add new domains and functionalities through time without incurring the high cost of a whole system retraining. We propose a continual learning benchmark for task-oriented dialogue systems with 37 domains to be learned continuously in four settings.
  arXiv  Detail & Related papers  (2020-12-31T08:44:25Z)
• Online Bag-of-Visual-Words Generation for Unsupervised Representation Learning [59.29452780994169]
  We propose a teacher-student scheme to learn representations by training a convnet to reconstruct a bag-of-visual-words (BoW) representation of an image. Our strategy performs an online training of both the teacher network (whose role is to generate the BoW targets) and the student network (whose role is to learn representations) along with an online update of the visual-words vocabulary.
  arXiv  Detail & Related papers  (2020-12-21T18:31:21Z)
• Neural Multi-Task Learning for Teacher Question Detection in Online Classrooms [50.19997675066203]
  We build an end-to-end neural framework that automatically detects questions from teachers' audio recordings. By incorporating multi-task learning techniques, we are able to strengthen the understanding of semantic relations among different types of questions.
  arXiv  Detail & Related papers  (2020-05-16T02:17:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.