AdamR at SemEval-2023 Task 10: Solving the Class Imbalance Problem in Sexism Detection with Ensemble Learning

• URL: http://arxiv.org/abs/2305.08636v1
• Date: Mon, 15 May 2023 13:28:59 GMT
• Title: AdamR at SemEval-2023 Task 10: Solving the Class Imbalance Problem in Sexism Detection with Ensemble Learning
• Authors: Adam Rydelek, Daryna Dementieva, and Georg Groh
• Abstract summary: The Explainable Detection of Online Sexism task presents the problem of explainable sexism detection through fine-grained categorisation of sexist cases. Our team experimented with different ways to combat class imbalance throughout the tasks using data augmentation and loss alteration techniques. This solution ranked us in the top 40% of teams for each of the tracks.
• Score: 1.9833664312284154
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: The Explainable Detection of Online Sexism task presents the problem of explainable sexism detection through fine-grained categorisation of sexist cases with three subtasks. Our team experimented with different ways to combat class imbalance throughout the tasks using data augmentation and loss alteration techniques. We tackled the challenge by utilising ensembles of Transformer models trained on different datasets, which are tested to find the balance between performance and interpretability. This solution ranked us in the top 40\% of teams for each of the tracks.

Related papers

• Guiding Through Complexity: What Makes Good Supervision for Hard Reasoning Tasks? [74.88417042125985]
  We investigate various data-driven strategies that offer supervision data at different quality levels upon tasks of varying complexity. We find that even when the outcome error rate for hard task supervision is high, training on such data can outperform perfectly correct supervision on easier subtasks. Our results also reveal that supplementing hard task supervision with the corresponding subtask supervision can yield notable performance improvements.
  arXiv  Detail & Related papers  (2024-10-27T17:55:27Z)
• GenderBias-\emph{VL}: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probing [72.0343083866144]
  This paper introduces the GenderBias-emphVL benchmark to evaluate occupation-related gender bias in Large Vision-Language Models. Using our benchmark, we extensively evaluate 15 commonly used open-source LVLMs and state-of-the-art commercial APIs. Our findings reveal widespread gender biases in existing LVLMs.
  arXiv  Detail & Related papers  (2024-06-30T05:55:15Z)
• A multitask learning framework for leveraging subjectivity of annotators to identify misogyny [47.175010006458436]
  We propose a multitask learning approach to enhance the performance of the misogyny identification systems. We incorporated diverse perspectives from annotators in our model design, considering gender and age across six profile groups. This research advances content moderation and highlights the importance of embracing diverse perspectives to build effective online moderation systems.
  arXiv  Detail & Related papers  (2024-06-22T15:06:08Z)
• Data-CUBE: Data Curriculum for Instruction-based Sentence Representation Learning [85.66907881270785]
  We propose a data curriculum method, namely Data-CUBE, that arranges the orders of all the multi-task data for training. In the task level, we aim to find the optimal task order to minimize the total cross-task interference risk. In the instance level, we measure the difficulty of all instances per task, then divide them into the easy-to-difficult mini-batches for training.
  arXiv  Detail & Related papers  (2024-01-07T18:12:20Z)
• LCT-1 at SemEval-2023 Task 10: Pre-training and Multi-task Learning for Sexism Detection and Classification [0.0]
  SemEval-2023 Task 10 on Explainable Detection of Online Sexism aims at increasing explainability of the sexism detection. Our system is based on further domain-adaptive pre-training. In experiments, multi-task learning performs on par with standard fine-tuning for sexism detection.
  arXiv  Detail & Related papers  (2023-06-08T09:56:57Z)
• Stanford MLab at SemEval-2023 Task 10: Exploring GloVe- and Transformer-Based Methods for the Explainable Detection of Online Sexism [0.0]
  We perform three classification tasks to predict whether the text is sexist. We classify the sexist text into subcategories in order to provide an additional explanation as to why the text is sexist.
  arXiv  Detail & Related papers  (2023-05-07T18:58:54Z)
• HausaNLP at SemEval-2023 Task 10: Transfer Learning, Synthetic Data and Side-Information for Multi-Level Sexism Classification [0.007696728525672149]
  We present the findings of our participation in the SemEval-2023 Task 10: Explainable Detection of Online Sexism (EDOS) task. We investigated the effects of transferring two language models: XLM-T (sentiment classification) and HateBERT (same domain -- Reddit) for multi-level classification into Sexist or not Sexist.
  arXiv  Detail & Related papers  (2023-04-28T20:03:46Z)
• Attention at SemEval-2023 Task 10: Explainable Detection of Online Sexism (EDOS) [15.52876591707497]
  We have worked on interpretability, trust, and understanding of the decisions made by models in the form of classification tasks. The first task consists of determining Binary Sexism Detection. The second task describes the Category of Sexism. The third task describes a more Fine-grained Category of Sexism.
  arXiv  Detail & Related papers  (2023-04-10T14:24:52Z)
• SemEval-2023 Task 10: Explainable Detection of Online Sexism [5.542286527528687]
  We introduce SemEval Task 10 on the Explainable Detection of Online Sexism (EDOS) We make three main contributions: i) a novel hierarchical taxonomy of sexist content, which includes granular vectors of sexism to aid explainability; ii) a new dataset of 20,000 social media comments with fine-grained labels, along with larger unlabelled datasets for model adaptation; andiii) baseline models as well as an analysis of the methods, results and errors for participant submissions to our task.
  arXiv  Detail & Related papers  (2023-03-07T20:28:39Z)
• Hierarchical Bayesian Bandits [51.67132887113412]
  We analyze a natural hierarchical Thompson sampling algorithm (hierTS) that can be applied to any problem in this class. Our regret bounds hold under many instances of such problems, including when the tasks are solved sequentially or in parallel. Experiments show that the hierarchical structure helps with knowledge sharing among the tasks.
  arXiv  Detail & Related papers  (2021-11-12T20:33:09Z)
• Improving filling level classification with adversarial training [90.01594595780928]
  We investigate the problem of classifying - from a single image - the level of content in a cup or a drinking glass. We use adversarial training in a generic source dataset and then refine the training with a task-specific dataset. We show that transfer learning with adversarial training in the source domain consistently improves the classification accuracy on the test set.
  arXiv  Detail & Related papers  (2021-02-08T08:32:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.