MT-Adapted Datasheets for Datasets: Template and Repository

• URL: http://arxiv.org/abs/2005.13156v1
• Date: Wed, 27 May 2020 04:56:08 GMT
• Title: MT-Adapted Datasheets for Datasets: Template and Repository
• Abstract summary: We are taking the standardized model proposed by Gebru et al. for documenting the popular machine translation datasets of the EuroParl and News-Commentary. Within this documentation process, we have adapted the original to the particular case of data consumers within the Machine Translation area.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this report we are taking the standardized model proposed by Gebru et al. (2018) for documenting the popular machine translation datasets of the EuroParl (Koehn, 2005) and News-Commentary (Barrault et al., 2019). Within this documentation process, we have adapted the original datasheet to the particular case of data consumers within the Machine Translation area. We are also proposing a repository for collecting the adapted datasheets in this research area

Related papers

• The EMN Country Factsheets Structured Dataset [4.452114001400509]
  The dataset was created to facilitate European-level research on migration policies and developments.<n>It was created at a time when the spread of online misinformation about migration constitutes a serious issue.<n>We propose envisioned applications and uses of the dataset.
  arXiv  Detail & Related papers  (2026-08-16T12:14:20Z)
• DatAasee -- A Metadata-Lake as Metadata Catalog for a Virtual Data-Lake [0.0]
  This work constructs a data architecture, derived from the data-lake: the metadata-lake.<n>A proof-of-concept implementation of this proposed metadata aggregator is presented and also evaluated.
  arXiv  Detail & Related papers  (2024-09-09T11:10:45Z)
• Personalized Federated Learning via Active Sampling [50.456464838807115]
  This paper proposes a novel method for sequentially identifying similar (or relevant) data generators. Our method evaluates the relevance of a data generator by evaluating the effect of a gradient step using its local dataset. We extend this method to non-parametric models by a suitable generalization of the gradient step to update a hypothesis using the local dataset provided by a data generator.
  arXiv  Detail & Related papers  (2024-09-03T17:12:21Z)
• The MERIT Dataset: Modelling and Efficiently Rendering Interpretable Transcripts [0.0]
  This paper introduces the MERIT dataset, a fully labeled dataset within the context of school reports. By its nature, the MERIT dataset can potentially include biases in a controlled way, making it a valuable tool to benchmark biases induced in Language Models (LLMs) To demonstrate the dataset's utility, we present a benchmark with token classification models, showing that the dataset poses a significant challenge even for SOTA models.
  arXiv  Detail & Related papers  (2024-08-31T12:56:38Z)
• Electric Vehicle Enquiry (EVE) Pilot [0.0]
  This dataset covers the usage data from a Renault Zoe over 3 years. The process of collection of the dataset, its treatment, and descriptions of all the included variables are detailed.
  arXiv  Detail & Related papers  (2024-03-05T08:32:21Z)
• The State of Documentation Practices of Third-party Machine Learning Models and Datasets [8.494940891363813]
  We assess the state of the practice of documenting model cards and dataset cards in one of the largest model stores in use today. Our findings show that only 21,902 models (39.62%) and 1,925 datasets (28.48%) have documentation.
  arXiv  Detail & Related papers  (2023-12-22T20:45:52Z)
• MADLAD-400: A Multilingual And Document-Level Large Audited Dataset [66.12330208082442]
  We introduce MADLAD-400, a manually audited, general domain 3T token monolingual dataset based on CommonCrawl. We discuss the limitations revealed by self-auditing MADLAD-400, and the role data auditing had in the dataset creation process.
  arXiv  Detail & Related papers  (2023-09-09T02:34:01Z)
• Alibaba-Translate China's Submission for WMT 2022 Metrics Shared Task [61.34108034582074]
  We build our system based on the core idea of UNITE (Unified Translation Evaluation) During the model pre-training phase, we first apply the pseudo-labeled data examples to continuously pre-train UNITE. During the fine-tuning phase, we use both Direct Assessment (DA) and Multidimensional Quality Metrics (MQM) data from past years' WMT competitions.
  arXiv  Detail & Related papers  (2022-10-18T08:51:25Z)
• FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation [64.9546787488337]
  We present FRMT, a new dataset and evaluation benchmark for Few-shot Region-aware Machine Translation. The dataset consists of professional translations from English into two regional variants each of Portuguese and Mandarin Chinese.
  arXiv  Detail & Related papers  (2022-10-01T05:02:04Z)
• GEMv2: Multilingual NLG Benchmarking in a Single Line of Code [161.1761414080574]
  Generation, Evaluation, and Metrics Benchmark introduces a modular infrastructure for dataset, model, and metric developers. GEMv2 supports 40 documented datasets in 51 languages. Models for all datasets can be evaluated online and our interactive data card creation and rendering tools make it easier to add new datasets to the living benchmark.
  arXiv  Detail & Related papers  (2022-06-22T17:52:30Z)
• The Problem of Zombie Datasets:A Framework For Deprecating Datasets [55.878249096379804]
  We examine the public afterlives of several prominent datasets, including ImageNet, 80 Million Tiny Images, MS-Celeb-1M, Duke MTMC, Brainwash, and HRT Transgender. We propose a dataset deprecation framework that includes considerations of risk, mitigation of impact, appeal mechanisms, timeline, post-deprecation protocol, and publication checks.
  arXiv  Detail & Related papers  (2021-10-18T20:13:51Z)
• A Survey on Awesome Korean NLP Datasets [0.0]
  This paper introduces 15 popular Korean based NLP datasets with summarized details such as volume, license, repositories, and other research results inspired by the datasets. The main characteristics of datasets are presented on a single table to provide a rapid summarization of datasets for researchers.
  arXiv  Detail & Related papers  (2021-10-17T03:24:05Z)
• Machine Translation Customization via Automatic Training Data Selection from the Web [97.98885151955467]
  We describe an approach for customizing machine translation systems on specific domains. We select data similar to the target customer data to train neural translation models. Finally, we train MT models on our automatically selected data, obtaining a system specialized to the target domain.
  arXiv  Detail & Related papers  (2021-02-20T03:29:41Z)
• A Parallel Evaluation Data Set of Software Documentation with Document Structure Annotation [0.0]
  The data set comprises of the language pairs English to Hindi, Indonesian, Malay and Thai. We provide insights into the origin and creation, the particularities and characteristics of the data set as well as machine translation results.
  arXiv  Detail & Related papers  (2020-08-11T06:50:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.