DAG Card is the new Model Card

• URL: http://arxiv.org/abs/2110.13601v1
• Date: Sun, 24 Oct 2021 20:54:19 GMT
• Title: DAG Card is the new Model Card
• Abstract summary: We propose DAG Cards as a form of documentation encompassing the tenets of a data-centric point of view. We argue that Machine Learning pipelines are the most appropriate level of documentation for many practical use cases.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: With the progressive commoditization of modeling capabilities, data-centric AI recognizes that what happens before and after training becomes crucial for real-world deployments. Following the intuition behind Model Cards, we propose DAG Cards as a form of documentation encompassing the tenets of a data-centric point of view. We argue that Machine Learning pipelines (rather than models) are the most appropriate level of documentation for many practical use cases, and we share with the community an open implementation to generate cards from code.

Related papers

• AdaQE-CG: Adaptive Query Expansion for Web-Scale Generative AI Model and Data Card Generation [6.289039465679207]
  We propose AdaQE-CG, an Adaptive Query Expansion for Card Generation framework that combines dynamic information extraction with cross-card knowledge transfer.<n>AdaQE-CG substantially outperforms existing approaches, exceeds human-authored data cards, and approaches human-level quality for model cards.<n>We introduce MetaGAI-Bench, the first large-scale, expert-annotated benchmark for evaluating GAI documentation.
  arXiv  Detail & Related papers  (2026-03-16T04:02:56Z)
• VecCity: A Taxonomy-guided Library for Map Entity Representation Learning [48.73446321300362]
  Map entity representation learning (MapRL) generates versatile and reusable data representations. We propose a novel taxonomy for MapRL that organizes models based on functional module-such as encoders, pre-training tasks, and downstream tasks. We present a taxonomy-driven library, VecCity, which offers easy-to-use interfaces for encoding, pre-training, fine-tuning, and evaluation.
  arXiv  Detail & Related papers  (2024-10-31T07:03:46Z)
• Automatic Generation of Model and Data Cards: A Step Towards Responsible AI [23.42842241759459]
  We propose an automated generation approach using Large Language Models (LLMs) Key contributions include the establishment of CardBench, a comprehensive dataset aggregated from over 4.8k model cards and 1.4k data cards. Our approach exhibits enhanced completeness, objectivity, and faithfulness in generated model and data cards, a significant step in responsible AI documentation practices.
  arXiv  Detail & Related papers  (2024-05-10T06:14:07Z)
• Guiding Attention in End-to-End Driving Models [49.762868784033785]
  Vision-based end-to-end driving models trained by imitation learning can lead to affordable solutions for autonomous driving. We study how to guide the attention of these models to improve their driving quality by adding a loss term during training. In contrast to previous work, our method does not require these salient semantic maps to be available during testing time.
  arXiv  Detail & Related papers  (2024-04-30T23:18:51Z)
• What's documented in AI? Systematic Analysis of 32K AI Model Cards [40.170354637778345]
  We conduct a comprehensive analysis of 32,111 AI model documentations on Hugging Face. Most of the AI models with substantial downloads provide model cards, though the cards have uneven informativeness. We find that sections addressing environmental impact, limitations, and evaluation exhibit the lowest filled-out rates, while the training section is the most consistently filled-out.
  arXiv  Detail & Related papers  (2024-02-07T18:04:32Z)
• The State of Documentation Practices of Third-party Machine Learning Models and Datasets [8.494940891363813]
  We assess the state of the practice of documenting model cards and dataset cards in one of the largest model stores in use today. Our findings show that only 21,902 models (39.62%) and 1,925 datasets (28.48%) have documentation.
  arXiv  Detail & Related papers  (2023-12-22T20:45:52Z)
• Unlocking Model Insights: A Dataset for Automated Model Card Generation [4.167070553534516]
  We introduce a dataset of 500 question-answer pairs for 25 ML models. We employ annotators to extract the answers from the original paper. Our experiments with ChatGPT-3.5, LLaMa, and Galactica showcase a significant gap in the understanding of research papers by these LMs.
  arXiv  Detail & Related papers  (2023-09-22T04:46:11Z)
• Teacher Guided Training: An Efficient Framework for Knowledge Transfer [86.6784627427194]
  We propose the teacher-guided training (TGT) framework for training a high-quality compact model. TGT exploits the fact that the teacher has acquired a good representation of the underlying data domain. We find that TGT can improve accuracy on several image classification benchmarks and a range of text classification and retrieval tasks.
  arXiv  Detail & Related papers  (2022-08-14T10:33:58Z)
• Unified Pretraining Framework for Document Understanding [52.224359498792836]
  We present UDoc, a new unified pretraining framework for document understanding. UDoc is designed to support most document understanding tasks, extending the Transformer to take multimodal embeddings as input. An important feature of UDoc is that it learns a generic representation by making use of three self-supervised losses.
  arXiv  Detail & Related papers  (2022-04-22T21:47:04Z)
• Aspirations and Practice of Model Documentation: Moving the Needle with Nudging and Traceability [8.875661788022637]
  We propose a set of design guidelines that aim to support the documentation practice for machine learning models. A prototype tool named DocML follows those guidelines to support model development in computational notebooks.
  arXiv  Detail & Related papers  (2022-04-13T14:39:18Z)
• Mapping Patterns for Virtual Knowledge Graphs [71.61234136161742]
  Virtual Knowledge Graphs (VKG) constitute one of the most promising paradigms for integrating and accessing legacy data sources. We build on well-established methodologies and patterns studied in data management, data analysis, and conceptual modeling. We validate our catalog on the considered VKG scenarios, showing it covers the vast majority of patterns present therein.
  arXiv  Detail & Related papers  (2020-12-03T13:54:52Z)
• Coach: A Coarse-to-Fine Approach for Cross-domain Slot Filling [65.09621991654745]
  Cross-domain slot filling is an essential task in task-oriented dialog systems. We propose a Coarse-to-fine approach (Coach) for cross-domain slot filling. Experimental results show that our model significantly outperforms state-of-the-art approaches in slot filling.
  arXiv  Detail & Related papers  (2020-04-24T13:07:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.