Bergson: An Open Source Library for Data Attribution

• URL: http://arxiv.org/abs/2606.11660v1
• Date: Wed, 10 Jun 2026 04:56:45 GMT
• Title: Bergson: An Open Source Library for Data Attribution
• Abstract summary: Bergson is an open source library that aims to enable faster progress in the field of data attribution.<n>We introduce the first open-source implementations of three leading data attribution methods: MAGIC, SOURCE, and TrackStar.
• Score: 14.496043435115867
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Data attribution is a promising field in interpretability that aims to explain model behavior through the influence of its training data, with applications including debugging undesirable model behavior and training dataset curation. However, significant engineering effort is required to perform it at scale, and many cutting edge techniques lack open-source tooling and support. Bergson is an open source library that aims to enable faster progress in the field by providing a host of techniques that scale to very large language models and pre-training datasets. The library natively supports on-disk gradient stores and multi-node distributed training, and provides quality of life tools for researchers. Finally, we introduce the first open-source implementations of three leading data attribution methods: MAGIC, SOURCE, and TrackStar. The library is available at https://github.com/EleutherAI/bergson .

Related papers

• DeepXiv-SDK: An Agentic Data Interface for Scientific Literature [60.19264121557117]
  DeepXiv-SDK is a three-layer agentic data interface for scientific literature.<n>DeepXiv-SDK supports the complete ArXiv corpus, and is synchronized daily to incorporate new releases.
  arXiv  Detail & Related papers  (2026-02-14T23:07:28Z)
• Cuvis.Ai: An Open-Source, Low-Code Software Ecosystem for Hyperspectral Processing and Classification [0.4038539043067986]
  cuvis.ai is an open-source and low-code software ecosystem for data acquisition, preprocessing, and model training. The package is written in Python and provides wrappers around common machine learning libraries.
  arXiv  Detail & Related papers  (2024-11-18T06:33:40Z)
• $\texttt{dattri}$: A Library for Efficient Data Attribution [7.803566162554017]
  Data attribution methods aim to quantify the influence of individual training samples on the prediction of artificial intelligence (AI) models. Despite a surge of new data attribution methods being developed, there lacks a comprehensive library that facilitates the development, benchmarking, and deployment of different data attribution methods. In this work, we introduce $textttdattri$, an open-source data attribution library that addresses the above needs.
  arXiv  Detail & Related papers  (2024-10-06T17:18:09Z)
• SEART Data Hub: Streamlining Large-Scale Source Code Mining and Pre-Processing [13.717170962455526]
  We present the SEART Data Hub, a web application that allows to easily build and pre-process large-scale datasets featuring code mined from public GitHub repositories. Through a simple web interface, researchers can specify a set of mining criteria as well as specific pre-processing steps they want to perform. After submitting the request, the user will receive an email with a download link for the required dataset within a few hours.
  arXiv  Detail & Related papers  (2024-09-27T11:42:19Z)
• Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Data [75.7383558074758]
  This work presents an Open Whisper-style Speech Model (OWSM) OWSM reproduces Whisper-style training using an open-source toolkit and publicly available data. We will publicly release all scripts used for data preparation, training, inference, and scoring as well as pre-trained models and training logs to promote open science.
  arXiv  Detail & Related papers  (2023-09-25T05:01:34Z)
• trajdata: A Unified Interface to Multiple Human Trajectory Datasets [32.93180256927027]
  We present trajdata, a unified interface to multiple human trajectory datasets. Trajdata provides a simple, uniform, and efficient representation and API for trajectory and map data.
  arXiv  Detail & Related papers  (2023-07-26T02:45:59Z)
• infoVerse: A Universal Framework for Dataset Characterization with Multidimensional Meta-information [68.76707843019886]
  infoVerse is a universal framework for dataset characterization. infoVerse captures multidimensional characteristics of datasets by incorporating various model-driven meta-information. In three real-world applications (data pruning, active learning, and data annotation), the samples chosen on infoVerse space consistently outperform strong baselines.
  arXiv  Detail & Related papers  (2023-05-30T18:12:48Z)
• Avalanche: A PyTorch Library for Deep Continual Learning [12.238684710313168]
  Continual learning is the problem of learning from a nonstationary stream of data. Avalanche is an open source library maintained by the ContinualAI non-profit organization.
  arXiv  Detail & Related papers  (2023-02-02T10:45:20Z)
• PyRelationAL: a python library for active learning research and development [1.0061110876649197]
  Active learning (AL) is a sub-field of ML focused on the development of methods to iteratively and economically acquire data. Here, we introduce PyRelationAL, an open source library for AL research. We describe a modular toolkit based around a two step design methodology for composing pool-based active learning strategies.
  arXiv  Detail & Related papers  (2022-05-23T08:21:21Z)
• Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding [69.40915115518523]
  Lack of training data presents a grand challenge to scaling out spoken language understanding (SLU) to low-resource languages. Various data augmentation approaches have been proposed to synthesize training data in low-resource target languages. In this paper we focus on mitigating noise in augmented data.
  arXiv  Detail & Related papers  (2021-09-03T15:44:15Z)
• Combining Feature and Instance Attribution to Detect Artifacts [62.63504976810927]
  We propose methods to facilitate identification of training data artifacts. We show that this proposed training-feature attribution approach can be used to uncover artifacts in training data. We execute a small user study to evaluate whether these methods are useful to NLP researchers in practice.
  arXiv  Detail & Related papers  (2021-07-01T09:26:13Z)
• Neural Data Server: A Large-Scale Search Engine for Transfer Learning Data [78.74367441804183]
  We introduce Neural Data Server (NDS), a large-scale search engine for finding the most useful transfer learning data to the target domain. NDS consists of a dataserver which indexes several large popular image datasets, and aims to recommend data to a client. We show the effectiveness of NDS in various transfer learning scenarios, demonstrating state-of-the-art performance on several target datasets.
  arXiv  Detail & Related papers  (2020-01-09T01:21:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.