Avalanche: A PyTorch Library for Deep Continual Learning
- URL: http://arxiv.org/abs/2302.01766v1
- Date: Thu, 2 Feb 2023 10:45:20 GMT
- Title: Avalanche: A PyTorch Library for Deep Continual Learning
- Authors: Antonio Carta, Lorenzo Pellegrini, Andrea Cossu, Hamed Hemati,
Vincenzo Lomonaco
- Abstract summary: Continual learning is the problem of learning from a nonstationary stream of data.
Avalanche is an open source library maintained by the ContinualAI non-profit organization.
- Score: 12.238684710313168
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Continual learning is the problem of learning from a nonstationary stream of
data, a fundamental issue for sustainable and efficient training of deep neural
networks over time. Unfortunately, deep learning libraries only provide
primitives for offline training, assuming that model's architecture and data
are fixed. Avalanche is an open source library maintained by the ContinualAI
non-profit organization that extends PyTorch by providing first-class support
for dynamic architectures, streams of datasets, and incremental training and
evaluation methods. Avalanche provides a large set of predefined benchmarks and
training algorithms and it is easy to extend and modular while supporting a
wide range of continual learning scenarios. Documentation is available at
\url{https://avalanche.continualai.org}.
Related papers
- Katakomba: Tools and Benchmarks for Data-Driven NetHack [52.0035089982277]
NetHack is known as the frontier of reinforcement learning research.
We argue that there are three major obstacles for adoption: resource-wise, implementation-wise, and benchmark-wise.
We develop an open-source library that provides workflow fundamentals familiar to the offline reinforcement learning community.
arXiv Detail & Related papers (2023-06-14T22:50:25Z) - SequeL: A Continual Learning Library in PyTorch and JAX [50.33956216274694]
SequeL is a library for Continual Learning that supports both PyTorch and JAX frameworks.
It provides a unified interface for a wide range of Continual Learning algorithms, including regularization-based approaches, replay-based approaches, and hybrid approaches.
We release SequeL as an open-source library, enabling researchers and developers to easily experiment and extend the library for their own purposes.
arXiv Detail & Related papers (2023-04-21T10:00:22Z) - TSFEDL: A Python Library for Time Series Spatio-Temporal Feature
Extraction and Prediction using Deep Learning (with Appendices on Detailed
Network Architectures and Experimental Cases of Study) [9.445070013080601]
The TSFE library is built upon a set offlow+Keras and PyTorch modules under the AGPLv3 license.
The performance validation of the architectures included in this proposal confirms the usefulness of this Python package.
arXiv Detail & Related papers (2022-06-07T10:58:33Z) - APP: Anytime Progressive Pruning [104.36308667437397]
We propose a novel way of training a neural network with a target sparsity in a particular case of online learning: the anytime learning at macroscale paradigm (ALMA)
The proposed approach significantly outperforms the baseline dense and Anytime OSP models across multiple architectures and datasets under short, moderate, and long-sequence training.
arXiv Detail & Related papers (2022-04-04T16:38:55Z) - Online Continual Learning with Natural Distribution Shifts: An Empirical
Study with Visual Data [101.6195176510611]
"Online" continual learning enables evaluating both information retention and online learning efficacy.
In online continual learning, each incoming small batch of data is first used for testing and then added to the training set, making the problem truly online.
We introduce a new benchmark for online continual visual learning that exhibits large scale and natural distribution shifts.
arXiv Detail & Related papers (2021-08-20T06:17:20Z) - Solo-learn: A Library of Self-supervised Methods for Visual
Representation Learning [83.02597612195966]
solo-learn is a library of self-supervised methods for visual representation learning.
Implemented in Python, using Pytorch and Pytorch lightning, the library fits both research and industry needs.
arXiv Detail & Related papers (2021-08-03T22:19:55Z) - OpTorch: Optimized deep learning architectures for resource limited
environments [1.5736899098702972]
We propose optimized deep learning pipelines in multiple aspects of training including time and memory.
OpTorch is a machine learning library designed to overcome weaknesses in existing implementations of neural network training.
arXiv Detail & Related papers (2021-05-03T03:58:57Z) - Avalanche: an End-to-End Library for Continual Learning [81.84325803942811]
We propose Avalanche, an open-source library for continual learning research based on PyTorch.
Avalanche is designed to provide a shared and collaborative for fast prototyping, training, and reproducible evaluation of continual learning algorithms.
arXiv Detail & Related papers (2021-04-01T11:31:46Z) - A Fortran-Keras Deep Learning Bridge for Scientific Computing [6.768544973019004]
We introduce a software library, the Fortran-Keras Bridge (FKB)
The paper describes several unique features offered by FKB, such as customizable layers, loss functions, and network ensembles.
The paper concludes with a case study that applies FKB to address open questions about the robustness of an experimental approach to global climate simulation.
arXiv Detail & Related papers (2020-04-14T15:10:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.