fastai: A Layered API for Deep Learning
- URL: http://arxiv.org/abs/2002.04688v2
- Date: Sun, 16 Feb 2020 18:17:51 GMT
- Title: fastai: A Layered API for Deep Learning
- Authors: Jeremy Howard and Sylvain Gugger
- Abstract summary: fastai is a deep learning library which provides practitioners with high-level components.
It provides researchers with low-level components that can be mixed and matched to build new approaches.
- Score: 1.7223564681760164
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: fastai is a deep learning library which provides practitioners with
high-level components that can quickly and easily provide state-of-the-art
results in standard deep learning domains, and provides researchers with
low-level components that can be mixed and matched to build new approaches. It
aims to do both things without substantial compromises in ease of use,
flexibility, or performance. This is possible thanks to a carefully layered
architecture, which expresses common underlying patterns of many deep learning
and data processing techniques in terms of decoupled abstractions. These
abstractions can be expressed concisely and clearly by leveraging the dynamism
of the underlying Python language and the flexibility of the PyTorch library.
fastai includes: a new type dispatch system for Python along with a semantic
type hierarchy for tensors; a GPU-optimized computer vision library which can
be extended in pure Python; an optimizer which refactors out the common
functionality of modern optimizers into two basic pieces, allowing optimization
algorithms to be implemented in 4-5 lines of code; a novel 2-way callback
system that can access any part of the data, model, or optimizer and change it
at any point during training; a new data block API; and much more. We have used
this library to successfully create a complete deep learning course, which we
were able to write more quickly than using previous approaches, and the code
was more clear. The library is already in wide use in research, industry, and
teaching. NB: This paper covers fastai v2, which is currently in pre-release at
http://dev.fast.ai/
Related papers
- SequeL: A Continual Learning Library in PyTorch and JAX [50.33956216274694]
SequeL is a library for Continual Learning that supports both PyTorch and JAX frameworks.
It provides a unified interface for a wide range of Continual Learning algorithms, including regularization-based approaches, replay-based approaches, and hybrid approaches.
We release SequeL as an open-source library, enabling researchers and developers to easily experiment and extend the library for their own purposes.
arXiv Detail & Related papers (2023-04-21T10:00:22Z) - pyGSL: A Graph Structure Learning Toolkit [14.000763778781547]
pyGSL is a Python library that provides efficient implementations of state-of-the-art graph structure learning models.
pyGSL is written in GPU-friendly ways, allowing one to scale to much larger network tasks.
arXiv Detail & Related papers (2022-11-07T14:23:10Z) - CodeRetriever: Unimodal and Bimodal Contrastive Learning [128.06072658302165]
We propose the CodeRetriever model, which combines the unimodal and bimodal contrastive learning to train function-level code semantic representations.
For unimodal contrastive learning, we design a semantic-guided method to build positive code pairs based on the documentation and function name.
For bimodal contrastive learning, we leverage the documentation and in-line comments of code to build text-code pairs.
arXiv Detail & Related papers (2022-01-26T10:54:30Z) - Solo-learn: A Library of Self-supervised Methods for Visual
Representation Learning [83.02597612195966]
solo-learn is a library of self-supervised methods for visual representation learning.
Implemented in Python, using Pytorch and Pytorch lightning, the library fits both research and industry needs.
arXiv Detail & Related papers (2021-08-03T22:19:55Z) - Small-Text: Active Learning for Text Classification in Python [23.87081733039124]
small-text is an easy-to-use active learning library for Python.
It offers pool-based active learning for single- and multi-label text classification.
arXiv Detail & Related papers (2021-07-21T19:23:56Z) - TensorX: Extensible API for Neural Network Model Design and Deployment [0.0]
TensorFlowX is a Python library for prototyping, design, and deployment of complex neural network models in computation.
A special emphasis is put on ease of use, performance, and API consistency.
arXiv Detail & Related papers (2020-12-29T00:15:38Z) - BOML: A Modularized Bilevel Optimization Library in Python for Meta
Learning [52.90643948602659]
BOML is a modularized optimization library that unifies several meta-learning algorithms into a common bilevel optimization framework.
It provides a hierarchical optimization pipeline together with a variety of iteration modules, which can be used to solve the mainstream categories of meta-learning methods.
arXiv Detail & Related papers (2020-09-28T14:21:55Z) - Kernel methods library for pattern analysis and machine learning in
python [0.0]
The kernelmethods library fills that important void in the python ML ecosystem in a domain-agnostic fashion.
The library provides a number of well-defined classes to make various kernel-based operations efficient.
arXiv Detail & Related papers (2020-05-27T16:44:42Z) - Torch-Struct: Deep Structured Prediction Library [138.5262350501951]
We introduce Torch-Struct, a library for structured prediction.
Torch-Struct includes a broad collection of probabilistic structures accessed through a simple and flexible distribution-based API.
arXiv Detail & Related papers (2020-02-03T16:43:02Z) - OPFython: A Python-Inspired Optimum-Path Forest Classifier [68.8204255655161]
This paper proposes a Python-based Optimum-Path Forest framework, denoted as OPFython.
As OPFython is a Python-based library, it provides a more friendly environment and a faster prototyping workspace than the C language.
arXiv Detail & Related papers (2020-01-28T15:46:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.