Model Zoos: A Dataset of Diverse Populations of Neural Network Models
- URL: http://arxiv.org/abs/2209.14764v1
- Date: Thu, 29 Sep 2022 13:20:42 GMT
- Title: Model Zoos: A Dataset of Diverse Populations of Neural Network Models
- Authors: Konstantin Sch\"urholt, Diyar Taskiran, Boris Knyazev, Xavier
Gir\'o-i-Nieto, Damian Borth
- Abstract summary: We publish a novel dataset of model zoos containing systematically generated and diverse populations of neural network models.
The dataset can be found at www.modelzoos.cc.
- Score: 2.7167743929103363
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In the last years, neural networks (NN) have evolved from laboratory
environments to the state-of-the-art for many real-world problems. It was shown
that NN models (i.e., their weights and biases) evolve on unique trajectories
in weight space during training. Following, a population of such neural network
models (referred to as model zoo) would form structures in weight space. We
think that the geometry, curvature and smoothness of these structures contain
information about the state of training and can reveal latent properties of
individual models. With such model zoos, one could investigate novel approaches
for (i) model analysis, (ii) discover unknown learning dynamics, (iii) learn
rich representations of such populations, or (iv) exploit the model zoos for
generative modelling of NN weights and biases. Unfortunately, the lack of
standardized model zoos and available benchmarks significantly increases the
friction for further research about populations of NNs. With this work, we
publish a novel dataset of model zoos containing systematically generated and
diverse populations of NN models for further research. In total the proposed
model zoo dataset is based on eight image datasets, consists of 27 model zoos
trained with varying hyperparameter combinations and includes 50'360 unique NN
models as well as their sparsified twins, resulting in over 3'844'360 collected
model states. Additionally, to the model zoo data we provide an in-depth
analysis of the zoos and provide benchmarks for multiple downstream tasks. The
dataset can be found at www.modelzoos.cc.
Related papers
- Model Selection with Model Zoo via Graph Learning [45.30615308692713]
We introduce TransferGraph, a novel framework that reformulates model selection as a graph learning problem.
We demonstrate TransferGraph's effectiveness in capturing essential model-dataset relationships, yielding up to a 32% improvement in correlation between predicted performance and the actual fine-tuning results compared to the state-of-the-art methods.
arXiv Detail & Related papers (2024-04-05T09:50:00Z) - Learning the 3D Fauna of the Web [70.01196719128912]
We develop 3D-Fauna, an approach that learns a pan-category deformable 3D animal model for more than 100 animal species jointly.
One crucial bottleneck of modeling animals is the limited availability of training data.
We show that prior category-specific attempts fail to generalize to rare species with limited training images.
arXiv Detail & Related papers (2024-01-04T18:32:48Z) - Hyper-Representations as Generative Models: Sampling Unseen Neural
Network Weights [2.9678808525128813]
We extend hyper-representations for generative use to sample new model weights.
Our results indicate the potential of knowledge aggregation from model zoos to new models via hyper-representations.
arXiv Detail & Related papers (2022-09-29T12:53:58Z) - Hyper-Representations for Pre-Training and Transfer Learning [2.9678808525128813]
We extend hyper-representations for generative use to sample new model weights as pre-training.
Our results indicate the potential of knowledge aggregation from model zoos to new models via hyper-representations.
arXiv Detail & Related papers (2022-07-22T09:01:21Z) - Towards automatic detection of wildlife trade using machine vision
models [0.0]
An important part of the trade now occurs on the internet, especially on digital marketplaces and social media.
Here, we developed machine vision models based on Deep Neural Networks with the aim to automatically identify images of exotic pet animals for sale.
We trained 24 neural-net models spanning a combination of five different architectures, three methods of training and two types of datasets.
arXiv Detail & Related papers (2022-05-23T14:11:16Z) - Learning Multi-Object Dynamics with Compositional Neural Radiance Fields [63.424469458529906]
We present a method to learn compositional predictive models from image observations based on implicit object encoders, Neural Radiance Fields (NeRFs), and graph neural networks.
NeRFs have become a popular choice for representing scenes due to their strong 3D prior.
For planning, we utilize RRTs in the learned latent space, where we can exploit our model and the implicit object encoder to make sampling the latent space informative and more efficient.
arXiv Detail & Related papers (2022-02-24T01:31:29Z) - Mixed Effects Neural ODE: A Variational Approximation for Analyzing the
Dynamics of Panel Data [50.23363975709122]
We propose a probabilistic model called ME-NODE to incorporate (fixed + random) mixed effects for analyzing panel data.
We show that our model can be derived using smooth approximations of SDEs provided by the Wong-Zakai theorem.
We then derive Evidence Based Lower Bounds for ME-NODE, and develop (efficient) training algorithms.
arXiv Detail & Related papers (2022-02-18T22:41:51Z) - Coarse-to-fine Animal Pose and Shape Estimation [67.39635503744395]
We propose a coarse-to-fine approach to reconstruct 3D animal mesh from a single image.
The coarse estimation stage first estimates the pose, shape and translation parameters of the SMAL model.
The estimated meshes are then used as a starting point by a graph convolutional network (GCN) to predict a per-vertex deformation in the refinement stage.
arXiv Detail & Related papers (2021-11-16T01:27:20Z) - The Neural Coding Framework for Learning Generative Models [91.0357317238509]
We propose a novel neural generative model inspired by the theory of predictive processing in the brain.
In a similar way, artificial neurons in our generative model predict what neighboring neurons will do, and adjust their parameters based on how well the predictions matched reality.
arXiv Detail & Related papers (2020-12-07T01:20:38Z) - Deformation-aware Unpaired Image Translation for Pose Estimation on
Laboratory Animals [56.65062746564091]
We aim to capture the pose of neuroscience model organisms, without using any manual supervision, to study how neural circuits orchestrate behaviour.
Our key contribution is the explicit and independent modeling of appearance, shape and poses in an unpaired image translation framework.
We demonstrate improved pose estimation accuracy on Drosophila melanogaster (fruit fly), Caenorhabditis elegans (worm) and Danio rerio (zebrafish)
arXiv Detail & Related papers (2020-01-23T15:34:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.