A Meta-Learning Approach to Population-Based Modelling of Structures
- URL: http://arxiv.org/abs/2302.07980v1
- Date: Wed, 15 Feb 2023 23:01:59 GMT
- Title: A Meta-Learning Approach to Population-Based Modelling of Structures
- Authors: G. Tsialiamanis, N. Dervilis, D. J. Wagg, K. Worden
- Abstract summary: A major problem of machine-learning approaches in structural dynamics is the frequent lack of structural data.
Inspired by the recently-emerging field of population-based structural health monitoring, this work attempts to create models that are able to transfer knowledge within populations of structures.
The models trained using meta-learning approaches, are able to outperform conventional machine learning methods regarding inference about structures of the population.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: A major problem of machine-learning approaches in structural dynamics is the
frequent lack of structural data. Inspired by the recently-emerging field of
population-based structural health monitoring (PBSHM), and the use of transfer
learning in this novel field, the current work attempts to create models that
are able to transfer knowledge within populations of structures. The approach
followed here is meta-learning, which is developed with a view to creating
neural network models which are able to exploit knowledge from a population of
various tasks to perform well in newly-presented tasks, with minimal training
and a small number of data samples from the new task. Essentially, the method
attempts to perform transfer learning in an automatic manner within the
population of tasks. For the purposes of population-based structural modelling,
the different tasks refer to different structures. The method is applied here
to a population of simulated structures with a view to predicting their
responses as a function of some environmental parameters. The meta-learning
approach, which is used herein is the model-agnostic meta-learning (MAML)
approach; it is compared to a traditional data-driven modelling approach, that
of Gaussian processes, which is a quite effective alternative when few data
samples are available for a problem. It is observed that the models trained
using meta-learning approaches, are able to outperform conventional machine
learning methods regarding inference about structures of the population, for
which only a small number of samples are available. Moreover, the models prove
to learn part of the physics of the problem, making them more robust than plain
machine-learning algorithms. Another advantage of the methods is that the
structures do not need to be parametrised in order for the knowledge transfer
to be performed.
Related papers
- Learning Low-Dimensional Strain Models of Soft Robots by Looking at the Evolution of Their Shape with Application to Model-Based Control [2.058941610795796]
This paper introduces a streamlined method for learning low-dimensional, physics-based models.
We validate our approach through simulations with various planar soft manipulators.
Thanks to the capability of the method of generating physically compatible models, the learned models can be straightforwardly combined with model-based control policies.
arXiv Detail & Related papers (2024-10-31T18:37:22Z) - PILOT: A Pre-Trained Model-Based Continual Learning Toolbox [71.63186089279218]
This paper introduces a pre-trained model-based continual learning toolbox known as PILOT.
On the one hand, PILOT implements some state-of-the-art class-incremental learning algorithms based on pre-trained models, such as L2P, DualPrompt, and CODA-Prompt.
On the other hand, PILOT fits typical class-incremental learning algorithms within the context of pre-trained models to evaluate their effectiveness.
arXiv Detail & Related papers (2023-09-13T17:55:11Z) - Towards a population-informed approach to the definition of data-driven
models for structural dynamics [0.0]
A population-based scheme is followed here and two different machine-learning algorithms from the meta-learning domain are used.
The algorithms seem to perform as intended and outperform a traditional machine-learning algorithm at approximating the quantities of interest.
arXiv Detail & Related papers (2023-07-19T09:45:41Z) - Generalization Properties of Retrieval-based Models [50.35325326050263]
Retrieval-based machine learning methods have enjoyed success on a wide range of problems.
Despite growing literature showcasing the promise of these models, the theoretical underpinning for such models remains underexplored.
We present a formal treatment of retrieval-based models to characterize their generalization ability.
arXiv Detail & Related papers (2022-10-06T00:33:01Z) - DST: Dynamic Substitute Training for Data-free Black-box Attack [79.61601742693713]
We propose a novel dynamic substitute training attack method to encourage substitute model to learn better and faster from the target model.
We introduce a task-driven graph-based structure information learning constrain to improve the quality of generated training data.
arXiv Detail & Related papers (2022-04-03T02:29:11Z) - Improving Meta-learning for Low-resource Text Classification and
Generation via Memory Imitation [87.98063273826702]
We propose a memory imitation meta-learning (MemIML) method that enhances the model's reliance on support sets for task adaptation.
A theoretical analysis is provided to prove the effectiveness of our method.
arXiv Detail & Related papers (2022-03-22T12:41:55Z) - Mixture of basis for interpretable continual learning with distribution
shifts [1.6114012813668934]
Continual learning in environments with shifting data distributions is a challenging problem with several real-world applications.
We propose a novel approach called mixture of Basismodels (MoB) for addressing this problem setting.
arXiv Detail & Related papers (2022-01-05T22:53:15Z) - Gone Fishing: Neural Active Learning with Fisher Embeddings [55.08537975896764]
There is an increasing need for active learning algorithms that are compatible with deep neural networks.
This article introduces BAIT, a practical representation of tractable, and high-performing active learning algorithm for neural networks.
arXiv Detail & Related papers (2021-06-17T17:26:31Z) - Model-Based Deep Learning [155.063817656602]
Signal processing, communications, and control have traditionally relied on classical statistical modeling techniques.
Deep neural networks (DNNs) use generic architectures which learn to operate from data, and demonstrate excellent performance.
We are interested in hybrid techniques that combine principled mathematical models with data-driven systems to benefit from the advantages of both approaches.
arXiv Detail & Related papers (2020-12-15T16:29:49Z) - A Visual Analytics Framework for Explaining and Diagnosing Transfer
Learning Processes [42.57604833160855]
We present a visual analytics framework for the multi-level exploration of the transfer learning processes when training deep neural networks.
Our framework establishes a multi-aspect design to explain how the learned knowledge from the existing model is transferred into the new learning task when training deep neural networks.
arXiv Detail & Related papers (2020-09-15T05:59:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.