Microscopy is All You Need

• URL: http://arxiv.org/abs/2210.06526v1
• Date: Wed, 12 Oct 2022 18:41:40 GMT
• Title: Microscopy is All You Need
• Authors: Sergei V. Kalinin, Rama Vasudevan, Yongtao Liu, Ayana Ghosh, Kevin Roccapriore, and Maxim Ziatdinov
• Abstract summary: We argue that a promising pathway for the development of machine learning methods is via the route of domain-specific deployable algorithms. This will benefit both fundamental physical studies and serve as a test bed for more complex autonomous systems such as robotics and manufacturing.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We pose that microscopy offers an ideal real-world experimental environment for the development and deployment of active Bayesian and reinforcement learning methods. Indeed, the tremendous progress achieved by machine learning (ML) and artificial intelligence over the last decade has been largely achieved via the utilization of static data sets, from the paradigmatic MNIST to the bespoke corpora of text and image data used to train large models such as GPT3, DALLE and others. However, it is now recognized that continuous, minute improvements to state-of-the-art do not necessarily translate to advances in real-world applications. We argue that a promising pathway for the development of ML methods is via the route of domain-specific deployable algorithms in areas such as electron and scanning probe microscopy and chemical imaging. This will benefit both fundamental physical studies and serve as a test bed for more complex autonomous systems such as robotics and manufacturing. Favorable environment characteristics of scanning and electron microscopy include low risk, extensive availability of domain-specific priors and rewards, relatively small effects of exogeneous variables, and often the presence of both upstream first principles as well as downstream learnable physical models for both statics and dynamics. Recent developments in programmable interfaces, edge computing, and access to APIs facilitating microscope control, all render the deployment of ML codes on operational microscopes straightforward. We discuss these considerations and hope that these arguments will lead to creating a novel set of development targets for the ML community by accelerating both real-world ML applications and scientific progress.

Related papers

• Recent Advances on Machine Learning for Computational Fluid Dynamics: A Survey [51.87875066383221]
  This paper introduces fundamental concepts, traditional methods, and benchmark datasets, then examine the various roles Machine Learning plays in improving CFD. We highlight real-world applications of ML for CFD in critical scientific and engineering disciplines, including aerodynamics, combustion, atmosphere & ocean science, biology fluid, plasma, symbolic regression, and reduced order modeling. We draw the conclusion that ML is poised to significantly transform CFD research by enhancing simulation accuracy, reducing computational time, and enabling more complex analyses of fluid dynamics.
  arXiv  Detail & Related papers  (2024-08-22T07:33:11Z)
• Human-in-the-loop: The future of Machine Learning in Automated Electron Microscopy [0.6760163180787716]
  We discuss some considerations in designing ML-based active experiments. The likely strategy for the next several years will be human-in-the-loop automated experiments.
  arXiv  Detail & Related papers  (2023-10-08T05:26:32Z)
• Deep Learning for Automated Experimentation in Scanning Transmission Electron Microscopy [0.0]
  Machine learning (ML) has become critical for post-acquisition data analysis in () transmission electron microscopy,scanning (S)TEM, imaging and spectroscopy. We discuss the associated challenges with the transition to active ML, including sequential data analysis and out-of-distribution drift effects. These considerations will collectively inform the operationalization of ML in next-generation experimentation.
  arXiv  Detail & Related papers  (2023-04-04T18:01:56Z)
• Machine learning in bioprocess development: From promise to practice [58.720142291102135]
  Data-driven methods like machine learning (ML) approaches have a high potential to rationally explore large design spaces. The aim of this review is to demonstrate how ML methods have been applied so far in bioprocess development.
  arXiv  Detail & Related papers  (2022-10-04T13:48:59Z)
• Towards Augmented Microscopy with Reinforcement Learning-Enhanced Workflows [0.0]
  We develop a virtual environment to test and develop a network to autonomously align the electron beam without prior knowledge. We deploy a successful model on the microscope to validate the approach and demonstrate the value of designing appropriate virtual environments. Overall, the results highlight that by taking advantage of RL, microscope operations can be automated without the need for extensive algorithm design.
  arXiv  Detail & Related papers  (2022-08-04T20:02:21Z)
• Bayesian Active Learning for Scanning Probe Microscopy: from Gaussian Processes to Hypothesis Learning [0.0]
  We discuss the basic principles of Bayesian active learning and illustrate its applications for scanning probe microscopes (SPMs) These frameworks allow for the use of prior data, the discovery of specific functionalities as encoded in spectral data, and exploration of physical laws manifesting during the experiment.
  arXiv  Detail & Related papers  (2022-05-30T23:01:41Z)
• Ultrafast Focus Detection for Automated Microscopy [0.0]
  We present a fast out-of-focus detection algorithm for electron microscopy images collected serially. Our technique, Multi-scale Histologic Feature Detection, adapts classical computer vision techniques and is based on detecting various fine-grained histologic features. Tests are performed that demonstrate near-real-time detection of out-of-focus conditions.
  arXiv  Detail & Related papers  (2021-08-26T22:24:41Z)
• A parameter refinement method for Ptychography based on Deep Learning concepts [55.41644538483948]
  coarse parametrisation in propagation distance, position errors and partial coherence frequently menaces the experiment viability. A modern Deep Learning framework is used to correct autonomously the setup incoherences, thus improving the quality of a ptychography reconstruction. We tested our system on both synthetic datasets and also on real data acquired at the TwinMic beamline of the Elettra synchrotron facility.
  arXiv  Detail & Related papers  (2021-05-18T10:15:17Z)
• Technology Readiness Levels for Machine Learning Systems [107.56979560568232]
  Development and deployment of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end. We have developed a proven systems engineering approach for machine learning development and deployment. Our "Machine Learning Technology Readiness Levels" framework defines a principled process to ensure robust, reliable, and responsible systems.
  arXiv  Detail & Related papers  (2021-01-11T15:54:48Z)
• Towards an Automatic Analysis of CHO-K1 Suspension Growth in Microfluidic Single-cell Cultivation [63.94623495501023]
  We propose a novel Machine Learning architecture, which allows us to infuse a neural deep network with human-powered abstraction on the level of data. Specifically, we train a generative model simultaneously on natural and synthetic data, so that it learns a shared representation, from which a target variable, such as the cell count, can be reliably estimated.
  arXiv  Detail & Related papers  (2020-10-20T08:36:51Z)
• Global Voxel Transformer Networks for Augmented Microscopy [54.730707387866076]
  We introduce global voxel transformer networks (GVTNets), an advanced deep learning tool for augmented microscopy. GVTNets are built on global voxel transformer operators (GVTOs), which are able to aggregate global information. We apply the proposed methods on existing datasets for three different augmented microscopy tasks under various settings.
  arXiv  Detail & Related papers  (2020-08-05T20:11:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.