Machine learning for faster and smarter fluorescence lifetime imaging microscopy

• URL: http://arxiv.org/abs/2008.02320v1
• Date: Wed, 5 Aug 2020 18:59:36 GMT
• Title: Machine learning for faster and smarter fluorescence lifetime imaging microscopy
• Authors: Varun Mannam, Yide Zhang, Xiaotong Yuan, Cara Ravasio and Scott S. Howard
• Abstract summary: Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique in biomedical research. At present, the calculation, analysis, and interpretation of FLIM is a complex, slow, and computationally expensive process. Machine learning (ML) techniques are well suited to extract and interpret measurements from multi-dimensional FLIM data sets.
• Score: 16.519888238537003
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique in biomedical research that uses the fluorophore decay rate to provide additional contrast in fluorescence microscopy. However, at present, the calculation, analysis, and interpretation of FLIM is a complex, slow, and computationally expensive process. Machine learning (ML) techniques are well suited to extract and interpret measurements from multi-dimensional FLIM data sets with substantial improvement in speed over conventional methods. In this topical review, we first discuss the basics of FILM and ML. Second, we provide a summary of lifetime extraction strategies using ML and its applications in classifying and segmenting FILM images with higher accuracy compared to conventional methods. Finally, we discuss two potential directions to improve FLIM with ML with proof of concept demonstrations.

Related papers

• Enhancing Fluorescence Lifetime Parameter Estimation Accuracy with Differential Transformer Based Deep Learning Model Incorporating Pixelwise Instrument Response Function [0.3441582801949978]
  We introduce a new DL architecture using state-of-the-art Differential Transformer encoder-decoder architecture, MFliNet. We demonstrate the model's performance through carefully designed, complex tissue-mimicking phantoms and preclinical in-vivo cancer xenograft experiments.
  arXiv  Detail & Related papers  (2024-11-25T20:03:41Z)
• CoMMIT: Coordinated Instruction Tuning for Multimodal Large Language Models [68.64605538559312]
  In this paper, we analyze the MLLM instruction tuning from both theoretical and empirical perspectives. Inspired by our findings, we propose a measurement to quantitatively evaluate the learning balance. In addition, we introduce an auxiliary loss regularization method to promote updating of the generation distribution of MLLMs.
  arXiv  Detail & Related papers  (2024-07-29T23:18:55Z)
• On machine learning analysis of atomic force microscopy images for image classification, sample surface recognition [2.356908851188234]
  Atomic force microscopy (AFM) imaging is one of the best matches with machine learning (ML) analysis among microscopy techniques. The described approach has already been successfully used to analyze and classify the surfaces of biological cells. It can be applied to recognize medical images, specific material processing, in forensic studies, even to identify the authenticity of arts.
  arXiv  Detail & Related papers  (2024-03-24T16:48:10Z)
• Feast Your Eyes: Mixture-of-Resolution Adaptation for Multimodal Large Language Models [84.78513908768011]
  We propose a novel and efficient method for MLLMs, termed Mixture-of-Resolution Adaptation (MRA) MRA adopts two visual pathways for images with different resolutions, where high-resolution visual information is embedded into the low-resolution pathway. To validate MRA, we apply it to a recent MLLM called LLaVA, and term the new model LLaVA-HR.
  arXiv  Detail & Related papers  (2024-03-05T14:31:24Z)
• DB-LLM: Accurate Dual-Binarization for Efficient LLMs [83.70686728471547]
  Large language models (LLMs) have significantly advanced the field of natural language processing. Existing ultra-low-bit quantization always causes severe accuracy drops. We propose a novel Dual-Binarization method for LLMs, namely DB-LLM.
  arXiv  Detail & Related papers  (2024-02-19T09:04:30Z)
• Learned, Uncertainty-driven Adaptive Acquisition for Photon-Efficient Multiphoton Microscopy [12.888922568191422]
  We propose a method to simultaneously denoise and predict pixel-wise uncertainty for multiphoton imaging measurements. We demonstrate our method on experimental noisy MPM measurements of human endometrium tissues. We are the first to demonstrate distribution-free uncertainty quantification for a denoising task with real experimental data.
  arXiv  Detail & Related papers  (2023-10-24T18:06:03Z)
• Fast fluorescence lifetime imaging analysis via extreme learning machine [7.7721777809498676]
  We present a fast and accurate analytical method for fluorescence lifetime imaging microscopy (FLIM) using the extreme learning machine (ELM) Results indicate that ELM can obtain higher fidelity, even in low-photon conditions.
  arXiv  Detail & Related papers  (2022-03-25T16:34:51Z)
• MAML is a Noisy Contrastive Learner [72.04430033118426]
  Model-agnostic meta-learning (MAML) is one of the most popular and widely-adopted meta-learning algorithms nowadays. We provide a new perspective to the working mechanism of MAML and discover that: MAML is analogous to a meta-learner using a supervised contrastive objective function. We propose a simple but effective technique, zeroing trick, to alleviate such interference.
  arXiv  Detail & Related papers  (2021-06-29T12:52:26Z)
• Convolutional Neural Network Denoising in Fluorescence Lifetime Imaging Microscopy (FLIM) [16.558653673949838]
  Fluorescence lifetime imaging microscopy (FLIM) systems are limited by their slow processing speed, low signal-to-noise ratio (SNR), and expensive and challenging hardware setups. In this work, we demonstrate applying a denoising convolutional network to improve FLIM SNR. The network will be integrated with an instant FLIM system with fast data acquisition based on analog signal processing, high SNR using high-efficiency pulse-modulation, and cost-effective implementation utilizing off-the-shelf radio-frequency components.
  arXiv  Detail & Related papers  (2021-03-07T03:27:44Z)
• Machine Learning Force Fields [54.48599172620472]
  Machine Learning (ML) has enabled numerous advances in computational chemistry. One of the most promising applications is the construction of ML-based force fields (FFs) This review gives an overview of applications of ML-FFs and the chemical insights that can be obtained from them.
  arXiv  Detail & Related papers  (2020-10-14T13:14:14Z)
• Hyperspectral-Multispectral Image Fusion with Weighted LASSO [68.04032419397677]
  We propose an approach for fusing hyperspectral and multispectral images to provide high-quality hyperspectral output. We demonstrate that the proposed sparse fusion and reconstruction provides quantitatively superior results when compared to existing methods on publicly available images.
  arXiv  Detail & Related papers  (2020-03-15T23:07:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.