Multimodal Machine Learning for Integrating Heterogeneous Analytical Systems

• URL: http://arxiv.org/abs/2602.00590v1
• Date: Sat, 31 Jan 2026 08:12:43 GMT
• Title: Multimodal Machine Learning for Integrating Heterogeneous Analytical Systems
• Authors: Shun Muroga, Hideaki Nakajima, Taiyo Shimizu, Kazufumi Kobashi, Kenji Hata,
• Abstract summary: We propose a machine learning framework that unifies heterogeneous analytical systems for end-to-end characterization.<n>We show how morphology descriptors are extracted from SEM images and captured curvature, orientation, intersection density, and void geometry.<n>Visualization using radar plots and UMAP reveals clear clustering of CNT films according to crystallinity and entanglements.
• Score: 0.6734447582308918
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Understanding structure-property relationships in complex materials requires integrating complementary measurements across multiple length scales. Here we propose an interpretable "multimodal" machine learning framework that unifies heterogeneous analytical systems for end-to-end characterization, demonstrated on carbon nanotube (CNT) films whose properties are highly sensitive to microstructural variations. Quantitative morphology descriptors are extracted from SEM images via binarization, skeletonization, and network analysis, capturing curvature, orientation, intersection density, and void geometry. These SEM-derived features are fused with Raman indicators of crystallinity/defect states, specific surface area from gas adsorption, and electrical surface resistivity. Multi-dimensional visualization using radar plots and UMAP reveals clear clustering of CNT films according to crystallinity and entanglements. Regression models trained on the multimodal feature set show that nonlinear approaches, particularly XGBoost, achieve the best predictive accuracy under leave-one-out cross-validation. Feature-importance analysis further provides physically meaningful interpretations: surface resistivity is primarily governed by junction-to-junction transport length scales, crystallinity/defect-related metrics, and network connectivity, whereas specific surface area is dominated by intersection density and void size. The proposed multimodal machine learning framework offers a general strategy for data-driven, explainable characterization of complex materials.

Related papers

• Learning ORDER-Aware Multimodal Representations for Composite Materials Design [15.819480337529741]
  We introduce ORDinal-aware imagE-tabulaR alignment (ORDER), a multimodal pretraining framework that establishes ordinality as a core principle for composite material representations.<n>ORDER ensures that materials with similar target properties occupy nearby regions in the latent space, which effectively preserves the continuous nature of composite properties.
  arXiv  Detail & Related papers  (2026-01-23T06:39:01Z)
• SIGMA: Scalable Spectral Insights for LLM Collapse [51.863164847253366]
  We introduce SIGMA (Spectral Inequalities for Gram Matrix Analysis), a unified framework for model collapse.<n>By utilizing benchmarks that deriving and deterministic bounds on the matrix's spectrum, SIGMA provides a mathematically grounded metric to track the contraction of the representation space.<n>We demonstrate that SIGMA effectively captures the transition towards states, offering both theoretical insights into the mechanics of collapse.
  arXiv  Detail & Related papers  (2026-01-06T19:47:11Z)
• Aligned Manifold Property and Topology Point Clouds for Learning Molecular Properties [55.2480439325792]
  This work introduces AMPTCR, a molecular surface representation that combines local quantum-derived scalar fields and custom topological descriptors within an aligned point cloud format.<n>For molecular weight, results confirm that AMPTCR encodes physically meaningful data, with a validation R2 of 0.87.<n>In the bacterial inhibition task, AMPTCR enables both classification and direct regression of E. coli inhibition values.
  arXiv  Detail & Related papers  (2025-07-22T04:35:50Z)
• Explainable Multimodal Machine Learning for Revealing Structure-Property Relationships in Carbon Nanotube Fibers [0.0]
  This study integrates the analysis of diverse data types (multimodal data) using factor analysis for feature extraction with Explainable AI (XAI)<n>This method is a powerful approach to elucidate the mechanisms governing material properties, where multi-stage fabrication conditions and multiscale structures have complex influences.
  arXiv  Detail & Related papers  (2025-02-11T09:29:23Z)
• Orientation-aware interaction-based deep material network in polycrystalline materials modeling [0.0]
  Deep material networks (DMNs) have been proposed as efficient surrogate models, yet they fall short of capturing texture evolution.<n>We propose the orientation-aware interaction-based deep material network (ODMN), which incorporates an orientation-aware mechanism and an interaction mechanism grounded in the Hill-Mandel principle.<n>Our results show that ODMN accurately predicts both mechanical responses and texture evolution under complex plastic deformation, thus expanding the applicability of DMNs to polycrystalline materials.
  arXiv  Detail & Related papers  (2025-02-04T16:25:15Z)
• A POD-TANN approach for the multiscale modeling of materials and macroelement derivation in geomechanics [0.0]
  This paper introduces a novel approach that combines Proper Orthogonal Decomposition (POD) with Thermodynamics-based Artificial Neural Networks (TANN) to capture the macroscopic behavior of complex inelastic systems and derive macroelements in geomechanics. The results indicate that the POD-TANN approach not only offers accuracy reproducing in the studied responses, but also reduces computational costs, making it a practical tool for the multiscale modeling of heterogeneous inelastic geomechanical systems.
  arXiv  Detail & Related papers  (2024-08-13T19:08:56Z)
• IME: Integrating Multi-curvature Shared and Specific Embedding for Temporal Knowledge Graph Completion [97.58125811599383]
  Temporal Knowledge Graphs (TKGs) incorporate a temporal dimension, allowing for a precise capture of the evolution of knowledge. We propose a novel Multi-curvature shared and specific Embedding (IME) model for TKGC tasks. IME incorporates two key properties, namely space-shared property and space-specific property.
  arXiv  Detail & Related papers  (2024-03-28T23:31:25Z)
• PyNanospacing: TEM image processing tool for strain analysis and visualization [0.0]
  This paper develops a Python code for TEM image processing that can handle a wide range of materials. It converts local differences in interplanar spacings into contour maps allowing for a visual representation of lattice expansion and compression. The tool is very generic and can significantly aid in analyzing material properties using TEM images.
  arXiv  Detail & Related papers  (2023-11-27T12:08:46Z)
• Learning Multiscale Consistency for Self-supervised Electron Microscopy Instance Segmentation [48.267001230607306]
  We propose a pretraining framework that enhances multiscale consistency in EM volumes. Our approach leverages a Siamese network architecture, integrating strong and weak data augmentations. It effectively captures voxel and feature consistency, showing promise for learning transferable representations for EM analysis.
  arXiv  Detail & Related papers  (2023-08-19T05:49:13Z)
• Static, dynamic and stability analysis of multi-dimensional functional graded plate with variable thickness using deep neural network [0.0]
  The goal of this paper is to analyze and predict the central deflection, natural frequency, and critical buckling load of the multi-directional functionally graded (FG) plate. The material properties are assumed to vary smoothly and continuously throughout three directions of the plate.
  arXiv  Detail & Related papers  (2023-01-14T11:37:01Z)
• Disentangling multiple scattering with deep learning: application to strain mapping from electron diffraction patterns [48.53244254413104]
  We implement a deep neural network called FCU-Net to invert highly nonlinear electron diffraction patterns into quantitative structure factor images. We trained the FCU-Net using over 200,000 unique dynamical diffraction patterns which include many different combinations of crystal structures. Our simulated diffraction pattern library, implementation of FCU-Net, and trained model weights are freely available in open source repositories.
  arXiv  Detail & Related papers  (2022-02-01T03:53:39Z)
• A deep learning driven pseudospectral PCE based FFT homogenization algorithm for complex microstructures [68.8204255655161]
  It is shown that the proposed method is able to predict central moments of interest while being magnitudes faster to evaluate than traditional approaches. It is shown, that the proposed method is able to predict central moments of interest while being magnitudes faster to evaluate than traditional approaches.
  arXiv  Detail & Related papers  (2021-10-26T07:02:14Z)
• Graph Neural Network for Hamiltonian-Based Material Property Prediction [56.94118357003096]
  We present and compare several different graph convolution networks that are able to predict the band gap for inorganic materials. The models are developed to incorporate two different features: the information of each orbital itself and the interaction between each other. The results show that our model can get a promising prediction accuracy with cross-validation.
  arXiv  Detail & Related papers  (2020-05-27T13:32:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.