Rapid detection of soil carbonates by means of NIR spectroscopy, deep learning methods and phase quantification by powder Xray diffraction

• URL: http://arxiv.org/abs/2307.12341v1
• Date: Sun, 23 Jul 2023 14:32:07 GMT
• Title: Rapid detection of soil carbonates by means of NIR spectroscopy, deep learning methods and phase quantification by powder Xray diffraction
• Authors: Lykourgos Chiniadis, Petros Tamvakis
• Abstract summary: We propose a rapid and efficient way to predict carbonates content in soil by means of FT NIR spectroscopy and by use of deep learning methods. We exploited multiple machine learning methods, such as: 1) a Regressor and 2) a CNN and compare their performance with other traditional ML algorithms.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Soil NIR spectral absorbance/reflectance libraries are utilized towards improving agricultural production and analysis of soil properties which are key prerequisite for agroecological balance and environmental sustainability. Carbonates in particular, represent a soil property which is mostly affected even by mild, let alone extreme, changes of environmental conditions during climate change. In this study we propose a rapid and efficient way to predict carbonates content in soil by means of FT NIR reflectance spectroscopy and by use of deep learning methods. We exploited multiple machine learning methods, such as: 1) a MLP Regressor and 2) a CNN and compare their performance with other traditional ML algorithms such as PLSR, Cubist and SVM on the combined dataset of two NIR spectral libraries: KSSL (USDA), a dataset of soil samples reflectance spectra collected nationwide, and LUCAS TopSoil (European Soil Library) which contains soil sample absorbance spectra from all over the European Union, and use them to predict carbonate content on never before seen soil samples. Soil samples in KSSL and in TopSoil spectral libraries were acquired in the spectral region of visNIR, however in this study, only the NIR spectral region was utilized. Quantification of carbonates by means of Xray Diffraction is in good agreement with the volumetric method and the MLP prediction. Our work contributes to rapid carbonates content prediction in soil samples in cases where: 1) no volumetric method is available and 2) only NIR spectra absorbance data are available. Up till now and to the best of our knowledge, there exists no other study, that presents a prediction model trained on such an extensive dataset with such promising results on unseen data, undoubtedly supporting the notion that deep learning models present excellent prediction tools for soil carbonates content.

Related papers

• A text-based, generative deep learning model for soil reflectance spectrum simulation in the VIS-NIR (400-2499 nm) bands [1.6114012813668932]
  This paper presents a data-driven soil optics generative model (SOGM) for simulation of soil reflectance spectra based on soil property inputs. The model is trained on an extensive dataset comprising nearly 180,000 soil spectra-property pairs from 17 datasets. It can be easily integrated with soil-plant radiation model used for remote sensin research like PROSAIL.
  arXiv  Detail & Related papers  (2024-05-02T07:34:12Z)
• Soil Fertility Prediction Using Combined USB-microscope Based Soil Image, Auxiliary Variables, and Portable X-Ray Fluorescence Spectrometry [3.431158134976364]
  The research combined color and texture features from microscopic soil images, PXRF data, and auxiliary soil variables (AVs) using a Random Forest model. Results indicated that integrating image features (IFs) with auxiliary variables (AVs) significantly enhanced prediction accuracy for available B. A data fusion approach, incorporating IFs, AVs, and PXRF data, further improved predictions for available Mn and SAI with R2 values of 0.72 and 0.70, respectively.
  arXiv  Detail & Related papers  (2024-04-17T17:57:20Z)
• Inferring Atmospheric Properties of Exoplanets with Flow Matching and Neural Importance Sampling [10.847353970405285]
  Atmospheric retrievals characterize exoplanets by estimating atmospheric parameters from observed light spectra. Traditional approaches such as nested sampling are computationally expensive, sparking an interest in solutions based on machine learning (ML) We first explore flow matching posterior estimation (FMPE) as a new ML-based method for AR and find that, in our case, it is more accurate than neural posterior estimation (NPE) We then combine both FMPE and NPE with importance sampling, in which case both methods outperform nested sampling in terms of accuracy and simulation efficiency.
  arXiv  Detail & Related papers  (2023-12-13T17:12:03Z)
• Hodge-Aware Contrastive Learning [101.56637264703058]
  Simplicial complexes prove effective in modeling data with multiway dependencies. We develop a contrastive self-supervised learning approach for processing simplicial data.
  arXiv  Detail & Related papers  (2023-09-14T00:40:07Z)
• Closing the loop: Autonomous experiments enabled by machine-learning-based online data analysis in synchrotron beamline environments [80.49514665620008]
  Machine learning can be used to enhance research involving large or rapidly generated datasets. In this study, we describe the incorporation of ML into a closed-loop workflow for X-ray reflectometry (XRR) We present solutions that provide an elementary data analysis in real time during the experiment without introducing the additional software dependencies in the beamline control software environment.
  arXiv  Detail & Related papers  (2023-06-20T21:21:19Z)
• Deep Learning Models of the Discrete Component of the Galactic Interstellar Gamma-Ray Emission [61.26321023273399]
  A significant point-like component from the small scale (or discrete) structure in the H2 interstellar gas might be present in the Fermi-LAT data. We show that deep learning may be effectively employed to model the gamma-ray emission traced by these rare H2 proxies within statistical significance in data-rich regions.
  arXiv  Detail & Related papers  (2022-06-06T18:00:07Z)
• Unsupervised Machine Learning for Exploratory Data Analysis of Exoplanet Transmission Spectra [68.8204255655161]
  We focus on unsupervised techniques for analyzing spectral data from transiting exoplanets. We show that there is a high degree of correlation in the spectral data, which calls for appropriate low-dimensional representations. We uncover interesting structures in the principal component basis, namely, well-defined branches corresponding to different chemical regimes.
  arXiv  Detail & Related papers  (2022-01-07T22:26:33Z)
• Unsupervised Spectral Unmixing For Telluric Correction Using A Neural Network Autoencoder [58.720142291102135]
  We present a neural network autoencoder approach for extracting a telluric transmission spectrum from a large set of high-precision observed solar spectra from the HARPS-N radial velocity spectrograph.
  arXiv  Detail & Related papers  (2021-11-17T12:54:48Z)
• Estimating Crop Primary Productivity with Sentinel-2 and Landsat 8 using Machine Learning Methods Trained with Radiative Transfer Simulations [58.17039841385472]
  We take advantage of all parallel developments in mechanistic modeling and satellite data availability for advanced monitoring of crop productivity. Our model successfully estimates gross primary productivity across a variety of C3 crop types and environmental conditions even though it does not use any local information from the corresponding sites. This highlights its potential to map crop productivity from new satellite sensors at a global scale with the help of current Earth observation cloud computing platforms.
  arXiv  Detail & Related papers  (2020-12-07T16:23:13Z)
• Retrieval of aboveground crop nitrogen content with a hybrid machine learning method [5.6740282691255075]
  Hyperspectral acquisitions have proven to be the most informative Earth observation data source for estimation of nitrogen (N) content. In the past, empirical algorithms have been widely employed to retrieve information on this biochemical plant component from canopy reflectance. Our study presents a hybrid retrieval method using a physically-based approach combined with machine learning regression to estimate crop N content.
  arXiv  Detail & Related papers  (2020-12-07T13:06:59Z)
• Cycle-StarNet: Bridging the gap between theory and data by leveraging large datasets [0.0]
  Current automated methods for analyzing spectra are either (a) data-driven, which requires prior knowledge of stellar parameters and elemental abundances, or (b) based on theoretical synthetic models that are susceptible to the gap between theory and practice. We present a hybrid generative domain adaptation method that turns simulated stellar spectra into realistic spectra by applying unsupervised learning to large spectroscopic surveys.
  arXiv  Detail & Related papers  (2020-07-06T23:06:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.