Unsupervised machine learning for data-driven rock mass classification: addressing limitations in existing systems using drilling data
- URL: http://arxiv.org/abs/2405.02631v2
- Date: Sat, 23 Nov 2024 12:49:16 GMT
- Title: Unsupervised machine learning for data-driven rock mass classification: addressing limitations in existing systems using drilling data
- Authors: T. F. Hansen, A. Aarset,
- Abstract summary: Rock mass classification systems are crucial for assessing stability and risk in underground construction globally.
We outline these limitations and describe how a data-driven system, based on drilling data, can overcome them.
Using statistical information extracted from thousands of MWD-data values in one-meter sections of a tunnel profile, we demonstrate that well-defined clusters can form a foundational basis for various classification systems.
- Score: 0.0
- License:
- Abstract: Rock mass classification systems are crucial for assessing stability and risk in underground construction globally and guiding support and excavation design. However, these systems, developed primarily in the 1970s, lack access to modern high-resolution data and advanced statistical techniques, limiting their effectiveness as decision-support systems. We outline these limitations and describe how a data-driven system, based on drilling data, can overcome them. Using statistical information extracted from thousands of MWD-data values in one-meter sections of a tunnel profile, acting as a signature of the rock mass, we demonstrate that well-defined clusters can form a foundational basis for various classification systems. Representation learning was used to reduce the dimensionality of 48-value vectors via a nonlinear manifold learning technique (UMAP) and linear principal component analysis (PCA) to enhance clustering. Unsupervised machine learning methods (HDBSCAN, Agglomerative Clustering, K-means) clustered the data, with hyperparameters optimised through multi-objective Bayesian optimisation. Domain knowledge improved clustering by adding extra features to core MWD-data clusters. We structured and correlated these clusters with physical rock properties, including rock type and quality, and analysed cumulative distributions of key MWD-parameters to determine if clusters meaningfully differentiate rock masses. The ability of MWD data to form distinct rock mass clusters suggests substantial potential for future classification systems using this objective, data-driven methodology, minimising human bias.
Related papers
- Self-Supervised Graph Embedding Clustering [70.36328717683297]
K-means one-step dimensionality reduction clustering method has made some progress in addressing the curse of dimensionality in clustering tasks.
We propose a unified framework that integrates manifold learning with K-means, resulting in the self-supervised graph embedding framework.
arXiv Detail & Related papers (2024-09-24T08:59:51Z) - A comparative study on machine learning approaches for rock mass classification using drilling data [0.3749861135832073]
Current rock engineering design in drill and blast tunnelling relies on engineers' observational assessments.
Measure While Drilling (MWD) data, a high-resolution sensor dataset collected during tunnel excavation, is underutilised.
This study aims to automate the translation of MWD data into actionable metrics for rock engineering.
arXiv Detail & Related papers (2024-03-15T15:37:19Z) - Unsupervised Learning for Fault Detection of HVAC Systems: An OPTICS
-based Approach for Terminal Air Handling Units [1.0878040851638]
This study introduces an unsupervised learning strategy to detect faults in terminal air handling units and their associated systems.
The methodology involves pre-processing historical sensor data using Principal Component Analysis to streamline dimensions.
Results showed that OPTICS consistently surpassed k-means in accuracy across seasons.
arXiv Detail & Related papers (2023-12-18T18:08:54Z) - Robust and Automatic Data Clustering: Dirichlet Process meets
Median-of-Means [18.3248037914529]
We present an efficient and automatic clustering technique by integrating the principles of model-based and centroid-based methodologies.
Statistical guarantees on the upper bound of clustering error suggest the advantages of our proposed method over existing state-of-the-art clustering algorithms.
arXiv Detail & Related papers (2023-11-26T19:01:15Z) - Clustering individuals based on multivariate EMA time-series data [2.0824228840987447]
Ecological Momentary Assessment (EMA) methodological advancements have offered new opportunities to collect time-intensive, repeated and intra-individual measurements.
Advanced machine learning (ML) methods are needed to understand data characteristics and uncover meaningful relationships regarding the underlying complex psychological processes.
arXiv Detail & Related papers (2022-12-02T13:33:36Z) - Deep Clustering: A Comprehensive Survey [53.387957674512585]
Clustering analysis plays an indispensable role in machine learning and data mining.
Deep clustering, which can learn clustering-friendly representations using deep neural networks, has been broadly applied in a wide range of clustering tasks.
Existing surveys for deep clustering mainly focus on the single-view fields and the network architectures, ignoring the complex application scenarios of clustering.
arXiv Detail & Related papers (2022-10-09T02:31:32Z) - Detection and Evaluation of Clusters within Sequential Data [58.720142291102135]
Clustering algorithms for Block Markov Chains possess theoretical optimality guarantees.
In particular, our sequential data is derived from human DNA, written text, animal movement data and financial markets.
It is found that the Block Markov Chain model assumption can indeed produce meaningful insights in exploratory data analyses.
arXiv Detail & Related papers (2022-10-04T15:22:39Z) - A One-shot Framework for Distributed Clustered Learning in Heterogeneous
Environments [54.172993875654015]
The paper proposes a family of communication efficient methods for distributed learning in heterogeneous environments.
One-shot approach, based on local computations at the users and a clustering based aggregation step at the server is shown to provide strong learning guarantees.
For strongly convex problems it is shown that, as long as the number of data points per user is above a threshold, the proposed approach achieves order-optimal mean-squared error rates in terms of the sample size.
arXiv Detail & Related papers (2022-09-22T09:04:10Z) - Enhancing cluster analysis via topological manifold learning [0.3823356975862006]
We show that inferring the topological structure of a dataset before clustering can considerably enhance cluster detection.
We combine manifold learning method UMAP for inferring the topological structure with density-based clustering method DBSCAN.
arXiv Detail & Related papers (2022-07-01T15:53:39Z) - Towards Uncovering the Intrinsic Data Structures for Unsupervised Domain
Adaptation using Structurally Regularized Deep Clustering [119.88565565454378]
Unsupervised domain adaptation (UDA) is to learn classification models that make predictions for unlabeled data on a target domain.
We propose a hybrid model of Structurally Regularized Deep Clustering, which integrates the regularized discriminative clustering of target data with a generative one.
Our proposed H-SRDC outperforms all the existing methods under both the inductive and transductive settings.
arXiv Detail & Related papers (2020-12-08T08:52:00Z) - Scalable Hierarchical Agglomerative Clustering [65.66407726145619]
Existing scalable hierarchical clustering methods sacrifice quality for speed.
We present a scalable, agglomerative method for hierarchical clustering that does not sacrifice quality and scales to billions of data points.
arXiv Detail & Related papers (2020-10-22T15:58:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.