Rock Classification Based on Residual Networks
- URL: http://arxiv.org/abs/2402.11831v1
- Date: Mon, 19 Feb 2024 04:45:15 GMT
- Title: Rock Classification Based on Residual Networks
- Authors: Sining Zhoubian, Yuyang Wang, Zhihuan Jiang
- Abstract summary: We propose two approaches using residual neural networks to tackle the problem of rock classification.
By modifying kernel sizes, normalization methods and composition based on ResNet34, we achieve an accuracy of 70.1% on the test dataset.
Using a similar backbone like BoTNet that incorporates multihead self attention, we additionally use internal residual connections in our model.
This boosts the model's performance, achieving an accuracy of 73.7% on the test dataset.
- Score: 4.256045122451066
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Rock Classification is an essential geological problem since it provides
important formation information. However, exploration on this problem using
convolutional neural networks is not sufficient. To tackle this problem, we
propose two approaches using residual neural networks. We first adopt data
augmentation methods to enlarge our dataset. By modifying kernel sizes,
normalization methods and composition based on ResNet34, we achieve an accuracy
of 70.1% on the test dataset, with an increase of 3.5% compared to regular
Resnet34. Furthermore, using a similar backbone like BoTNet that incorporates
multihead self attention, we additionally use internal residual connections in
our model. This boosts the model's performance, achieving an accuracy of 73.7%
on the test dataset. We also explore how the number of bottleneck transformer
blocks may influence model performance. We discover that models with more than
one bottleneck transformer block may not further improve performance. Finally,
we believe that our approach can inspire future work related to this problem
and our model design can facilitate the development of new residual model
architectures.
Related papers
- Enhancing Rock Image Segmentation in Digital Rock Physics: A Fusion of
Generative AI and State-of-the-Art Neural Networks [5.089732183029123]
In digital rock physics, analysing microstructures from CT and SEM scans is crucial for estimating properties like porosity and pore connectivity.
Traditional segmentation methods like thresholding and CNNs often fall short in accurately detailing rock microstructures and are prone to noise.
U-Net improved segmentation accuracy but required many expert-annotated samples, a laborious and error-prone process due to complex pore shapes.
Our study employed an advanced generative AI model, the diffusion model, to overcome these limitations.
TransU-Net sets a new standard in digital rock physics, paving the way for future geoscience and engineering breakthroughs.
arXiv Detail & Related papers (2023-11-10T14:24:50Z) - On the effectiveness of partial variance reduction in federated learning
with heterogeneous data [27.527995694042506]
We show that the diversity of the final classification layers across clients impedes the performance of the FedAvg algorithm.
Motivated by this, we propose to correct model by variance reduction only on the final layers.
We demonstrate that this significantly outperforms existing benchmarks at a similar or lower communication cost.
arXiv Detail & Related papers (2022-12-05T11:56:35Z) - Part-Based Models Improve Adversarial Robustness [57.699029966800644]
We show that combining human prior knowledge with end-to-end learning can improve the robustness of deep neural networks.
Our model combines a part segmentation model with a tiny classifier and is trained end-to-end to simultaneously segment objects into parts.
Our experiments indicate that these models also reduce texture bias and yield better robustness against common corruptions and spurious correlations.
arXiv Detail & Related papers (2022-09-15T15:41:47Z) - From Environmental Sound Representation to Robustness of 2D CNN Models
Against Adversarial Attacks [82.21746840893658]
This paper investigates the impact of different standard environmental sound representations (spectrograms) on the recognition performance and adversarial attack robustness of a victim residual convolutional neural network.
We show that while the ResNet-18 model trained on DWT spectrograms achieves a high recognition accuracy, attacking this model is relatively more costly for the adversary.
arXiv Detail & Related papers (2022-04-14T15:14:08Z) - Improved Aggregating and Accelerating Training Methods for Spatial Graph
Neural Networks on Fraud Detection [0.0]
This work proposes an improved deep architecture to extend CAmouflage-REsistant GNN (CARE-GNN) to deep models named as Residual Layered CARE-GNN (RLC-GNN)
Three issues of RLC-GNN are the usage of neighboring information reaching limitation, the training difficulty and lack of comprehensive consideration about node features and external patterns.
Experiments are conducted on Yelp and Amazon datasets.
arXiv Detail & Related papers (2022-02-14T09:51:35Z) - Robust lEarned Shrinkage-Thresholding (REST): Robust unrolling for
sparse recover [87.28082715343896]
We consider deep neural networks for solving inverse problems that are robust to forward model mis-specifications.
We design a new robust deep neural network architecture by applying algorithm unfolding techniques to a robust version of the underlying recovery problem.
The proposed REST network is shown to outperform state-of-the-art model-based and data-driven algorithms in both compressive sensing and radar imaging problems.
arXiv Detail & Related papers (2021-10-20T06:15:45Z) - Network Augmentation for Tiny Deep Learning [73.57192520534585]
We introduce Network Augmentation (NetAug), a new training method for improving the performance of tiny neural networks.
We demonstrate the effectiveness of NetAug on image classification and object detection.
arXiv Detail & Related papers (2021-10-17T18:48:41Z) - Densely connected neural networks for nonlinear regression [8.830042935753303]
We propose a novel DenseNet regression model where convolution and pooling layers are replaced by fully connected layers.
The results give an optimal depth (19) and recommend a limited input dimension (under 200).
Ultimately, DenseNet regression is applied to predict relative humidity, and the outcome shows a high correlation (0.91) with observations.
arXiv Detail & Related papers (2021-07-29T03:41:56Z) - Firearm Detection via Convolutional Neural Networks: Comparing a
Semantic Segmentation Model Against End-to-End Solutions [68.8204255655161]
Threat detection of weapons and aggressive behavior from live video can be used for rapid detection and prevention of potentially deadly incidents.
One way for achieving this is through the use of artificial intelligence and, in particular, machine learning for image analysis.
We compare a traditional monolithic end-to-end deep learning model and a previously proposed model based on an ensemble of simpler neural networks detecting fire-weapons via semantic segmentation.
arXiv Detail & Related papers (2020-12-17T15:19:29Z) - From Sound Representation to Model Robustness [82.21746840893658]
We investigate the impact of different standard environmental sound representations (spectrograms) on the recognition performance and adversarial attack robustness of a victim residual convolutional neural network.
Averaged over various experiments on three environmental sound datasets, we found the ResNet-18 model outperforms other deep learning architectures.
arXiv Detail & Related papers (2020-07-27T17:30:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.