DBNode: A Decentralized Storage System for Big Data Storage in Consortium Blockchains
- URL: http://arxiv.org/abs/2409.20123v1
- Date: Mon, 30 Sep 2024 09:22:15 GMT
- Title: DBNode: A Decentralized Storage System for Big Data Storage in Consortium Blockchains
- Authors: Narges Dadkhah, Xuyang Ma, Katinka Wolter, Gerhard Wunder,
- Abstract summary: This paper proposes a decentralized storage system for Hyperledger Fabric.
We employ erasure coding to partition files, then organize these chunks into a hierarchical structure.
We design a two-layer hash-slots mechanism and a mirror strategy, enabling high data availability.
- Score: 2.474908349649168
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Storing big data directly on a blockchain poses a substantial burden due to the need to maintain a consistent ledger across all nodes. Numerous studies in decentralized storage systems have been conducted to tackle this particular challenge. Most state-of-the-art research concentrates on developing a general storage system that can accommodate diverse blockchain categories. However, it is essential to recognize the unique attributes of a consortium blockchain, such as data privacy and access control. Beyond ensuring high performance, these specific needs are often overlooked by general storage systems. This paper proposes a decentralized storage system for Hyperledger Fabric, which is a well-known consortium blockchain. First, we employ erasure coding to partition files, subsequently organizing these chunks into a hierarchical structure that fosters efficient and dependable data storage. Second, we design a two-layer hash-slots mechanism and a mirror strategy, enabling high data availability. Third, we design an access control mechanism based on a smart contract to regulate file access.
Related papers
- Integration of blockchain in smart systems: problems and opportunities for real-time sensor data storage [2.0971479389679337]
The internet of things (IoT) and other emerging ubiquitous technologies are supporting the rapid spread of smart systems.
With its inherent decentralization and immutability, blockchain offers itself as a potential solution for these requirements.
However, the practicality of incorporating blockchain into real-time sensor data storage systems is a topic that demands in-depth examination.
arXiv Detail & Related papers (2024-08-12T17:47:32Z) - The Latency Price of Threshold Cryptosystem in Blockchains [52.359230560289745]
We study the interplay between threshold cryptography and a class of blockchains that use Byzantine-fault tolerant (BFT) consensus protocols.
Existing approaches for threshold cryptosystems introduce a latency overhead of at least one message delay for running the threshold cryptographic protocol.
We propose a mechanism to eliminate this overhead for blockchain-native threshold cryptosystems with tight thresholds.
arXiv Detail & Related papers (2024-07-16T20:53:04Z) - Private Blockchain-based Procurement and Asset Management System with QR Code [0.0]
The developed system aims to incorporate a private blockchain technology in the procurement process for the supply office.
The procurement process includes the canvassing, purchasing, delivery and inspection of items, inventory, and disposal.
The study recommends the use of private blockchain-based technology with the procurement and asset management system in the supply office.
arXiv Detail & Related papers (2024-07-12T15:27:36Z) - Blockchains for Internet of Things: Fundamentals, Applications, and Challenges [38.29453164670072]
Not every blockchain system is suitable for specific IoT applications.
Public blockchains are not suitable for storing sensitive data.
We explore the blockchain's application in three pivotal IoT areas: edge AI, communications, and healthcare.
arXiv Detail & Related papers (2024-05-08T04:25:57Z) - Enhancing Trust and Privacy in Distributed Networks: A Comprehensive Survey on Blockchain-based Federated Learning [51.13534069758711]
Decentralized approaches like blockchain offer a compelling solution by implementing a consensus mechanism among multiple entities.
Federated Learning (FL) enables participants to collaboratively train models while safeguarding data privacy.
This paper investigates the synergy between blockchain's security features and FL's privacy-preserving model training capabilities.
arXiv Detail & Related papers (2024-03-28T07:08:26Z) - FileDES: A Secure Scalable and Succinct Decentralized Encrypted Storage Network [30.775493810737192]
Decentralized Storage Network (DSN) is an emerging technology that challenges traditional cloud-based storage systems.
We propose FileDES, which incorporates three essential elements: privacy preservation, scalable storage proof, and batch verification.
Our protocol outperforms the others in terms of proof generation/verification efficiency, storage costs, and scalability.
arXiv Detail & Related papers (2024-03-22T06:41:30Z) - Generative AI-enabled Blockchain Networks: Fundamentals, Applications,
and Case Study [73.87110604150315]
Generative Artificial Intelligence (GAI) has emerged as a promising solution to address challenges of blockchain technology.
In this paper, we first introduce GAI techniques, outline their applications, and discuss existing solutions for integrating GAI into blockchains.
arXiv Detail & Related papers (2024-01-28T10:46:17Z) - A Scale-out Decentralized Blockchain Ledger System for Web3.0 [5.327844605578174]
This paper proposes EZchain -- a novel decentralized scale-out" ledger system designed for web3.0.
Without compromising security and decentralization, EZchain successfully accomplishes the following milestones.
arXiv Detail & Related papers (2023-12-01T01:34:48Z) - When Quantum Information Technologies Meet Blockchain in Web 3.0 [86.91054991998273]
We introduce a quantum blockchain-driven Web 3.0 framework that provides information-theoretic security for decentralized data transferring and payment transactions.
We discuss the potential applications and challenges of implementing quantum blockchain in Web 3.0.
arXiv Detail & Related papers (2022-11-29T05:38:42Z) - Analysis of Arbitrary Content on Blockchain-Based Systems using BigQuery [0.0]
We develop and apply a cloud-based approach for quickly discovering and classifying content on public blockchains.
Our method can be adapted to different blockchain systems and offers insights into content-related usage patterns and potential cases of abuse.
To the best of our knowledge, the presented study is the first to systematically analyze non-financial content stored on the blockchain.
arXiv Detail & Related papers (2022-03-17T15:12:38Z) - Quantum-resistance in blockchain networks [46.63333997460008]
This paper describes the work carried out by the Inter-American Development Bank, the IDB Lab, LACChain, Quantum Computing (CQC), and Tecnologico de Monterrey to identify and eliminate quantum threats in blockchain networks.
The advent of quantum computing threatens internet protocols and blockchain networks because they utilize non-quantum resistant cryptographic algorithms.
arXiv Detail & Related papers (2021-06-11T23:39:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.