Implementing a Scalable, Redeployable and Multitiered Repository for FAIR and Secure Scientific Data Sharing: The BIG-MAP Archive

• URL: http://arxiv.org/abs/2512.15815v1
• Date: Wed, 17 Dec 2025 14:15:10 GMT
• Title: Implementing a Scalable, Redeployable and Multitiered Repository for FAIR and Secure Scientific Data Sharing: The BIG-MAP Archive
• Abstract summary: Key technical challenges include creating a scalable architecture, a user-friendly interface, and robust security and access control.<n>The BIG-MAP Archive is a cloud-based, disciplinary, private repository designed to address these challenges.<n>This paper reviews the repository's key features, showing how the BIG-MAP Archive enables secure, controlled data sharing within large consortia.
• Score: 4.201349431355019
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Data sharing in large consortia, such as research collaborations or industry partnerships, requires addressing both organizational and technical challenges. A common platform is essential to promote collaboration, facilitate exchange of findings, and ensure secure access to sensitive data. Key technical challenges include creating a scalable architecture, a user-friendly interface, and robust security and access control. The BIG-MAP Archive is a cloud-based, disciplinary, private repository designed to address these challenges. Built on InvenioRDM, it leverages platform functionalities to meet consortium-specific needs, providing a tailored solution compared to general repositories. Access can be restricted to members of specific communities or open to the entire consortium, such as the BATTERY 2030+, a consortium accelerating advanced battery technologies. Uploaded data and metadata are controlled via fine grained permissions, allowing access to individual project members or the full initiative. The formalized upload process ensures data are formatted and ready for publication in open repositories when needed. This paper reviews the repository's key features, showing how the BIG-MAP Archive enables secure, controlled data sharing within large consortia. It ensures data confidentiality while supporting flexible, permissions-based access and can be easily redeployed for other consortia, including MaterialsCommons4.eu and RAISE (Resource for AI Science in Europe).

Related papers

• OpenHealth Lake: Designing and testing a data lakehouse platform for health applications [0.2539920413471809]
  OpenHealth Lake is a data management prototype platform based on a data lakehouse architecture, data federation, and the FAIR principles.<n>The current prototype platform comprises a user-friendly website, an open API, Python and R packages, allowing users to interact with the platform in multiple ways.
  arXiv  Detail & Related papers  (2026-05-19T14:45:59Z)
• DeepXiv-SDK: An Agentic Data Interface for Scientific Literature [60.19264121557117]
  DeepXiv-SDK is a three-layer agentic data interface for scientific literature.<n>DeepXiv-SDK supports the complete ArXiv corpus, and is synchronized daily to incorporate new releases.
  arXiv  Detail & Related papers  (2026-02-14T23:07:28Z)
• The OpenHands Software Agent SDK: A Composable and Extensible Foundation for Production Agents [46.254487394746725]
  We present the OpenHands Software Agent SDK, a toolkit for implementing software development agents.<n>To achieve flexibility, we design a simple interface for implementing agents that requires only a few lines of code in the default case.<n>For security and reliability, it delivers seamless local-to-remote execution portability, integrated REST/WebSocket services.
  arXiv  Detail & Related papers  (2025-11-05T18:16:44Z)
• LLM-based Multi-Agent Blackboard System for Information Discovery in Data Science [69.1690891731311]
  We propose a novel multi-agent communication paradigm inspired by the blackboard architecture for traditional AI models.<n>In this framework, a central agent posts requests to a shared blackboard, and autonomous subordinate agents respond based on their capabilities.<n>We evaluate our method on three benchmarks that require explicit data discovery.
  arXiv  Detail & Related papers  (2025-09-30T22:34:23Z)
• Access control for Data Spaces [4.265773997354608]
  We design and implement an access control mechanism that ensures continuous evaluation of access control policies.<n>We extend to allow data owners to maintain their own Policy Administration Points.
  arXiv  Detail & Related papers  (2025-04-18T16:09:53Z)
• Digital Asset Data Lakehouse. The concept based on a blockchain research center [0.0]
  This paper introduces a novel software architecture designed to meet the demand for robust, scalable, and secure data management platforms.<n>We detail the architectural design, including its components and interactions, and discuss how it addresses common challenges in managing blockchain data and digital assets.<n>Our results indicate that the proposed architecture not only enhances the efficiency and scalability of distributed data management but also opens new avenues for innovation in the research area.
  arXiv  Detail & Related papers  (2025-03-20T09:12:39Z)
• Balancing Confidentiality and Transparency for Blockchain-based Process-Aware Information Systems [43.253676241213626]
  We propose an architecture for blockchain-based PAISs to preserve confidentiality and transparency.<n>Smart contracts enact, enforce and store public interactions, while attribute-based encryption techniques are adopted to specify access grants to confidential information.<n>We assess the security of our solution through a systematic threat model analysis and evaluate its practical feasibility.
  arXiv  Detail & Related papers  (2024-12-07T20:18:36Z)
• DBNode: A Decentralized Storage System for Big Data Storage in Consortium Blockchains [2.474908349649168]
  This paper proposes a decentralized storage system for Hyperledger Fabric. We employ erasure coding to partition files, then organize these chunks into a hierarchical structure. We design a two-layer hash-slots mechanism and a mirror strategy, enabling high data availability.
  arXiv  Detail & Related papers  (2024-09-30T09:22:15Z)
• FACOS: Enabling Privacy Protection Through Fine-Grained Access Control with On-chain and Off-chain System [11.901770945295391]
  We propose a permissioned blockchain-based privacy-preserving fine-grained access control on-chain and off-chain system, namely FACOS. Compared to similar work that only stores encrypted data in centralized or non-fault-tolerant IPFS systems, we enhanced off-chain data storage security and robustness.
  arXiv  Detail & Related papers  (2024-06-06T02:23:12Z)
• Alibaba LingmaAgent: Improving Automated Issue Resolution via Comprehensive Repository Exploration [64.19431011897515]
  This paper presents Alibaba LingmaAgent, a novel Automated Software Engineering method designed to comprehensively understand and utilize whole software repositories for issue resolution.<n>Our approach introduces a top-down method to condense critical repository information into a knowledge graph, reducing complexity, and employs a Monte Carlo tree search based strategy.<n>In production deployment and evaluation at Alibaba Cloud, LingmaAgent automatically resolved 16.9% of in-house issues faced by development engineers, and solved 43.3% of problems after manual intervention.
  arXiv  Detail & Related papers  (2024-06-03T15:20:06Z)
• Evault for legal records [0.0]
  Lawyers, judges, clients, and even registrars can effortlessly upload and retrieve legal documents, track changes, and share information within the platform. This feature allows users to generate and securely store legal documents, streamlining the entire documentation process.
  arXiv  Detail & Related papers  (2024-03-02T11:56:40Z)
• HasTEE+ : Confidential Cloud Computing and Analytics with Haskell [50.994023665559496]
  Confidential computing enables the protection of confidential code and data in a co-tenanted cloud deployment using specialized hardware isolation units called Trusted Execution Environments (TEEs) TEEs offer low-level C/C++-based toolchains that are susceptible to inherent memory safety vulnerabilities and lack language constructs to monitor explicit and implicit information-flow leaks. We address the above with HasTEE+, a domain-specific language (cla) embedded in Haskell that enables programming TEEs in a high-level language with strong type-safety.
  arXiv  Detail & Related papers  (2024-01-17T00:56:23Z)
• Sparsity-Aware Intelligent Massive Random Access Control in Open RAN: A Reinforcement Learning Based Approach [61.74489383629319]
  Massive random access of devices in the emerging Open Radio Access Network (O-RAN) brings great challenge to the access control and management. reinforcement-learning (RL)-assisted scheme of closed-loop access control is proposed to preserve sparsity of access requests. Deep-RL-assisted SAUD is proposed to resolve highly complex environments with continuous and high-dimensional state and action spaces.
  arXiv  Detail & Related papers  (2023-03-05T12:25:49Z)
• Federated Learning for Open Banking [42.05232310057235]
  In the near future, it is foreseeable to have decentralized data ownership in the finance sector using federated learning. This chapter will discuss the possible challenges for applying federated learning in the context of open banking.
  arXiv  Detail & Related papers  (2021-08-24T14:06:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.