A big data intelligence marketplace and secure analytics experimentation platform for the aviation industry

• URL: http://arxiv.org/abs/2111.09872v1
• Date: Thu, 18 Nov 2021 18:51:40 GMT
• Title: A big data intelligence marketplace and secure analytics experimentation platform for the aviation industry
• Authors: Dimitrios Miltiadou (1), Stamatis Pitsios (1), Dimitrios Spyropoulos (1), Dimitrios Alexandrou (1), Fenareti Lampathaki (2), Domenico Messina (3), Konstantinos Perakis (1) ((1) UBITECH, (2) Suite5, (3) ENGINEERING Ingegneria Informatica S.p.A.)
• Abstract summary: This paper introduces the ICARUS big data-enabled platform that offers a novel aviation data and intelligence marketplace. It holistically handles the complete big data lifecycle from the data collection, data curation and data exploration to the data integration and data analysis.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: The unprecedented volume, diversity and richness of aviation data that can be acquired, generated, stored, and managed provides unique capabilities for the aviation-related industries and pertains value that remains to be unlocked with the adoption of the innovative Big Data Analytics technologies. Despite the large efforts and investments on research and innovation, the Big Data technologies introduce a number of challenges to its adopters. Besides the effective storage and access to the underlying big data, efficient data integration and data interoperability should be considered, while at the same time multiple data sources should be effectively combined by performing data exchange and data sharing between the different stakeholders. However, this reveals additional challenges for the crucial preservation of the information security of the collected data, the trusted and secure data exchange and data sharing, as well as the robust data access control. The current paper aims to introduce the ICARUS big data-enabled platform that aims provide a multi-sided platform that offers a novel aviation data and intelligence marketplace accompanied by a trusted and secure analytics workspace. It holistically handles the complete big data lifecycle from the data collection, data curation and data exploration to the data integration and data analysis of data originating from heterogeneous data sources with different velocity, variety and volume in a trusted and secure manner.

Related papers

• A Survey on Data Markets [73.07800441775814]
  Growing trend of trading data for greater welfare has led to the emergence of data markets. A data market is any mechanism whereby the exchange of data products including datasets and data derivatives takes place. It serves as a coordinating mechanism by which several functions, including the pricing and the distribution of data, interact.
  arXiv  Detail & Related papers  (2024-11-09T15:09:24Z)
• Secure Computation and Trustless Data Intermediaries in Data Spaces [0.44998333629984877]
  This paper explores the integration of advanced cryptographic techniques for secure computation in data spaces. We exploit the introduced secure methods, i.e. Secure Multi-Party Computation (MPC) and Fully Homomorphic Encryption (FHE) We present solutions through real-world use cases, including air traffic management, manufacturing, and secondary data use.
  arXiv  Detail & Related papers  (2024-10-21T19:10:53Z)
• Data Advisor: Dynamic Data Curation for Safety Alignment of Large Language Models [79.65071553905021]
  We propose Data Advisor, a method for generating data that takes into account the characteristics of the desired dataset. Data Advisor monitors the status of the generated data, identifies weaknesses in the current dataset, and advises the next iteration of data generation.
  arXiv  Detail & Related papers  (2024-10-07T17:59:58Z)
• Research and Design of a Financial Intelligent Risk Control Platform Based on Big Data Analysis and Deep Machine Learning [2.766666938196471]
  This article explores how to fully utilize big data technology to achieve complete integration of internal and external data of financial institutions. This article adopts big data mining and real-time streaming data processing technology to monitor, analyze, and alert various business data.
  arXiv  Detail & Related papers  (2024-09-16T14:41:41Z)
• OpenDataLab: Empowering General Artificial Intelligence with Open Datasets [53.22840149601411]
  This paper introduces OpenDataLab, a platform designed to bridge the gap between diverse data sources and the need for unified data processing. OpenDataLab integrates a wide range of open-source AI datasets and enhances data acquisition efficiency through intelligent querying and high-speed downloading services. We anticipate that OpenDataLab will significantly boost artificial general intelligence (AGI) research and facilitate advancements in related AI fields.
  arXiv  Detail & Related papers  (2024-06-04T10:42:01Z)
• Data Acquisition: A New Frontier in Data-centric AI [65.90972015426274]
  We first present an investigation of current data marketplaces, revealing lack of platforms offering detailed information about datasets. We then introduce the DAM challenge, a benchmark to model the interaction between the data providers and acquirers. Our evaluation of the submitted strategies underlines the need for effective data acquisition strategies in Machine Learning.
  arXiv  Detail & Related papers  (2023-11-22T22:15:17Z)
• Outsourcing Training without Uploading Data via Efficient Collaborative Open-Source Sampling [49.87637449243698]
  Traditional outsourcing requires uploading device data to the cloud server. We propose to leverage widely available open-source data, which is a massive dataset collected from public and heterogeneous sources. We develop a novel strategy called Efficient Collaborative Open-source Sampling (ECOS) to construct a proximal proxy dataset from open-source data for cloud training.
  arXiv  Detail & Related papers  (2022-10-23T00:12:18Z)
• DataPerf: Benchmarks for Data-Centric AI Development [81.03754002516862]
  DataPerf is a community-led benchmark suite for evaluating ML datasets and data-centric algorithms. We provide an open, online platform with multiple rounds of challenges to support this iterative development. The benchmarks, online evaluation platform, and baseline implementations are open source.
  arXiv  Detail & Related papers  (2022-07-20T17:47:54Z)
• Designing a Trusted Data Brokerage Framework in the Aviation Domain [0.0]
  ICARUS data policy and assets brokerage framework aims to formalise the data attributes and qualities that affect how aviation data assets can be shared and handled. This involves expressing contractual terms pertaining to data trading agreements into a machine-processable language.
  arXiv  Detail & Related papers  (2021-11-25T23:22:17Z)
• A Secure Experimentation Sandbox for the design and execution of trusted and secure analytics in the aviation domain [0.0]
  ICARUS platform aims to become an 'one-stop shop' for aviation data and intelligence marketplace. Secure Experimentation Sandbox has been designed and integrated in the ICARUS platform offering.
  arXiv  Detail & Related papers  (2021-11-18T18:44:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.