Towards Integrated Fine-tuning and Inference when Generative AI meets
Edge Intelligence
- URL: http://arxiv.org/abs/2401.02668v1
- Date: Fri, 5 Jan 2024 06:52:55 GMT
- Title: Towards Integrated Fine-tuning and Inference when Generative AI meets
Edge Intelligence
- Authors: Ning Chen, Zhipeng Cheng, Xuwei Fan, Xiaoyu Xia, and Lianfen Huang
- Abstract summary: High-performance generative artificial intelligence (GAI) represents latest evolution of computational intelligence.
The inevitable encounter between GAI and edge intelligence (EI) can unleash new opportunities.
We propose the GAI-oriented synthetical network (GaisNet) that buffers contradiction leveraging data-free knowledge relay.
- Score: 5.078859563367533
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The high-performance generative artificial intelligence (GAI) represents the
latest evolution of computational intelligence, while the blessing of future 6G
networks also makes edge intelligence (EI) full of development potential. The
inevitable encounter between GAI and EI can unleash new opportunities, where
GAI's pre-training based on massive computing resources and large-scale
unlabeled corpora can provide strong foundational knowledge for EI, while EI
can harness fragmented computing resources to aggregate personalized knowledge
for GAI. However, the natural contradictory features pose significant
challenges to direct knowledge sharing. To address this, in this paper, we
propose the GAI-oriented synthetical network (GaisNet), a collaborative
cloud-edge-end intelligence framework that buffers contradiction leveraging
data-free knowledge relay, where the bidirectional knowledge flow enables GAI's
virtuous-cycle model fine-tuning and task inference, achieving mutualism
between GAI and EI with seamless fusion and collaborative evolution.
Experimental results demonstrate the effectiveness of the proposed mechanisms.
Finally, we discuss the future challenges and directions in the interplay
between GAI and EI.
Related papers
- GIVE: Structured Reasoning with Knowledge Graph Inspired Veracity Extrapolation [108.2008975785364]
Graph Inspired Veracity Extrapolation (GIVE) is a novel reasoning framework that integrates the parametric and non-parametric memories.
Our method facilitates a more logical and step-wise reasoning approach akin to experts' problem-solving, rather than gold answer retrieval.
arXiv Detail & Related papers (2024-10-11T03:05:06Z) - Socialized Learning: A Survey of the Paradigm Shift for Edge Intelligence in Networked Systems [62.252355444948904]
This paper presents the findings of a literature review on the integration of edge intelligence (EI) and socialized learning (SL)
SL is a learning paradigm predicated on social principles and behaviors, aimed at amplifying the collaborative capacity and collective intelligence of agents.
We elaborate on three integrated components: socialized architecture, socialized training, and socialized inference, analyzing their strengths and weaknesses.
arXiv Detail & Related papers (2024-04-20T11:07:29Z) - Agent-driven Generative Semantic Communication with Cross-Modality and Prediction [57.335922373309074]
We propose a novel agent-driven generative semantic communication framework based on reinforcement learning.
In this work, we develop an agent-assisted semantic encoder with cross-modality capability, which can track the semantic changes, channel condition, to perform adaptive semantic extraction and sampling.
The effectiveness of the designed models has been verified using the UA-DETRAC dataset, demonstrating the performance gains of the overall A-GSC framework.
arXiv Detail & Related papers (2024-04-10T13:24:27Z) - Uncertainty Estimation in Multi-Agent Distributed Learning for AI-Enabled Edge Devices [0.0]
Edge IoT devices have seen a paradigm shift with the introduction of FPGAs and AI accelerators.
This advancement has vastly amplified their computational capabilities, emphasizing the practicality of edge AI.
Our study explores methods that enable distributed data processing through AI-enabled edge devices, enhancing collaborative learning capabilities.
arXiv Detail & Related papers (2024-03-14T07:40:32Z) - Generative AI for Secure Physical Layer Communications: A Survey [80.0638227807621]
Generative Artificial Intelligence (GAI) stands at the forefront of AI innovation, demonstrating rapid advancement and unparalleled proficiency in generating diverse content.
In this paper, we offer an extensive survey on the various applications of GAI in enhancing security within the physical layer of communication networks.
We delve into the roles of GAI in addressing challenges of physical layer security, focusing on communication confidentiality, authentication, availability, resilience, and integrity.
arXiv Detail & Related papers (2024-02-21T06:22:41Z) - From Generative AI to Generative Internet of Things: Fundamentals,
Framework, and Outlooks [82.964958051535]
Generative Artificial Intelligence (GAI) possesses the capabilities of generating realistic data and facilitating advanced decision-making.
By integrating GAI into modern Internet of Things (IoT), Generative Internet of Things (GIoT) is emerging and holds immense potential to revolutionize various aspects of society.
arXiv Detail & Related papers (2023-10-27T02:58:11Z) - Towards Artificial General Intelligence (AGI) in the Internet of Things
(IoT): Opportunities and Challenges [55.82853124625841]
Artificial General Intelligence (AGI) possesses the capacity to comprehend, learn, and execute tasks with human cognitive abilities.
This research embarks on an exploration of the opportunities and challenges towards achieving AGI in the context of the Internet of Things.
The application spectrum for AGI-infused IoT is broad, encompassing domains ranging from smart grids, residential environments, manufacturing, and transportation to environmental monitoring, agriculture, healthcare, and education.
arXiv Detail & Related papers (2023-09-14T05:43:36Z) - A Survey on Collaborative DNN Inference for Edge Intelligence [22.691247982285432]
Edge intelligence (EI) becomes a cutting-edge direction in the field of AI.
In this paper, we classify four typical collaborative DNN inference paradigms for EI, and analyze the characteristics and key technologies of them.
arXiv Detail & Related papers (2022-07-16T02:32:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.