Guiding AI-Generated Digital Content with Wireless Perception
- URL: http://arxiv.org/abs/2303.14624v1
- Date: Sun, 26 Mar 2023 04:39:03 GMT
- Title: Guiding AI-Generated Digital Content with Wireless Perception
- Authors: Jiacheng Wang, Hongyang Du, Dusit Niyato, Zehui Xiong, Jiawen Kang,
Shiwen Mao, and Xuemin (Sherman) Shen
- Abstract summary: We introduce an integration of wireless perception with AI-generated content (AIGC) to improve the quality of digital content production.
The framework employs a novel multi-scale perception technology to read user's posture, which is difficult to describe accurately in words, and transmits it to the AIGC model as skeleton images.
Since the production process imposes the user's posture as a constraint on the AIGC model, it makes the generated content more aligned with the user's requirements.
- Score: 69.51950037942518
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Recent advances in artificial intelligence (AI), coupled with a surge in
training data, have led to the widespread use of AI for digital content
generation, with ChatGPT serving as a representative example. Despite the
increased efficiency and diversity, the inherent instability of AI models poses
a persistent challenge in guiding these models to produce the desired content
for users. In this paper, we introduce an integration of wireless perception
(WP) with AI-generated content (AIGC) and propose a unified WP-AIGC framework
to improve the quality of digital content production. The framework employs a
novel multi-scale perception technology to read user's posture, which is
difficult to describe accurately in words, and transmits it to the AIGC model
as skeleton images. Based on these images and user's service requirements, the
AIGC model generates corresponding digital content. Since the production
process imposes the user's posture as a constraint on the AIGC model, it makes
the generated content more aligned with the user's requirements. Additionally,
WP-AIGC can also accept user's feedback, allowing adjustment of computing
resources at edge server to improve service quality. Experiments results verify
the effectiveness of the WP-AIGC framework, highlighting its potential as a
novel approach for guiding AI models in the accurate generation of digital
content.
Related papers
- Intelligent Mobile AI-Generated Content Services via Interactive Prompt Engineering and Dynamic Service Provisioning [55.641299901038316]
AI-generated content can organize collaborative Mobile AIGC Service Providers (MASPs) at network edges to provide ubiquitous and customized content for resource-constrained users.
Such a paradigm faces two significant challenges: 1) raw prompts often lead to poor generation quality due to users' lack of experience with specific AIGC models, and 2) static service provisioning fails to efficiently utilize computational and communication resources.
We develop an interactive prompt engineering mechanism that leverages a Large Language Model (LLM) to generate customized prompt corpora and employs Inverse Reinforcement Learning (IRL) for policy imitation.
arXiv Detail & Related papers (2025-02-17T03:05:20Z) - XEdgeAI: A Human-centered Industrial Inspection Framework with Data-centric Explainable Edge AI Approach [2.0209172586699173]
This paper introduces a novel XAI-integrated Visual Quality Inspection framework.
Our framework incorporates XAI and the Large Vision Language Model to deliver human-centered interpretability.
This approach paves the way for the broader adoption of reliable and interpretable AI tools in critical industrial applications.
arXiv Detail & Related papers (2024-07-16T14:30:24Z) - Semantic Communications for Artificial Intelligence Generated Content
(AIGC) Toward Effective Content Creation [75.73229320559996]
This paper develops a conceptual model for the integration of AIGC and SemCom.
A novel framework that employs AIGC technology is proposed as an encoder and decoder for semantic information.
The framework can adapt to different types of content generated, the required quality, and the semantic information utilized.
arXiv Detail & Related papers (2023-08-09T13:17:21Z) - Federated Learning-Empowered AI-Generated Content in Wireless Networks [58.48381827268331]
Federated learning (FL) can be leveraged to improve learning efficiency and achieve privacy protection for AIGC.
We present FL-based techniques for empowering AIGC, and aim to enable users to generate diverse, personalized, and high-quality content.
arXiv Detail & Related papers (2023-07-14T04:13:11Z) - AI-Generated Content (AIGC): A Survey [4.108847841902397]
artificial intelligence-generated content (AIGC) has emerged to address the challenges of digital intelligence in the digital economy.
This paper provides an extensive overview of AIGC, covering its definition, essential conditions, cutting-edge capabilities, and advanced features.
arXiv Detail & Related papers (2023-03-26T02:22:12Z) - A Comprehensive Survey of AI-Generated Content (AIGC): A History of
Generative AI from GAN to ChatGPT [63.58711128819828]
ChatGPT and other Generative AI (GAI) techniques belong to the category of Artificial Intelligence Generated Content (AIGC)
The goal of AIGC is to make the content creation process more efficient and accessible, allowing for the production of high-quality content at a faster pace.
arXiv Detail & Related papers (2023-03-07T20:36:13Z) - Enabling AI-Generated Content (AIGC) Services in Wireless Edge Networks [68.00382171900975]
In wireless edge networks, the transmission of incorrectly generated content may unnecessarily consume network resources.
We present the AIGC-as-a-service concept and discuss the challenges in deploying A at the edge networks.
We propose a deep reinforcement learning-enabled algorithm for optimal ASP selection.
arXiv Detail & Related papers (2023-01-09T09:30:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.