Towards Neural Architecture Search for Transfer Learning in 6G Networks

• URL: http://arxiv.org/abs/2406.02333v1
• Date: Tue, 4 Jun 2024 14:01:03 GMT
• Title: Towards Neural Architecture Search for Transfer Learning in 6G Networks
• Authors: Adam Orucu, Farnaz Moradi, Masoumeh Ebrahimi, Andreas Johnsson,
• Abstract summary: We describe and review the state-of-the-art in Neural Architecture Search and Transfer Learning and their applicability in networking. We identify open research challenges and set directions with a specific focus on three main requirements with elements unique to the future network.
• Score: 4.863212763542215
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The future 6G network is envisioned to be AI-native, and as such, ML models will be pervasive in support of optimizing performance, reducing energy consumption, and in coping with increasing complexity and heterogeneity. A key challenge is automating the process of finding optimal model architectures satisfying stringent requirements stemming from varying tasks, dynamicity and available resources in the infrastructure and deployment positions. In this paper, we describe and review the state-of-the-art in Neural Architecture Search and Transfer Learning and their applicability in networking. Further, we identify open research challenges and set directions with a specific focus on three main requirements with elements unique to the future network, namely combining NAS and TL, multi-objective search, and tabular data. Finally, we outline and discuss both near-term and long-term work ahead.

Related papers

• Evolution and Efficiency in Neural Architecture Search: Bridging the Gap Between Expert Design and Automated Optimization [1.7385545432331702]
  The paper provides a comprehensive overview of Neural Architecture Search. It emphasizes its evolution from manual design to automated, computationally-driven approaches. It highlights its application across various domains, including medical imaging and natural language processing.
  arXiv  Detail & Related papers  (2024-02-11T18:27:29Z)
• OTOv3: Automatic Architecture-Agnostic Neural Network Training and Compression from Structured Pruning to Erasing Operators [57.145175475579315]
  This topic spans various techniques, from structured pruning to neural architecture search, encompassing both pruning and erasing operators perspectives. We introduce the third-generation Only-Train-Once (OTOv3), which first automatically trains and compresses a general DNN through pruning and erasing operations. Our empirical results demonstrate the efficacy of OTOv3 across various benchmarks in structured pruning and neural architecture search.
  arXiv  Detail & Related papers  (2023-12-15T00:22:55Z)
• Foundation Model Based Native AI Framework in 6G with Cloud-Edge-End Collaboration [56.330705072736166]
  We propose a 6G native AI framework based on foundation models, provide a customization approach for intent-aware PFM, and outline a novel cloud-edge-end collaboration paradigm. As a practical use case, we apply this framework for orchestration, achieving the maximum sum rate within a wireless communication system.
  arXiv  Detail & Related papers  (2023-10-26T15:19:40Z)
• A Survey on Multi-Objective Neural Architecture Search [9.176056742068813]
  Multi-Objective Neural architecture Search (MONAS) has been attracting attentions. We present an overview of principal and state-of-the-art works in the field of MONAS.
  arXiv  Detail & Related papers  (2023-07-18T09:42:51Z)
• Optimization Design for Federated Learning in Heterogeneous 6G Networks [27.273745760946962]
  Federated learning (FL) is anticipated to be a key enabler for achieving ubiquitous AI in 6G networks. There are several system and statistical heterogeneity challenges for effective and efficient FL implementation in 6G networks. In this article, we investigate the optimization approaches that can effectively address the challenges.
  arXiv  Detail & Related papers  (2023-03-15T02:18:21Z)
• Holistic Network Virtualization and Pervasive Network Intelligence for 6G [14.35331138476144]
  We look into the evolution and prospect of network architecture and propose a novel conceptual architecture for the 6th generation (6G) networks. The proposed architecture has two key elements, i.e., holistic network virtualization and pervasive artificial intelligence (AI) We aim to inspire further discussions and developments on the potential architecture of 6G.
  arXiv  Detail & Related papers  (2023-01-02T04:15:33Z)
• SuperNet in Neural Architecture Search: A Taxonomic Survey [14.037182039950505]
  This survey focuses on the supernet optimization that builds a neural network that assembles all the architectures as its sub models by using weight sharing. We aim to accomplish that by proposing them as solutions to the common challenges found in the literature: data-side optimization, poor rank correlation alleviation, and transferable NAS for a number of deployment scenarios.
  arXiv  Detail & Related papers  (2022-04-08T08:29:52Z)
• Neural Architecture Search for Dense Prediction Tasks in Computer Vision [74.9839082859151]
  Deep learning has led to a rising demand for neural network architecture engineering. neural architecture search (NAS) aims at automatically designing neural network architectures in a data-driven manner rather than manually. NAS has become applicable to a much wider range of problems in computer vision.
  arXiv  Detail & Related papers  (2022-02-15T08:06:50Z)
• A Tutorial on Ultra-Reliable and Low-Latency Communications in 6G: Integrating Domain Knowledge into Deep Learning [115.75967665222635]
  Ultra-reliable and low-latency communications (URLLC) will be central for the development of various emerging mission-critical applications. Deep learning algorithms have been considered as promising ways of developing enabling technologies for URLLC in future 6G networks. This tutorial illustrates how domain knowledge can be integrated into different kinds of deep learning algorithms for URLLC.
  arXiv  Detail & Related papers  (2020-09-13T14:53:01Z)
• Automated Search for Resource-Efficient Branched Multi-Task Networks [81.48051635183916]
  We propose a principled approach, rooted in differentiable neural architecture search, to automatically define branching structures in a multi-task neural network. We show that our approach consistently finds high-performing branching structures within limited resource budgets.
  arXiv  Detail & Related papers  (2020-08-24T09:49:19Z)
• Deep Learning for Ultra-Reliable and Low-Latency Communications in 6G Networks [84.2155885234293]
  We first summarize how to apply data-driven supervised deep learning and deep reinforcement learning in URLLC. To address these open problems, we develop a multi-level architecture that enables device intelligence, edge intelligence, and cloud intelligence for URLLC.
  arXiv  Detail & Related papers  (2020-02-22T14:38:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.