A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysis

• URL: http://arxiv.org/abs/2506.12263v1
• Date: Fri, 13 Jun 2025 22:28:55 GMT
• Title: A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysis
• Authors: Hui Wei, Dong Yoon Lee, Shubham Rohal, Zhizhang Hu, Shiwei Fang, Shijia Pan,
• Abstract summary: Foundation models have gained growing interest in the IoT domain due to their reduced reliance on labeled data.<n>Most existing foundation model based methods are developed for specific IoT tasks.<n>This survey aims to bridge this gap by providing a comprehensive overview of current methodologies.
• Score: 6.678090066713295
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Foundation models have gained growing interest in the IoT domain due to their reduced reliance on labeled data and strong generalizability across tasks, which address key limitations of traditional machine learning approaches. However, most existing foundation model based methods are developed for specific IoT tasks, making it difficult to compare approaches across IoT domains and limiting guidance for applying them to new tasks. This survey aims to bridge this gap by providing a comprehensive overview of current methodologies and organizing them around four shared performance objectives by different domains: efficiency, context-awareness, safety, and security & privacy. For each objective, we review representative works, summarize commonly-used techniques and evaluation metrics. This objective-centric organization enables meaningful cross-domain comparisons and offers practical insights for selecting and designing foundation model based solutions for new IoT tasks. We conclude with key directions for future research to guide both practitioners and researchers in advancing the use of foundation models in IoT applications.

Related papers

• Generative Representational Learning of Foundation Models for Recommendation [45.88034661002164]
  RecFound is a generative representational learning framework for recommendation foundation models.<n>We construct the first comprehensive dataset for recommendation foundation models covering both generative and embedding tasks.<n> Experiments demonstrate that RecFound achieves state-of-the-art performance across various recommendation tasks.
  arXiv  Detail & Related papers  (2025-06-13T17:54:12Z)
• Enhance Then Search: An Augmentation-Search Strategy with Foundation Models for Cross-Domain Few-Shot Object Detection [13.980798935767558]
  Foundation models pretrained on extensive datasets have performed remarkably in the cross-domain few-shot object detection task.<n>We found that the integration of image-based data augmentation techniques and grid-based sub-domain search strategy significantly enhances the performance of these foundation models.<n>Our findings substantially advance the practical deployment of vision-language models in data-scarce environments.
  arXiv  Detail & Related papers  (2025-04-06T15:30:35Z)
• A Concise Survey on Lane Topology Reasoning for HD Mapping [30.73664953504888]
  Lane topology reasoning techniques play a crucial role in high-definition (HD) mapping and autonomous driving applications.<n>Recent years have witnessed significant advances in this field, but there has been limited effort to consolidate these works into a comprehensive overview.<n>This survey systematically reviews the evolution and current state of lane topology reasoning methods.
  arXiv  Detail & Related papers  (2025-03-31T11:30:40Z)
• GeMID: Generalizable Models for IoT Device Identification [4.029017464832905]
  Device identification (DI) distinguishes IoT devices based on their traffic patterns.<n>Existing approaches to DI that build machine learning models often overlook the challenge of model generalizability across diverse network environments.<n>We propose a novel framework to address this limitation and evaluate the generalizability of DI models across datasets collected within different network environments.
  arXiv  Detail & Related papers  (2024-11-05T17:09:43Z)
• Vision Foundation Models in Remote Sensing: A Survey [6.036426846159163]
  Foundation models are large-scale, pre-trained AI models capable of performing a wide array of tasks with unprecedented accuracy and efficiency.<n>This survey aims to serve as a resource for researchers and practitioners by providing a panorama of advances and promising pathways for continued development and application of foundation models in remote sensing.
  arXiv  Detail & Related papers  (2024-08-06T22:39:34Z)
• Evaluating and Benchmarking Foundation Models for Earth Observation and Geospatial AI [26.986832126456413]
  We focus on the specific Computer Vision application of Foundation Models for Earth Observation (EO) and geospatial AI. We show that for a limited number of labelled data, Foundation Models achieve improved performance compared to problem-specific models. We present the results using our evaluation benchmark for EO Foundation Models and show that Foundation Models are label efficient in the downstream tasks.
  arXiv  Detail & Related papers  (2024-06-26T12:27:06Z)
• A Large-Scale Evaluation of Speech Foundation Models [110.95827399522204]
  We establish the Speech processing Universal PERformance Benchmark (SUPERB) to study the effectiveness of the foundation model paradigm for speech. We propose a unified multi-tasking framework to address speech processing tasks in SUPERB using a frozen foundation model followed by task-specialized, lightweight prediction heads.
  arXiv  Detail & Related papers  (2024-04-15T00:03:16Z)
• Exploring Federated Unlearning: Review, Comparison, and Insights [101.64910079905566]
  federated unlearning enables the selective removal of data from models trained in federated systems.<n>This paper examines existing federated unlearning approaches, examining their algorithmic efficiency, impact on model accuracy, and effectiveness in preserving privacy.<n>We propose the OpenFederatedUnlearning framework, a unified benchmark for evaluating federated unlearning methods.
  arXiv  Detail & Related papers  (2023-10-30T01:34:33Z)
• Instruction Tuning for Large Language Models: A Survey [52.86322823501338]
  We make a systematic review of the literature, including the general methodology of supervised fine-tuning (SFT)<n>We also review the potential pitfalls of SFT along with criticism against it, along with efforts pointing out current deficiencies of existing strategies.
  arXiv  Detail & Related papers  (2023-08-21T15:35:16Z)
• Self-training through Classifier Disagreement for Cross-Domain Opinion Target Extraction [62.41511766918932]
  Opinion target extraction (OTE) or aspect extraction (AE) is a fundamental task in opinion mining. Recent work focus on cross-domain OTE, which is typically encountered in real-world scenarios. We propose a new SSL approach that opts for selecting target samples whose model output from a domain-specific teacher and student network disagrees on the unlabelled target data.
  arXiv  Detail & Related papers  (2023-02-28T16:31:17Z)
• Self-Taught Cross-Domain Few-Shot Learning with Weakly Supervised Object Localization and Task-Decomposition [84.24343796075316]
  We propose a task-expansion-decomposition framework for Cross-Domain Few-Shot Learning. The proposed Self-Taught (ST) approach alleviates the problem of non-target guidance by constructing task-oriented metric spaces. We conduct experiments under the cross-domain setting including 8 target domains: CUB, Cars, Places, Plantae, CropDieases, EuroSAT, ISIC, and ChestX.
  arXiv  Detail & Related papers  (2021-09-03T04:23:07Z)
• Evaluating Federated Learning for Intrusion Detection in Internet of Things: Review and Challenges [0.0]
  Federated Learning (FL) has attracted a significant interest in different sectors, including healthcare and transport systems. We evaluate a FL-enabled IDS approach based on a multiclass classifier considering different data distributions for the detection of different attacks in an IoT scenario. We identify a set of challenges and future directions based on the existing literature and the analysis of our evaluation results.
  arXiv  Detail & Related papers  (2021-08-02T15:22:05Z)
• A Field Guide to Federated Optimization [161.3779046812383]
  Federated learning and analytics are a distributed approach for collaboratively learning models (or statistics) from decentralized data. This paper provides recommendations and guidelines on formulating, designing, evaluating and analyzing federated optimization algorithms.
  arXiv  Detail & Related papers  (2021-07-14T18:09:08Z)
• Edge-assisted Democratized Learning Towards Federated Analytics [67.44078999945722]
  We show the hierarchical learning structure of the proposed edge-assisted democratized learning mechanism, namely Edge-DemLearn. We also validate Edge-DemLearn as a flexible model training mechanism to build a distributed control and aggregation methodology in regions.
  arXiv  Detail & Related papers  (2020-12-01T11:46:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.