OmniFed: A Modular Framework for Configurable Federated Learning from Edge to HPC
- URL: http://arxiv.org/abs/2509.19396v1
- Date: Tue, 23 Sep 2025 03:40:22 GMT
- Title: OmniFed: A Modular Framework for Configurable Federated Learning from Edge to HPC
- Abstract summary: We present OmniFed, a modular framework designed around decoupling and clear separation of concerns for configuration, orchestration, communication, and training logic.<n>Its architecture supports configuration-driven prototyping and code-level override-what-you-need customization.<n>We also support different topologies, mixed communication protocols within a single deployment, and popular training algorithms.
- Score: 4.221579336040247
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Federated Learning (FL) is critical for edge and High Performance Computing (HPC) where data is not centralized and privacy is crucial. We present OmniFed, a modular framework designed around decoupling and clear separation of concerns for configuration, orchestration, communication, and training logic. Its architecture supports configuration-driven prototyping and code-level override-what-you-need customization. We also support different topologies, mixed communication protocols within a single deployment, and popular training algorithms. It also offers optional privacy mechanisms including Differential Privacy (DP), Homomorphic Encryption (HE), and Secure Aggregation (SA), as well as compression strategies. These capabilities are exposed through well-defined extension points, allowing users to customize topology and orchestration, learning logic, and privacy/compression plugins, all while preserving the integrity of the core system. We evaluate multiple models and algorithms to measure various performance metrics. By unifying topology configuration, mixed-protocol communication, and pluggable modules in one stack, OmniFed streamlines FL deployment across heterogeneous environments. Github repository is available at https://github.com/at-aaims/OmniFed.
Related papers
- Dual-Grained Agent Memory and Shapley Context Attribution for Multimodal Agentic Learner [55.80248281761638]
multimodal large language models (MLLMs) deliver impressive perception yet still falter on scientific and mathematical reasoning.<n>We propose DG-Mem, a dual-grained agentic memory framework that augments a frozen MLLM with a non- externally stored memory built once from training-time rollouts and consulted read-only at test time.
arXiv Detail & Related papers (2026-08-24T13:56:01Z) - MetaInfer: A Knowledge Only LLM Inference Engine Generator SKILL Toolbox [0.3581211034057412]
This paper presents metainfer, an 'LLM-as-Compiler' approach in which users specify only the runtime constraints of an inference program.<n>An LLM-driven multi-agent collaboration system, coupled with a contract knowledge base, then automatically generates a compact customized inference framework.
arXiv Detail & Related papers (2026-07-14T15:22:48Z) - PymooLab: An Open-Source Visual Analytics Framework for Multi-Objective Optimization using LLM-Based Code Generation and MCDM [0.0]
PymooLab is an open-source visual analytics environment built on top of textitpymoo.<n>It unifies configuration, execution monitoring, and formal decision support in a single reproducible workflow.<n>For computationally intensive studies, PymooLab relies on the native textitpymoo acceleration pathway through JAX.
arXiv Detail & Related papers (2026-03-02T00:56:32Z) - Theory of Code Space: Do Code Agents Understand Software Architecture? [0.0]
Theory of Code Space (ToCS) is a benchmark that evaluates ability to construct, maintain, and update coherent architectural beliefs.<n>ToCS requires agents to build structured belief states over module dependencies.<n>Preliminary Architectural Constraint Discovery is a code-specific evaluation.
arXiv Detail & Related papers (2026-02-28T11:40:17Z) - ARM: A Learnable, Plug-and-Play Module for CLIP-based Open-vocabulary Semantic Segmentation [11.04143971119602]
Open-vocabulary semantic segmentation (OVSS) is fundamentally hampered by the coarse, image-level representations of CLIP.<n>We propose the Attention Refinement Module (ARM), a lightweight, learnable module that effectively unlocks CLIP's internal potential.<n> ARM consistently boosts baseline performance on multiple benchmarks with negligible inference overhead.
arXiv Detail & Related papers (2025-12-30T13:38:30Z) - HiPerformer: A High-Performance Global-Local Segmentation Model with Modular Hierarchical Fusion Strategy [14.223063820829047]
Both local details and global context are crucial in medical image segmentation, and effectively integrating them is essential for achieving high accuracy.<n>We propose HiPerformer, a novel modular hierarchical architecture that fuses multi-source features in parallel.<n>We design a Local-Global Feature Fusion (LGFF) module to achieve precise and efficient integration of local details and global semantic information.<n>Experiments on eleven public datasets demonstrate that the proposed method outperforms existing segmentation techniques.
arXiv Detail & Related papers (2025-09-24T16:15:42Z) - DitHub: A Modular Framework for Incremental Open-Vocabulary Object Detection [32.77455136447568]
We introduce DitHub, a framework designed to build and maintain a library of efficient adaptation modules.<n>Inspired by Version Control Systems, DitHub manages expert modules as branches that can be fetched and merged as needed.<n>Our method achieves state-of-the-art performance on the ODinW-13 benchmark and ODinW-O, a newly introduced benchmark designed to assess class reappearance.
arXiv Detail & Related papers (2025-03-12T11:15:34Z) - Multi-client Functional Encryption for Set Intersection with Non-monotonic Access Structures in Federated Learning [1.2891210250935148]
Federated learning (FL) based on cloud servers is a distributed machine learning framework.<n>We propose a multi-client functional encryption scheme for set intersection with non-monotonic access structures.
arXiv Detail & Related papers (2024-12-12T13:19:12Z) - Mamba-FSCIL: Dynamic Adaptation with Selective State Space Model for Few-Shot Class-Incremental Learning [115.79349923044663]
Few-shot class-incremental learning (FSCIL) aims to incrementally learn novel classes from limited examples.<n>Existing methods face a critical dilemma: static architectures rely on a fixed parameter space to learn from data that arrive sequentially, prone to overfitting to the current session.<n>In this study, we explore the potential of Selective State Space Models (SSMs) for FSCIL.
arXiv Detail & Related papers (2024-07-08T17:09:39Z) - Unlocking the Potential of Prompt-Tuning in Bridging Generalized and
Personalized Federated Learning [49.72857433721424]
Vision Transformers (ViT) and Visual Prompt Tuning (VPT) achieve state-of-the-art performance with improved efficiency in various computer vision tasks.
We present a novel algorithm, SGPT, that integrates Generalized FL (GFL) and Personalized FL (PFL) approaches by employing a unique combination of both shared and group-specific prompts.
arXiv Detail & Related papers (2023-10-27T17:22:09Z) - FedYolo: Augmenting Federated Learning with Pretrained Transformers [61.56476056444933]
In this work, we investigate pretrained transformers (PTF) to achieve on-device learning goals.
We show that larger scale shrinks the accuracy gaps between alternative approaches and improves robustness.
Finally, it enables clients to solve multiple unrelated tasks simultaneously using a single PTF.
arXiv Detail & Related papers (2023-07-10T21:08:52Z) - Scalable Collaborative Learning via Representation Sharing [53.047460465980144]
Federated learning (FL) and Split Learning (SL) are two frameworks that enable collaborative learning while keeping the data private (on device)
In FL, each data holder trains a model locally and releases it to a central server for aggregation.
In SL, the clients must release individual cut-layer activations (smashed data) to the server and wait for its response (during both inference and back propagation).
In this work, we present a novel approach for privacy-preserving machine learning, where the clients collaborate via online knowledge distillation using a contrastive loss.
arXiv Detail & Related papers (2022-11-20T10:49:22Z) - Federated Boosted Decision Trees with Differential Privacy [24.66980518231163]
We propose a general framework that captures and extends existing approaches for differentially private decision trees.
We show that with a careful choice of techniques it is possible to achieve very high utility while maintaining strong levels of privacy.
arXiv Detail & Related papers (2022-10-06T13:28:29Z) - Federated Select: A Primitive for Communication- and Memory-Efficient
Federated Learning [4.873569522869751]
Federated learning (FL) is a framework for machine learning across heterogeneous client devices.
We propose a more general procedure in which clients "select" what values are sent to them.
This allows clients to operate on smaller, data-dependent slices.
arXiv Detail & Related papers (2022-08-19T16:26:03Z) - Privatized Graph Federated Learning [57.14673504239551]
We introduce graph federated learning, which consists of multiple units connected by a graph.
We show how graph homomorphic perturbations can be used to ensure the algorithm is differentially private.
arXiv Detail & Related papers (2022-03-14T13:48:23Z) - AlignSeg: Feature-Aligned Segmentation Networks [109.94809725745499]
We propose Feature-Aligned Networks (AlignSeg) to address misalignment issues during the feature aggregation process.
Our network achieves new state-of-the-art mIoU scores of 82.6% and 45.95%, respectively.
arXiv Detail & Related papers (2020-02-24T10:00:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.