FLAME: Condensing Ensemble Diversity into a Single Network for Efficient Sequential Recommendation

• URL: http://arxiv.org/abs/2604.04038v1
• Date: Sun, 05 Apr 2026 09:41:30 GMT
• Title: FLAME: Condensing Ensemble Diversity into a Single Network for Efficient Sequential Recommendation
• Abstract summary: FLAME is a novel framework that condenses ensemble-level diversity into a single network for efficient sequential recommendation.<n>Experiments on six datasets show that FLAME outperforms state-of-the-art baselines.
• Score: 18.34589545845525
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Sequential recommendation requires capturing diverse user behaviors, which a single network often fails to capture. While ensemble methods mitigate this by leveraging multiple networks, training them all from scratch leads to high computational cost and instability from noisy mutual supervision. We propose {\bf F}rozen and {\bf L}earnable networks with {\bf A}ligned {\bf M}odular {\bf E}nsemble ({\bf FLAME}), a novel framework that condenses ensemble-level diversity into a single network for efficient sequential recommendation. During training, FLAME simulates exponential diversity using only two networks via {\it modular ensemble}. By decomposing each network into sub-modules (e.g., layers or blocks) and dynamically combining them, FLAME generates a rich space of diverse representation patterns. To stabilize this process, we pretrain and freeze one network to serve as a semantic anchor and employ {\it guided mutual learning}. This aligns the diverse representations into the space of the remaining learnable network, ensuring robust optimization. Consequently, at inference, FLAME utilizes only the learnable network, achieving ensemble-level performance with zero overhead compared to a single network. Experiments on six datasets show that FLAME outperforms state-of-the-art baselines, achieving up to 7.69$\times$ faster convergence and 9.70\% improvement in NDCG@20. We provide the source code of FLAME at https://github.com/woo-joo/FLAME_SIGIR26.

Related papers

• FANS: Federated Adaptive Network Search Learning for Heterogeneous Devices [44.62284429272935]
  Heterogeneous Learning (HFL) aims to train models across devices with diverse resource budgets while preserving data privacy.<n>We introduce Federated Adaptive Network Search (FANS), a hypernetwork-based framework that learns a shared architecture space.<n>We evaluate FANS on CIFAR-10, CIFAR-100, and MNLI using ResNet-18, DenseNet-121, and BERT-base, respectively.
  arXiv  Detail & Related papers  (2026-09-05T13:57:56Z)
• QFlowNet: Fast, Diverse, and Efficient Unitary Synthesis with Generative Flow Networks [5.077782193180541]
  Unitary synthesis is a fundamental challenge in quantum compilation.<n>We propose QFlowNet, a framework that learns efficiently from sparse signals by pairing a Generative Flow Network (GFlowNet) with Transformers.
  arXiv  Detail & Related papers  (2026-03-03T14:38:05Z)
• Unrolled Neural Networks for Constrained Optimization [83.29547301151177]
  Our framework comprises two coupled neural networks that jointly approximate the saddle point of the Lagrangian.<n>We numerically evaluate the framework on mixed-integer quadratic programs and power allocation in wireless networks.
  arXiv  Detail & Related papers  (2026-01-24T03:12:41Z)
• Network Fission Ensembles for Low-Cost Self-Ensembles [20.103367702014474]
  We propose a low-cost ensemble learning and inference, called Network Fission Ensembles (NFE)<n>We first prune some of the weights to reduce the training burden.<n>We then group the remaining weights into several sets and create multiple auxiliary paths using each set to construct multi-exits.
  arXiv  Detail & Related papers  (2024-08-05T08:23:59Z)
• Hierarchical Multi-Marginal Optimal Transport for Network Alignment [52.206006379563306]
  Multi-network alignment is an essential prerequisite for joint learning on multiple networks. We propose a hierarchical multi-marginal optimal transport framework named HOT for multi-network alignment. Our proposed HOT achieves significant improvements over the state-of-the-art in both effectiveness and scalability.
  arXiv  Detail & Related papers  (2023-10-06T02:35:35Z)
• SFNet: Faster and Accurate Semantic Segmentation via Semantic Flow [88.97790684009979]
  A common practice to improve the performance is to attain high-resolution feature maps with strong semantic representation. We propose a Flow Alignment Module (FAM) to learn textitSemantic Flow between feature maps of adjacent levels. We also present a novel Gated Dual Flow Alignment Module to directly align high-resolution feature maps and low-resolution feature maps.
  arXiv  Detail & Related papers  (2022-07-10T08:25:47Z)
• MixMo: Mixing Multiple Inputs for Multiple Outputs via Deep Subnetworks [97.08677678499075]
  We introduce MixMo, a new framework for learning multi-input multi-output deepworks. We show that binary mixing in features - particularly with patches from CutMix - enhances results by makingworks stronger and more diverse. In addition to being easy to implement and adding no cost at inference, our models outperform much costlier data augmented deep ensembles.
  arXiv  Detail & Related papers  (2021-03-10T15:31:02Z)
• Manifold Regularized Dynamic Network Pruning [102.24146031250034]
  This paper proposes a new paradigm that dynamically removes redundant filters by embedding the manifold information of all instances into the space of pruned networks. The effectiveness of the proposed method is verified on several benchmarks, which shows better performance in terms of both accuracy and computational cost.
  arXiv  Detail & Related papers  (2021-03-10T03:59:03Z)
• Smoother Network Tuning and Interpolation for Continuous-level Image Processing [7.730087303035803]
  Filter Transition Network (FTN) is a structurally smoother module for continuous-level learning. FTN generalizes well across various tasks and networks and cause fewer undesirable side effects. For stable learning of FTN, we additionally propose a method to non-linear neural network layers with identity mappings.
  arXiv  Detail & Related papers  (2020-10-05T18:29:52Z)
• Network Adjustment: Channel Search Guided by FLOPs Utilization Ratio [101.84651388520584]
  This paper presents a new framework named network adjustment, which considers network accuracy as a function of FLOPs. Experiments on standard image classification datasets and a wide range of base networks demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2020-04-06T15:51:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.