FastODT: A tree-based framework for efficient continual learning

• URL: http://arxiv.org/abs/2603.13276v1
• Date: Fri, 27 Feb 2026 10:00:27 GMT
• Title: FastODT: A tree-based framework for efficient continual learning
• Abstract summary: This paper introduces a oblivious tree-based model with Hoeffding bound controlling its growth.<n>It seamlessly integrates rapid learning and inference with efficient memory management and robust knowledge preservation, thus allowing for online learning.
• Score: 0.22390482983773527
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Machine learning models deployed in real-world settings must operate under evolving data distributions and constrained computational resources. This challenge is particularly acute in non-stationary domains such as energy time series, weather monitoring, and environmental sensing. To remain effective, models must support adaptability, continuous learning, and long-term knowledge retention. This paper introduces a oblivious tree-based model with Hoeffding bound controlling its growth. It seamlessly integrates rapid learning and inference with efficient memory management and robust knowledge preservation, thus allowing for online learning. Extensive experiments across energy and environmental sensing time-series benchmarks demonstrate that the proposed framework achieves performance competitive with, and in several cases surpassing, existing online and batch learning methods, while maintaining superior computational efficiency. Collectively, these results demonstrate that the proposed approach fulfills the core objectives of adaptability, continual updating, and efficient retraining without full model retraining. The framework provides a scalable and resource-aware foundation for deployment in real-world non-stationary environments where resources are constrained and sustained adaptation is essential.

Related papers

• Towards Continuous Power Forecasting: Practical Continual Learning for Real-World Energy Systems in Nonstationary Time Series [4.036538092091887]
  This paper proposes the paradigm of Continuous Power Forecasting.<n>It views power forecasting as a continual learning problem rather than a static offline task.<n>We show how continual learning can be pragmatically integrated into industrial power forecasting pipelines.
  arXiv  Detail & Related papers  (2026-06-23T08:48:38Z)
• A Systematic Post-Train Framework for Video Generation [76.26555417456773]
  Large-scale video diffusion models have demonstrated impressive capabilities in generating high-resolution and semantically rich content.<n>A significant gap remains between their pretraining performance and real-world deployment requirements due to critical issues such as prompt sensitivity, temporal inconsistency, and prohibitive inference costs.<n>We propose a comprehensive post-training framework that systematically aligns pretrained models with user intentions through four synergistic stages.
  arXiv  Detail & Related papers  (2026-04-28T09:34:51Z)
• Perspective: Towards sustainable exploration of chemical spaces with machine learning [49.29528647472741]
  We argue that sustainable progress will rely on open data and models, reusable datasets, and domain-specific AI systems.<n>We highlight emerging strategies to enhance efficiency, including general-purpose machine learning (ML) models, multi-fidelity approaches, model distillation, and active learning.
  arXiv  Detail & Related papers  (2026-03-31T13:29:20Z)
• Optimal Learning Rate Schedule for Balancing Effort and Performance [4.693715072095583]
  Learning how to learn efficiently is a fundamental challenge for biological agents and a growing concern for artificial ones.<n>We introduce a normative framework that formalizes this problem as an optimal control process in which the agent maximizes cumulative performance while incurring a cost of learning.<n>We show how a simple episodic memory mechanism can approximate the required performance expectations by recalling similar past learning experiences.
  arXiv  Detail & Related papers  (2026-01-12T18:59:07Z)
• SCALER:Synthetic Scalable Adaptive Learning Environment for Reasoning [24.80806018678682]
  Reinforcement learning (RL) offers a principled way to enhance the reasoning capabilities of large language models.<n>In practice, RL progress often slows when task difficulty becomes poorly aligned with model capability.<n>We propose a framework that sustains effective learning signals through adaptive environment design.
  arXiv  Detail & Related papers  (2026-01-08T10:42:04Z)
• Environment-Aware Transfer Reinforcement Learning for Sustainable Beam Selection [3.2023814100005894]
  This paper presents a novel and sustainable approach for improving beam selection in 5G and beyond networks using transfer learning and Reinforcement Learning (RL)<n>We propose modeling the environment as a point cloud, where each point represents the locations of gNodeBs (gNBs) and surrounding scatterers.<n>By computing the Chamfer distance between point clouds, structurally similar environments can be efficiently identified, enabling the reuse of pre-trained models through transfer learning.
  arXiv  Detail & Related papers  (2025-11-10T08:50:05Z)
• Load Forecasting for Households and Energy Communities: Are Deep Learning Models Worth the Effort? [0.0]
  Energy communities (ECs) play a key role in enabling local demand shifting and enhancing self-sufficiency.<n>Data-driven forecasting has gained significant attention, but it remains insufficiently explored in many practical contexts.<n>This study evaluates the effectiveness of state-of-the-art deep learning models across various community size, historical data availability, and model complexity.
  arXiv  Detail & Related papers  (2025-01-09T06:29:50Z)
• Energy-Efficient Federated Edge Learning with Streaming Data: A Lyapunov Optimization Approach [34.00679567444125]
  We develop a dynamic scheduling and resource allocation algorithm to address the inherent randomness in data arrivals and resource availability under long-term energy constraints. Our proposed algorithm makes adaptive decisions on device scheduling, computational capacity adjustment, and allocation of bandwidth and transmit power in every round. The effectiveness of our scheme is verified through simulation results, demonstrating improved learning performance and energy efficiency as compared to baseline schemes.
  arXiv  Detail & Related papers  (2024-05-20T14:13:22Z)
• Towards Robust Continual Learning with Bayesian Adaptive Moment Regularization [51.34904967046097]
  Continual learning seeks to overcome the challenge of catastrophic forgetting, where a model forgets previously learnt information. We introduce a novel prior-based method that better constrains parameter growth, reducing catastrophic forgetting. Results show that BAdam achieves state-of-the-art performance for prior-based methods on challenging single-headed class-incremental experiments.
  arXiv  Detail & Related papers  (2023-09-15T17:10:51Z)
• Actively Learning Costly Reward Functions for Reinforcement Learning [56.34005280792013]
  We show that it is possible to train agents in complex real-world environments orders of magnitudes faster. By enabling the application of reinforcement learning methods to new domains, we show that we can find interesting and non-trivial solutions.
  arXiv  Detail & Related papers  (2022-11-23T19:17:20Z)
• Active Learning of Discrete-Time Dynamics for Uncertainty-Aware Model Predictive Control [46.81433026280051]
  We present a self-supervised learning approach that actively models the dynamics of nonlinear robotic systems. Our approach showcases high resilience and generalization capabilities by consistently adapting to unseen flight conditions.
  arXiv  Detail & Related papers  (2022-10-23T00:45:05Z)
• Learning to Continuously Optimize Wireless Resource in a Dynamic Environment: A Bilevel Optimization Perspective [52.497514255040514]
  This work develops a new approach that enables data-driven methods to continuously learn and optimize resource allocation strategies in a dynamic environment. We propose to build the notion of continual learning into wireless system design, so that the learning model can incrementally adapt to the new episodes. Our design is based on a novel bilevel optimization formulation which ensures certain fairness" across different data samples.
  arXiv  Detail & Related papers  (2021-05-03T07:23:39Z)
• Learning to Continuously Optimize Wireless Resource In Episodically Dynamic Environment [55.91291559442884]
  This work develops a methodology that enables data-driven methods to continuously learn and optimize in a dynamic environment. We propose to build the notion of continual learning into the modeling process of learning wireless systems. Our design is based on a novel min-max formulation which ensures certain fairness" across different data samples.
  arXiv  Detail & Related papers  (2020-11-16T08:24:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.