ECO: Energy-Constrained Optimization with Reinforcement Learning for Humanoid Walking

• URL: http://arxiv.org/abs/2602.06445v1
• Date: Fri, 06 Feb 2026 07:14:43 GMT
• Title: ECO: Energy-Constrained Optimization with Reinforcement Learning for Humanoid Walking
• Abstract summary: ECO (Energy-Constrained Optimization) is a constrained RL framework that separates energy-related metrics from rewards.<n>We show that ECO significantly reduces energy consumption compared to baselines while maintaining robust walking performance.
• Score: 18.843782019570735
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Achieving stable and energy-efficient locomotion is essential for humanoid robots to operate continuously in real-world applications. Existing MPC and RL approaches often rely on energy-related metrics embedded within a multi-objective optimization framework, which require extensive hyperparameter tuning and often result in suboptimal policies. To address these challenges, we propose ECO (Energy-Constrained Optimization), a constrained RL framework that separates energy-related metrics from rewards, reformulating them as explicit inequality constraints. This method provides a clear and interpretable physical representation of energy costs, enabling more efficient and intuitive hyperparameter tuning for improved energy efficiency. ECO introduces dedicated constraints for energy consumption and reference motion, enforced by the Lagrangian method, to achieve stable, symmetric, and energy-efficient walking for humanoid robots. We evaluated ECO against MPC, standard RL with reward shaping, and four state-of-the-art constrained RL methods. Experiments, including sim-to-sim and sim-to-real transfers on the kid-sized humanoid robot BRUCE, demonstrate that ECO significantly reduces energy consumption compared to baselines while maintaining robust walking performance. These results highlight a substantial advancement in energy-efficient humanoid locomotion. All experimental demonstrations can be found on the project website: https://sites.google.com/view/eco-humanoid.

Related papers

• Optimising for Energy Efficiency and Performance in Machine Learning [3.8803432012641395]
  We show that Energy Consumption Optimiser (ECOpt) optimises for energy efficiency and model performance.<n>ECOpt quantifies the trade-off between these metrics as an interpretable frontier.<n>We show that ECOpt can have a net positive environmental impact and use it to uncover seven models for CIFAR-10 that improve upon the state of the art.
  arXiv  Detail & Related papers  (2026-01-13T21:28:58Z)
• Energy-Efficient Omnidirectional Locomotion for Wheeled Quadrupeds via Predictive Energy-Aware Nominal Gait Selection [17.713242307107166]
  We present a hierarchical control framework that integrates predictive power modeling with residual reinforcement learning to optimize omnidirectional efficiency for wheeled quadrupedal robots.<n>Our approach employs a novel power prediction network that forecasts energy consumption across different gait patterns over a 1-second horizon.<n>A reinforcement learning policy then generates residual adjustments to this nominal gait, fine-tuning the robot's actions to balance energy efficiency with performance objectives.
  arXiv  Detail & Related papers  (2025-12-23T09:56:35Z)
• Fast Visuomotor Policy for Robotic Manipulation [31.26284715644132]
  Energy Policy is designed for high-frequency robotic tasks and resource-constrained systems.<n>It predicts multimodal actions in a single forward pass, enabling high-precision manipulation at high speed.<n>Results show Energy Policy matches or surpasses the performance of state-of-the-art manipulation methods.
  arXiv  Detail & Related papers  (2025-10-14T13:18:45Z)
• A Reinforcement Learning Approach for Optimal Control in Microgrids [43.122212629962235]
  Microgrids provide a promising solution by enabling localized control over energy generation, storage, and distribution.<n>This paper presents a novel reinforcement learning (RL)-based methodology for optimizing microgrid energy management.
  arXiv  Detail & Related papers  (2025-06-28T20:10:00Z)
• Tu(r)ning AI Green: Exploring Energy Efficiency Cascading with Orthogonal Optimizations [2.829284162137884]
  This paper emphasizes on treating energy efficiency as the first-class citizen and as a fundamental design consideration for a compute-intensive pipeline.<n>We show that strategic selection across five AI pipeline phases (data, model, training, system, inference) creates cascading efficiency.<n>Combinations reduce energy consumption by up to $94.6$% while preserving $95.95$% of the original F1 score of non-optimized pipelines.
  arXiv  Detail & Related papers  (2025-06-23T04:52:08Z)
• Joint Resource Management for Energy-efficient UAV-assisted SWIPT-MEC: A Deep Reinforcement Learning Approach [50.52139512096988]
  6G Internet of Things (IoT) networks face challenges in remote areas and disaster scenarios where ground infrastructure is unavailable.<n>This paper proposes a novel aerial unmanned vehicle (UAV)-assisted computing (MEC) system enhanced by directional antennas to provide both computational and energy support for ground edge terminals.
  arXiv  Detail & Related papers  (2025-05-06T06:46:19Z)
• Latent Adaptive Planner for Dynamic Manipulation [43.959104380268066]
  Latent Adaptive Planner (LAP) is a trajectory-level latent-variable policy for dynamic nonprehensile manipulation.<n>LAP formulates planning as inference in a low-dimensional latent space and is learned effectively from human demonstration videos.
  arXiv  Detail & Related papers  (2025-05-06T00:09:09Z)
• Green MLOps to Green GenOps: An Empirical Study of Energy Consumption in Discriminative and Generative AI Operations [2.2765705959685234]
  This study investigates the energy consumption of Discriminative and Generative AI models within real-world MLOps pipelines.<n>We employ software-based power measurements to ensure ease of replication across diverse configurations, models, and datasets.
  arXiv  Detail & Related papers  (2025-03-31T10:28:04Z)
• Impact of ML Optimization Tactics on Greener Pre-Trained ML Models [46.78148962732881]
  This study aims to (i) analyze image classification datasets and pre-trained models, (ii) improve inference efficiency by comparing optimized and non-optimized models, and (iii) assess the economic impact of the optimizations. We conduct a controlled experiment to evaluate the impact of various PyTorch optimization techniques (dynamic quantization, torch.compile, local pruning, and global pruning) to 42 Hugging Face models for image classification. Dynamic quantization demonstrates significant reductions in inference time and energy consumption, making it highly suitable for large-scale systems.
  arXiv  Detail & Related papers  (2024-09-19T16:23:03Z)
• AI-Driven approach for sustainable extraction of earth's subsurface renewable energy while minimizing seismic activity [44.99833362998488]
  Injection of fluids into the Earth's crust can induce or trigger earthquakes. We propose a new approach based on Reinforcement Learning for the control of human-induced seismicity. We show that the reinforcement learning algorithm can interact efficiently with a robust controller.
  arXiv  Detail & Related papers  (2024-08-07T10:06:04Z)
• Adaptive Energy Management for Self-Sustainable Wearables in Mobile Health [21.97214707198675]
  Small form factor of wearable devices limits the battery size and operating lifetime. Energy harvesting has emerged as an effective method towards sustainable operation of wearable devices. This paper studies the novel problem of adaptive energy management towards the goal of self-sustainable wearables by using harvested energy to supplement the battery energy and to reduce manual recharging by users.
  arXiv  Detail & Related papers  (2022-01-16T23:49:20Z)
• Risk-Aware Energy Scheduling for Edge Computing with Microgrid: A Multi-Agent Deep Reinforcement Learning Approach [82.6692222294594]
  We study a risk-aware energy scheduling problem for a microgrid-powered MEC network. We derive the solution by applying a multi-agent deep reinforcement learning (MADRL)-based advantage actor-critic (A3C) algorithm with shared neural networks.
  arXiv  Detail & Related papers  (2020-02-21T02:14:38Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.