Online Decision-Making Under Uncertainty for Vehicle-to-Building Systems

• URL: http://arxiv.org/abs/2601.03476v1
• Date: Wed, 07 Jan 2026 00:05:45 GMT
• Title: Online Decision-Making Under Uncertainty for Vehicle-to-Building Systems
• Authors: Rishav Sen, Yunuo Zhang, Fangqi Liu, Jose Paolo Talusan, Ava Pettet, Yoshinori Suzue, Ayan Mukhopadhyay, Abhishek Dubey,
• Abstract summary: Vehicle-to-building (V2B) systems integrate physical infrastructures, such as smart buildings and electric vehicles (EVs) connected to chargers at the building, with digital control mechanisms to manage energy use.<n>This setup leads to the V2B optimization problem, where buildings coordinate EV charging and discharging to minimize total electricity costs while meeting users' charging requirements.
• Score: 7.044953600272161
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Vehicle-to-building (V2B) systems integrate physical infrastructures, such as smart buildings and electric vehicles (EVs) connected to chargers at the building, with digital control mechanisms to manage energy use. By utilizing EVs as flexible energy reservoirs, buildings can dynamically charge and discharge them to optimize energy use and cut costs under time-variable pricing and demand charge policies. This setup leads to the V2B optimization problem, where buildings coordinate EV charging and discharging to minimize total electricity costs while meeting users' charging requirements. However, the V2B optimization problem is challenging because of: (1) fluctuating electricity pricing, which includes both energy charges ($/kWh) and demand charges ($/kW); (2) long planning horizons (typically over 30 days); (3) heterogeneous chargers with varying charging rates, controllability, and directionality (i.e., unidirectional or bidirectional); and (4) user-specific battery levels at departure to ensure user requirements are met. In contrast to existing approaches that often model this setting as a single-shot combinatorial optimization problem, we highlight critical limitations in prior work and instead model the V2B optimization problem as a Markov decision process (MDP), i.e., a stochastic control process. Solving the resulting MDP is challenging due to the large state and action spaces. To address the challenges of the large state space, we leverage online search, and we counter the action space by using domain-specific heuristics to prune unpromising actions. We validate our approach in collaboration with Nissan Advanced Technology Center - Silicon Valley. Using data from their EV testbed, we show that the proposed framework significantly outperforms state-of-the-art methods.

Related papers

• CONSENT: A Negotiation Framework for Leveraging User Flexibility in Vehicle-to-Building Charging under Uncertainty [6.820103523878096]
  The growth of Electric Vehicles (EVs) creates a conflict in vehicle-to-building (V2B) settings between building operators, who face high energy costs from uncoordinated charging, and drivers, who prioritize convenience and a full charge.<n>We propose a negotiation-based framework that guarantees voluntary participation, strategy-proofness, and budget feasibility.<n>It transforms EV charging into a strategic resource by offering drivers a range of incentive-backed options for modest flexibility in their departure time or requested state of charge.
  arXiv  Detail & Related papers  (2026-01-04T15:59:52Z)
• Shielded Controller Units for RL with Operational Constraints Applied to Remote Microgrids [50.64533198075622]
  Reinforcement learning (RL) is a powerful framework for optimizing decision-making in complex systems under uncertainty.<n>In this paper, we introduce Shielded Controller Units (SCUs), a systematic and interpretable approach that leverages prior knowledge of system dynamics.<n>We demonstrate the effectiveness of SCUs on a remote microgrid optimization task with strict operational requirements.
  arXiv  Detail & Related papers  (2025-11-30T19:28:34Z)
• Safe and Sustainable Electric Bus Charging Scheduling with Constrained Hierarchical DRL [43.715336081857394]
  Electric Buses (EBs) with renewable energy sources such as photovoltaic (PV) panels is a promising approach to promote sustainable and low-carbon public transportation.<n>We propose a safe Deep Reinforcement Learning framework for solving the EB Charging Scheduling Problem (EBCSP) under multi-source uncertainties.<n>We develop a novel HDRL algorithm, namely Double ActorCritic MultiAgent Proximal Policy Optimization Lagrangian (DACMAPPO-Lagrangian)
  arXiv  Detail & Related papers  (2025-11-25T20:00:02Z)
• A Digital Twin Framework for Decision-Support and Optimization of EV Charging Infrastructure in Localized Urban Systems [0.6640968473398454]
  This study advances beyond static models by proposing a digital twin framework.<n>It integrates agent-based decision support with embedded optimization to dynamically simulate EV charging behaviors.<n>The model is applied to a localized urban site in Hanoi, Vietnam.
  arXiv  Detail & Related papers  (2025-10-21T12:26:35Z)
• Smart Ride and Delivery Services with Electric Vehicles: Leveraging Bidirectional Charging for Profit Optimisation [8.899491864225464]
  We introduce the Electric Vehicle Orienteering Problem with V2G (EVOP-V2G)<n>This involves navigating dynamic electricity prices, charging station selection, and route constraints.<n>We propose two near-optimal metaheuristic algorithms: one evolutionary (EA) and the other based on large neighborhood search (LNS)
  arXiv  Detail & Related papers  (2025-06-25T13:15:52Z)
• Joint Resource Management for Energy-efficient UAV-assisted SWIPT-MEC: A Deep Reinforcement Learning Approach [50.52139512096988]
  6G Internet of Things (IoT) networks face challenges in remote areas and disaster scenarios where ground infrastructure is unavailable.<n>This paper proposes a novel aerial unmanned vehicle (UAV)-assisted computing (MEC) system enhanced by directional antennas to provide both computational and energy support for ground edge terminals.
  arXiv  Detail & Related papers  (2025-05-06T06:46:19Z)
• Uncertainty-Aware Critic Augmentation for Hierarchical Multi-Agent EV Charging Control [9.96602699887327]
  We propose HUCA, a novel real-time charging control for regulating energy demands for both the building and EVs.<n>HUCA employs hierarchical actor-critic networks to dynamically reduce electricity costs in buildings, accounting for the needs of EV charging in the dynamic pricing scenario.<n> Experiments on real-world electricity datasets under both simulated certain and uncertain departure scenarios demonstrate that HUCA outperforms baselines in terms of total electricity costs.
  arXiv  Detail & Related papers  (2024-12-23T23:45:45Z)
• Electric Vehicles coordination for grid balancing using multi-objective Harris Hawks Optimization [0.0]
  The rise of renewables coincides with the shift towards Electrical Vehicles (EVs) posing technical and operational challenges for the energy balance of the local grid. Coordinating power flow from multiple EVs into the grid requires sophisticated algorithms and load-balancing strategies. This paper proposes an EVs fleet coordination model for the day ahead aiming to ensure a reliable energy supply and maintain a stable local grid.
  arXiv  Detail & Related papers  (2023-11-24T15:50:37Z)
• Charge Manipulation Attacks Against Smart Electric Vehicle Charging Stations and Deep Learning-based Detection Mechanisms [49.37592437398933]
  "Smart" electric vehicle charging stations (EVCSs) will be a key step toward achieving green transportation. We investigate charge manipulation attacks (CMAs) against EV charging, in which an attacker manipulates the information exchanged during smart charging operations. We propose an unsupervised deep learning-based mechanism to detect CMAs by monitoring the parameters involved in EV charging.
  arXiv  Detail & Related papers  (2023-10-18T18:38:59Z)
• Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control [42.17503767317918]
  This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments. A horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users' behaviors and dynamic environments. Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various factors.
  arXiv  Detail & Related papers  (2022-10-04T08:22:46Z)
• NeurOpt: Neural network based optimization for building energy management and climate control [58.06411999767069]
  We propose a data-driven control algorithm based on neural networks to reduce this cost of model identification. We validate our learning and control algorithms on a two-story building with ten independently controlled zones, located in Italy.
  arXiv  Detail & Related papers  (2020-01-22T00:51:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.