Diffusion Reinforcement Learning Based Online 3D Bin Packing Spatial Strategy Optimization

• URL: http://arxiv.org/abs/2604.10953v1
• Date: Mon, 13 Apr 2026 03:50:12 GMT
• Title: Diffusion Reinforcement Learning Based Online 3D Bin Packing Spatial Strategy Optimization
• Abstract summary: The online 3D bin packing problem is important in logistics, warehousing and intelligent manufacturing.<n>This paper proposes a diffusion reinforcement learning-based algorithm, using a Markov decision chain for packing modeling.<n> Experiments show it significantly improves the average number of packed items compared to state-of-the-art DRL methods.
• Score: 10.773877323537235
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The online 3D bin packing problem is important in logistics, warehousing and intelligent manufacturing, with solutions shifting to deep reinforcement learning (DRL) which faces challenges like low sample efficiency. This paper proposes a diffusion reinforcement learning-based algorithm, using a Markov decision chain for packing modeling, height map-based state representation and a diffusion model-based actor network. Experiments show it significantly improves the average number of packed items compared to state-of-the-art DRL methods, with excellent application potential in complex online scenarios.

Related papers

• Optimizing 3D Diffusion Models for Medical Imaging via Multi-Scale Reward Learning [7.493047521402676]
  This paper presents a method to enhance 3D diffusion models using Reinforcement Learning (RL) with multi-scale feedback.<n>We fine-tune the model using Proximal Policy Optimization (PPO), guided by a novel reward system that integrates both 2D slice-wise assessments and 3D analysis.<n>Our results indicate that incorporating RL feedback effectively steers the generation process toward higher quality distributions.
  arXiv  Detail & Related papers  (2026-03-06T11:30:55Z)
• 3D-Learning: Diffusion-Augmented Distributionally Robust Decision-Focused Learning [7.497355941969675]
  We present the framework of Distributionally Robust Decision-Focused Learning (DR-DFL)<n>DR-DFL trains ML models to optimize decision performance under the worst-case distribution.<n>By leveraging the powerful distribution modeling capabilities of diffusion models, 3D-Learning identifies worst-case distributions that remain consistent with real data.
  arXiv  Detail & Related papers  (2026-02-03T00:37:22Z)
• Enhancing Diffusion-based Restoration Models via Difficulty-Adaptive Reinforcement Learning with IQA Reward [93.04811239892852]
  Reinforcement Learning (RL) has recently been incorporated into diffusion models.<n>In this paper, we investigate how to effectively integrate RL into diffusion-based restoration models.
  arXiv  Detail & Related papers  (2025-11-03T14:57:57Z)
• Towards Stable and Effective Reinforcement Learning for Mixture-of-Experts [113.0656076371565]
  We propose a novel router-aware approach to optimize importance sampling weights in off-policy reinforcement learning (RL)<n>Specifically, we design a rescaling strategy guided by router logits, which effectively reduces gradient variance and mitigates training divergence.<n> Experimental results demonstrate that our method significantly improves both the convergence stability and the final performance of MoE models.
  arXiv  Detail & Related papers  (2025-10-27T05:47:48Z)
• Demystifying Reinforcement Learning in Agentic Reasoning [90.3737088727791]
  We conduct a comprehensive and systematic investigation to demystify reinforcement learning in agentic reasoning.<n>We highlight our key insights: (i) replacing stitched synthetic trajectories with real end-to-end tool-use trajectories yields a far stronger SFT.<n> Exploration-friendly techniques are crucial for agentic RL, such as clip higher, overlong reward shaping, and maintaining adequate policy entropy could improve the training efficiency.
  arXiv  Detail & Related papers  (2025-10-13T17:57:15Z)
• Lightweight and Accurate Multi-View Stereo with Confidence-Aware Diffusion Model [81.01939699480094]
  We propose a novel MVS framework, which introduces diffusion models in MVS.<n>Considering the discriminative characteristic of depth estimation, we design a condition encoder to guide the diffusion process.<n>Based on our novel MVS framework, we propose two novel MVS methods, DiffMVS and CasMVS.
  arXiv  Detail & Related papers  (2025-09-18T17:59:19Z)
• Multi-Agent Reinforcement Learning for Sample-Efficient Deep Neural Network Mapping [54.65536245955678]
  We present a decentralized multi-agent reinforcement learning (MARL) framework designed to overcome the challenge of sample inefficiency.<n>We introduce an agent clustering algorithm that assigns similar mapping parameters to the same agents based on correlation analysis.<n> Experimental results show our MARL approach improves sample efficiency by 30-300x over standard single-agent RL.
  arXiv  Detail & Related papers  (2025-07-22T05:51:07Z)
• Deep RL Dual Sourcing Inventory Management with Supply and Capacity Risk Awareness [4.583289433858458]
  We study how to efficiently apply reinforcement learning (RL) for solving large-scale optimization problems by leveraging intervention models.<n>We demonstrate our approach on a challenging real-world application, the multi-sourcing multi-period inventory management problem in supply chain optimization.
  arXiv  Detail & Related papers  (2025-07-19T02:44:45Z)
• Degradation-Guided One-Step Image Super-Resolution with Diffusion Priors [75.24313405671433]
  Diffusion-based image super-resolution (SR) methods have achieved remarkable success by leveraging large pre-trained text-to-image diffusion models as priors. We introduce a novel one-step SR model, which significantly addresses the efficiency issue of diffusion-based SR methods. Unlike existing fine-tuning strategies, we designed a degradation-guided Low-Rank Adaptation (LoRA) module specifically for SR.
  arXiv  Detail & Related papers  (2024-09-25T16:15:21Z)
• Enhancing Sample Efficiency and Exploration in Reinforcement Learning through the Integration of Diffusion Models and Proximal Policy Optimization [3.2288603733409498]
  We present a strictly on policy framework that treats a conditional diffusion model as an adaptable action prior.<n>The prior is pre trained on logged data and used online only at sampling time to propose actions at current on policy states.<n>Results indicate that an adaptable diffusion action prior is a practical way to boost on policy PPO under tight interaction budgets.
  arXiv  Detail & Related papers  (2024-09-02T19:10:32Z)
• Heuristic Algorithm-based Action Masking Reinforcement Learning (HAAM-RL) with Ensemble Inference Method [0.0]
  This paper presents a novel reinforcement learning approach called HAAMRL (Heuristic ensemble-based Action Masking Reinforcement Learning) The proposed approach exhibits superior performance and capability generalization, indicating superior effectiveness in optimizing complex manufacturing processes.
  arXiv  Detail & Related papers  (2024-03-21T03:42:39Z)
• Reinforcement Learning to Optimize the Logistics Distribution Routes of Unmanned Aerial Vehicle [0.0]
  This paper proposes an improved method to achieve path planning for UAVs in complex surroundings: multiple no-fly zones. The results show the feasibility and efficiency of the model applying in this kind of complicated situation.
  arXiv  Detail & Related papers  (2020-04-21T09:42:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.