Fuzzy Logic Theory-based Adaptive Reward Shaping for Robust Reinforcement Learning (FARS)

• URL: http://arxiv.org/abs/2604.15772v1
• Date: Fri, 17 Apr 2026 07:25:55 GMT
• Title: Fuzzy Logic Theory-based Adaptive Reward Shaping for Robust Reinforcement Learning (FARS)
• Abstract summary: Reinforcement learning (RL) often struggles in real-world tasks with high-dimensional state spaces and long horizons.<n>This paper presents a fuzzy logic based reward shaping method that integrates human intuition into RL reward design.
• Score: 2.8055179094637683
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reinforcement learning (RL) often struggles in real-world tasks with high-dimensional state spaces and long horizons, where sparse or fixed rewards severely slow down exploration and cause agents to get trapped in local optima. This paper presents a fuzzy logic based reward shaping method that integrates human intuition into RL reward design. By encoding expert knowledge into adaptive and interpreable terms, fuzzy rules promote stable learning and reduce sensitivity to hyperparameters. The proposed method leverages these properties to adapt reward contributions based on the agent state, enabling smoother transitions between fast motion and precise control in challenging navigation tasks. Extensive simulation results on autonomous drone racing benchmarks show stable learning behavior and consistent task performance across scenarios of increasing difficulty. The proposed method achieves faster convergence and reduced performance variability across training seeds in more challenging environments, with success rates improving by up to approximately 5 percent compared to non fuzzy reward formulations.

Related papers

• ARISE-RL: Agentic Rubric-Grounded Iterative Self-Evolution with Reinforcement Learning [74.19730275669227]
  ARISE-RL is a novel full-cycle self-evolution framework for training open-ended agents.<n>We present Reward-Gated Self-Evolution Distillation (RG-SED), which distills a memory-augmented variant of the same policy back into itself.<n>We also present ECR-Bench, an expert-calibrated rubric benchmark suite covering single-tool deep research and multi-tool travel planning.
  arXiv  Detail & Related papers  (2026-09-01T10:54:13Z)
• RSPO: Reward-Swap Policy Optimization for Multi-Turn LLM Agents [24.215311212134882]
  We propose Reward-Swap Policy Optimization (RSPO) to leverage the rich information from dense process rewards to facilitate training with outcome rewards.<n>RSPO ensures the diversity of sampled trajectories while guaranteeing consistency between the optimization objective and the true outcome rewards.
  arXiv  Detail & Related papers  (2026-07-06T06:32:39Z)
• FastDSAC: Enhancing Policy Plasticity via Constrained Exploration for Scalable Humanoid Locomotion [19.265864503552123]
  FastDSAC is a fast and high-performance variant of the Distributional Actor-Critic algorithm for parallel sampling scenarios.<n>We show that FastDSAC stabilizes the overall training process and achieves superior performance and faster convergence compared to state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-06-30T14:04:26Z)
• Match or Replay: Self Imitating Proximal Policy Optimization [14.033176618356746]
  Reinforcement Learning (RL) agents often struggle with inefficient exploration.<n>Traditional exploration strategies can lead to slow learning and suboptimal performance.<n>We propose a self-imitating on-policy algorithm that enhances exploration and sample efficiency.
  arXiv  Detail & Related papers  (2026-03-29T04:44:48Z)
• On the Learning Dynamics of RLVR at the Edge of Competence [86.52481827737097]
  Reinforcement learning with verifiable rewards (RLVR) has been a main driver of recent breakthroughs in large reasoning models.<n>We develop a theory of the training dynamics of RL for transformers on compositional reasoning tasks.
  arXiv  Detail & Related papers  (2026-02-16T16:03:08Z)
• Adaptive Milestone Reward for GUI Agents [38.548364518806046]
  We propose the Adaptive Milestone Reward (ADMIRE) mechanism.<n>ADMIRE constructs a verifiable, adaptive reward system by anchoring trajectory to milestones.<n>Experiments demonstrate that ADMIRE consistently yields over 10% absolute improvement in success rate.
  arXiv  Detail & Related papers  (2026-02-12T03:31:40Z)
• ArenaRL: Scaling RL for Open-Ended Agents via Tournament-based Relative Ranking [84.07076200941474]
  ArenaRL is a reinforcement learning paradigm that shifts from pointwise scalar scoring to intra-group relative ranking.<n>We construct an intra-group adversarial arena and devise a tournament-based ranking scheme to obtain stable advantage signals.<n>Experiments show that ArenaRL substantially outperforms standard RL baselines.
  arXiv  Detail & Related papers  (2026-01-10T08:43:07Z)
• Sample-Efficient Neurosymbolic Deep Reinforcement Learning [49.60927398960061]
  We propose a neuro-symbolic Deep RL approach that integrates background symbolic knowledge to improve sample efficiency.<n>Online reasoning is performed to guide the training process through two mechanisms.<n>We show improved performance over a state-of-the-art reward machine baseline.
  arXiv  Detail & Related papers  (2026-01-06T09:28:53Z)
• Towards better dense rewards in Reinforcement Learning Applications [0.7344790292816897]
  Finding meaningful and accurate dense rewards is a fundamental task in the field of reinforcement learning (RL)<n>Dense reward functions offer a potential solution by shaping agent behavior and accelerating learning.<n>This proposal explores several approaches to dealing with unsolved problems and enhancing the effectiveness and reliability of dense reward construction.
  arXiv  Detail & Related papers  (2025-12-03T22:36:55Z)
• Sycophancy Mitigation Through Reinforcement Learning with Uncertainty-Aware Adaptive Reasoning Trajectories [58.988535279557546]
  We introduce textbf sycophancy Mitigation through Adaptive Reasoning Trajectories.<n>We show that SMART significantly reduces sycophantic behavior while preserving strong performance on out-of-distribution inputs.
  arXiv  Detail & Related papers  (2025-09-20T17:09:14Z)
• Beyond Human Preferences: Exploring Reinforcement Learning Trajectory Evaluation and Improvement through LLMs [12.572869123617783]
  Reinforcement learning (RL) faces challenges in evaluating policy trajectories within intricate game tasks. PbRL presents a pioneering framework that capitalizes on human preferences as pivotal reward signals. We propose a LLM-enabled automatic preference generation framework named LLM4PG.
  arXiv  Detail & Related papers  (2024-06-28T04:21:24Z)
• Reinforcement Learning from Diverse Human Preferences [68.4294547285359]
  This paper develops a method for crowd-sourcing preference labels and learning from diverse human preferences. The proposed method is tested on a variety of tasks in DMcontrol and Meta-world. It has shown consistent and significant improvements over existing preference-based RL algorithms when learning from diverse feedback.
  arXiv  Detail & Related papers  (2023-01-27T15:18:54Z)
• Reinforcement Learning for Robust Missile Autopilot Design [0.0]
  This work is pioneer in proposing Reinforcement Learning as a framework for flight control. Under TRPO's methodology, the collected experience is augmented according to HER, stored in a replay buffer and sampled according to its significance. Results show that it is possible both to achieve the optimal performance and to improve the agent's robustness to uncertainties.
  arXiv  Detail & Related papers  (2020-11-26T09:30:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.