Hypersonic Flow Control: Generalized Deep Reinforcement Learning for Hypersonic Intake Unstart Control under Uncertainty

• URL: http://arxiv.org/abs/2602.02531v1
• Date: Tue, 27 Jan 2026 22:38:52 GMT
• Title: Hypersonic Flow Control: Generalized Deep Reinforcement Learning for Hypersonic Intake Unstart Control under Uncertainty
• Authors: Trishit Mondal, Ameya D. Jagtap,
• Abstract summary: Unstart is a major challenge to reliable air-breathing propulsion at Mach 5 and above.<n>We show a strategy to control unstart in a canonical two-dimensional hypersonic inlet at Mach 5 and Reynolds number $5times 106$.<n>Results establish a data-driven approach for real-time hypersonic flow control under realistic operational uncertainties.
• Score: 0.34376560669160394
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The hypersonic unstart phenomenon poses a major challenge to reliable air-breathing propulsion at Mach 5 and above, where strong shock-boundary-layer interactions and rapid pressure fluctuations can destabilize inlet operation. Here, we demonstrate a deep reinforcement learning (DRL)- based active flow control strategy to control unstart in a canonical two-dimensional hypersonic inlet at Mach 5 and Reynolds number $5\times 10^6$. The in-house CFD solver enables high-fidelity simulations with adaptive mesh refinement, resolving key flow features, including shock motion, boundary-layer dynamics, and flow separation, that are essential for learning physically consistent control policies suitable for real-time deployment. The DRL controller robustly stabilizes the inlet over a wide range of back pressures representative of varying combustion chamber conditions. It further generalizes to previously unseen scenarios, including different back-pressure levels, Reynolds numbers, and sensor configurations, while operating with noisy measurements, thereby demonstrating strong zero-shot generalization. Control remains robust in the presence of noisy sensor measurements, and a minimal, optimally selected sensor set achieves comparable performance, enabling practical implementation. These results establish a data-driven approach for real-time hypersonic flow control under realistic operational uncertainties.

Related papers

• HydroGym: A Reinforcement Learning Platform for Fluid Dynamics [2.7789211666404228]
  HydroGym is a solver-independent RL platform for flow control research.<n>Our platform includes 42 validated environments spanning from canonical laminar flows to complex three-dimensional turbulent scenarios.
  arXiv  Detail & Related papers  (2025-12-19T12:58:06Z)
• Active Control of Turbulent Airfoil Flows Using Adjoint-based Deep Learning [0.0]
  We train active neural-network flow controllers to optimize lift-to-drag ratios in turbulent airfoil flows at Reynolds number $5times104$ and Mach number 0.4.<n>The trained flow controllers significantly improve the lift-to-drag ratios and reduce flow separation for both two- and three-dimensional air flows.
  arXiv  Detail & Related papers  (2025-10-08T14:59:29Z)
• Physics-informed Neural-operator Predictive Control for Drag Reduction in Turbulent Flows [109.99020160824553]
  We propose an efficient deep reinforcement learning framework for modeling and control of turbulent flows.<n>It is model-based RL for predictive control (PC), where both the policy and the observer models for turbulence control are learned jointly.<n>We find that PINO-PC achieves a drag reduction of 39.0% under a bulk-velocity Reynolds number of 15,000, outperforming previous fluid control methods by more than 32%.
  arXiv  Detail & Related papers  (2025-10-03T00:18:26Z)
• CL-DiffPhyCon: Closed-loop Diffusion Control of Complex Physical Systems [10.167080282182972]
  We propose an efficient Closed-Loop Diffusion method for Physical systems Control (CL-DiffPhyCon)<n>By employing an asynchronous denoising framework for different physical time steps, CL-DiffPhyCon generates control signals conditioned on real-time feedback from the system.<n>We evaluate CL-DiffPhyCon on two tasks: 1D Burgers' equation control and 2D incompressible fluid control.
  arXiv  Detail & Related papers  (2024-07-31T14:54:29Z)
• Iterative Learning Control of Fast, Nonlinear, Oscillatory Dynamics (Preprint) [0.0]
  nonlinear, chaotic, and are often too fast for active control schemes. We develop an alternative active controls system using an iterative, trajectory-optimization and parameter-tuning approach. We demonstrate that the controller is robust to missing information and uncontrollable parameters as long as certain requirements are met.
  arXiv  Detail & Related papers  (2024-05-30T13:27:17Z)
• Function Approximation for Reinforcement Learning Controller for Energy from Spread Waves [69.9104427437916]
  Multi-generator Wave Energy Converters (WEC) must handle multiple simultaneous waves coming from different directions called spread waves. These complex devices need controllers with multiple objectives of energy capture efficiency, reduction of structural stress to limit maintenance, and proactive protection against high waves. In this paper, we explore different function approximations for the policy and critic networks in modeling the sequential nature of the system dynamics.
  arXiv  Detail & Related papers  (2024-04-17T02:04:10Z)
• Growing Q-Networks: Solving Continuous Control Tasks with Adaptive Control Resolution [51.83951489847344]
  In robotics applications, smooth control signals are commonly preferred to reduce system wear and energy efficiency. In this work, we aim to bridge this performance gap by growing discrete action spaces from coarse to fine control resolution. Our work indicates that an adaptive control resolution in combination with value decomposition yields simple critic-only algorithms that yield surprisingly strong performance on continuous control tasks.
  arXiv  Detail & Related papers  (2024-04-05T17:58:37Z)
• Distributed Neurodynamics-Based Backstepping Optimal Control for Robust Constrained Consensus of Underactuated Underwater Vehicles Fleet [16.17376845767656]
  This paper develops a novel consensus based optimal coordination protocol and a robust controller. The optimal formation tracking of UUVs fleet can be achieved, and the constraints are fulfilled. The stability of the overall UUVs formation system is established to ensure that all the states of the UUVs are uniformly ultimately bounded in the presence of unknown disturbances.
  arXiv  Detail & Related papers  (2023-08-18T06:04:12Z)
• Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing [6.330823385793404]
  This study proposes a self-learning algorithm for closed-loop cylinder wake control targeting lower drag and lower lift fluctuations. The resulting dynamic feature-based DRL (DF-DRL) automatically learns a feedback control in the plant without a dynamic model.
  arXiv  Detail & Related papers  (2023-07-05T02:56:29Z)
• Spectrum Breathing: Protecting Over-the-Air Federated Learning Against Interference [73.63024765499719]
  Mobile networks can be compromised by interference from neighboring cells or jammers. We propose Spectrum Breathing, which cascades-gradient pruning and spread spectrum to suppress interference without bandwidth expansion. We show a performance tradeoff between gradient-pruning and interference-induced error as regulated by the breathing depth.
  arXiv  Detail & Related papers  (2023-05-10T07:05:43Z)
• Real-Time Model-Free Deep Reinforcement Learning for Force Control of a Series Elastic Actuator [56.11574814802912]
  State-of-the art robotic applications utilize series elastic actuators (SEAs) with closed-loop force control to achieve complex tasks such as walking, lifting, and manipulation. Model-free PID control methods are more prone to instability due to nonlinearities in the SEA. Deep reinforcement learning has proved to be an effective model-free method for continuous control tasks.
  arXiv  Detail & Related papers  (2023-04-11T00:51:47Z)
• Optimal control of a nitrogen-vacancy spin ensemble in diamond for sensing in the pulsed domain [52.77024349608834]
  Defects in solid state materials provide an ideal platform for quantum sensing. Control of such an ensemble is challenging due to the spatial variation in both the defect energy levels and in any control field across a macroscopic sample. We experimentally demonstrate that we can overcome these challenges using Floquet theory and optimal control optimization methods.
  arXiv  Detail & Related papers  (2021-01-25T13:01:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.