Export citation

Export citation

Choose format for download:

Download Citation
  • Editors' Suggestion

Timescale separation enables deep reinforcement learning control of rotating detonation engine mode transitions

Kristian Holme1,*, Jean Rabault2, Ricardo Vinuesa3, and Mikael Mortensen1

  • 1Department of Mathematics, Mechanics Division, University of Oslo, 0316 Oslo, Norway
  • 2Independent researcher, Oslo, Norway
  • 3Department of Aerospace Engineering, University of Michigan, Ann Arbor, Michigan 48109, USA

  • *Contact author: holme.kristian@gmail.com

Phys. Rev. Fluids 11, 113202 – Published 17 November, 2026

DOI: https://doi.org/10.1103/t7hy-55bc

Abstract

Rotating detonation engines (RDEs) are a promising propulsion concept that may offer higher thermodynamic efficiency and specific impulse than conventional systems, but nonlinear phenomena, including transitions to oscillatory or chaotic propagation modes, can hinder practical operation. Deep reinforcement learning (DRL) has emerged as a promising method for controlling complex nonlinear dynamics such as those observed in RDEs. However, the multitimescale nature of the RDE system makes direct application of DRL challenging. We address this challenge by reformulating the DRL problem in a moving reference frame that follows the detonation-wave pattern, making the wave structure appear quasisteady to the agent. This reformulation enables scale separation between fast detonation propagation and slower operating-mode dynamics. We train DRL controllers to modulate spatially segmented injection pressure in a one-dimensional reduced-order RDE model and induce rapid transitions between different mode-locked states. Across a range of actuation periods, initial states, and target modes, controllers trained in the moving frame learn more reliably than those trained in a stationary frame and remain effective over a broader range of actuation periods. These results suggest that symmetry-aware moving reference frame formulations may be useful for related multiscale flow-control problems and that scale separation should be exploited whenever possible to enable DRL control of multitimescale systems.

Physics Subject Headings (PhySH)

Authorization Required

We need you to provide your credentials before accessing this content.

References (Subscription Required)

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation