• Accepted Paper

Real-time reinforcement learning on coupling correction

Yihao Gong, Shunqiang Tian, Linglong Mao, Xinzhong Liu, Xuan Shouzhi, and Liyuan Tan

Phys. Rev. Accel. Beams - Accepted 4 September, 2026

DOI: https://doi.org/10.1103/49ns-fryv

Abstract

The stability of vertical emittance is a critical performance metric for modern high-brightness synchrotron light sources. This paper presents a real-time, RL-based correction framework based on Deep Reinforcement Learning (DRL) by employing Dueling Deep Q-Network (DQN) with a discrete action space to dynamically adjust skew quadrupole magnets. To ensure operational safety and accelerate convergence, we introduce a curriculum learning strategy and leverage a high-fidelity simulation of the Shanghai Synchrotron Radiation Facility (SSRF) for systematic hyperparameter optimization. Experimental results demonstrate that the agent, trained in-situ on the real machine, successfully achieves stabilization of the beam-size readback at the sub-micrometer fluctuation level and exhibits rapid adaptability to target changes. This work validates the feasibility of using RL for robust, online accelerator optimization during user beam delivery.

Export citation

Export citation

Choose format for download:

Download Citation

If the author has provided any supplemental materials with this article they will be available upon publication of the version of record.

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation