- Open Access
Machine-state embeddings as an operational reference space for accelerator operation
Phys. Rev. Accel. Beams 29, 105101 – Published 1 October, 2026
DOI: https://doi.org/10.1103/d1b7-qdcm
Abstract
We demonstrate that graph neural network embeddings of injector configurations provide a practical operational reference space for the Continuous Electron Beam Accelerator Facility injector at Jefferson Lab. Using 137,389 snapshots spanning January 2022 through March 2023, we show that injector operation occupies a small number of persistent, well-separated neighborhoods in a 16-dimensional learned state space rather than a featureless continuum. Density-based clustering identifies ten persistent operating regimes with strong operational run alignment, and regime persistence statistics confirm that these regimes are stable over timescales of hours to weeks. Large relocations between neighborhoods are rare and episodic; 99.6% of 1-h operating windows fall within an empirically derived jitter baseline. Geometric outlier screening narrows a year-long dataset to a small set of intervals warranting operational review, and nearest-neighbor retrieval enables case-based reasoning over the historical archive. A controlled beam study validates that deliberate injector reconfiguration traces coherent, interpretable trajectories in embedding space. Together these capabilities demonstrate that machine-state embeddings support holistic operational monitoring in ways that single-channel inspection cannot.
Physics Subject Headings (PhySH)
Article Text
References (30)
- S. Wang, C. Tennant, D. Moser, T. Larrieu, and J. Li, Graph learning for particle accelerator operations, Front. Big Data 7, 1366469 (2024).
- T. Chen, S. Kornblith, M. Norouzi, and G. Hinton, A simple framework for contrastive learning of visual representations, in Proceedings of the 37th International Conference on Machine Learning (PMLR, Cambridge, MA, USA, 2020), pp. 1597–1607, https://proceedings.mlr.press/v119/chen20j.html.
- Y. You, T. Chen, Y. Sui, T. Chen, Z. Wang, and Y. Shen, Graph contrastive learning with augmentations, in Advances in Neural Information Processing Systems (Curran Associates, Inc., Red Hook, NY, USA, 2020), Vol. 33, pp. 5812–5823, https://proceedings.neurips.cc/paper/2020/hash/3fe230348e9a12c13120749e3f9fa4cd-Abstract.html.
- O. Convery, L. Smith, Y. Gal, and A. Hanuka, Uncertainty quantification for virtual diagnostic of particle accelerators, Phys. Rev. Accel. Beams 24, 074602 (2021).
- J. Zhu, Y. Chen, F. Brinker, W. Decking, S. Tomin, and H. Schlarb, High-fidelity prediction of megapixel longitudinal phase-space images of electron beams using encoder-decoder neural networks, Phys. Rev. Appl. 16, 024005 (2021).
- M. Rautela, A. Williams, and A. Scheinker, A conditional latent autoregressive recurrent model for generation and forecasting of beam dynamics in particle accelerators, Sci. Rep. 14, 18157 (2024).
- K. Rajput, M. Schram, W. Blokland, Y. Alanazi, P. Ramuhalli, A. Zhukov, C. Peters, and R. Vilalta, Robust errant beam prognostics with conditional modeling for particle accelerators, Mach. Learn.:Sci. Technol. 5, 015044 (2024).
- A. Scheinker and A. Williams, Latent diffusion can map beam loss to two-dimensional phase-space projections, Phys. Rev. Accel. Beams 28, 094602 (2025).
- Q. Xu, H. D. Zhang, G. Trad, A. Hill, F. Roncarolo, and C. P. Welsch, Development of radiation-tolerant beam imaging via multimode fiber and synthetic data-driven machine learning, Phys. Rev. Accel. Beams 29, 032801 (2026).
- A. Edelen and X. Huang, Machine learning for design and control of particle accelerators: A look backward and forward, Annu. Rev. Nucl. Part. Sci. 74, 557 (2024).
- E. Fol, R. Tomás, J. Coello de Portugal, and G. Franchetti, Detection of faulty beam position monitors using unsupervised learning, Phys. Rev. Accel. Beams 23, 102805 (2020).
- P. Arpaia, G. Azzopardi, F. Blanc, X. Buffat, L. Coyle, E. Fol, F. Giordano, M. Giovannozzi, T. Pieloni, R. Prevete, S. Redaelli, B. Salvachua, B. Salvant, M. Schenk, M. S. Camillocci, R. Tomas, G. Valentino, F. F. Van der Veken, and J. Wenninger, Beam measurements and machine learning at the CERN large hadron collider, IEEE Instrum. ‘I&’ Meas. Mag. 24, 47 (2021).
- F. T. Liu, K. M. Ting, and Z.-H. Zhou, Isolation forest, in Proc. 8th IEEE Int. Conf. on Data Mining (ICDM) (IEEE, New York, 2008), pp. 413–422.
- P. Wójcik and T. Barszcz, Condition monitoring using a latent space of variational autoencoder trained on healthy data, Sensors 24, 6670 (2024).
- D. P. Kingma and M. Welling, Auto-encoding variational Bayes, in Proceedings of the 2nd International Conference on Learning Representations (ICLR), Ithaca, NY, USA (2014), arXiv:1312.6114.
- I. T. Jolliffe, Principal Component Analysis, 2nd ed. (Springer, New York, NY, USA, 2002).
- L. van der Maaten and G. Hinton, Visualizing data using t-SNE, J. Mach. Learn. Res. 9, 2579 (2008).
- L. McInnes, J. Healy, N. Saul, and L. Großberger, UMAP: Uniform manifold approximation and projection for dimension reduction, J. Open Source Softw. 3, 861 (2018).
- M. Joswiak, Y. Peng, I. Castillo, and L. H. Chiang, Dimensionality reduction for visualizing industrial chemical process data, Control Eng. Pract. 93, 104189 (2019).
- P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Liò, and Y. Bengio, Graph attention networks, arXiv:1710.10903.
- R. J. G. B. Campello, D. Moulavi, and J. Sander, Density-based clustering based on hierarchical density estimates, in Advances in Knowledge Discovery and Data Mining (Springer, Berlin, Heidelberg, Germany, 2013), pp. 160–172, 10.1007/978-3-642-37456-2_14.
- R. J. G. B. Campello, D. Moulavi, A. Zimek, and J. Sander, Hierarchical density estimates for data clustering, visualization, and outlier detection, ACM Trans. Knowl. Discovery Data (TKDD) 10, 1 (2015).
- S. Ramaswamy, R. Rastogi, and K. Shim, Efficient algorithms for mining outliers from large data sets, in Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data (Association for Computing Machinery, New York, NY, USA, 2000), pp. 427–438, 10.1145/342009.335437.
- M. M. Breunig, H.-P. Kriegel, R. T. Ng, and J. Sander, LOF: Identifying density-based local outliers, in Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data (Association for Computing Machinery, New York, NY, USA, 2000), pp. 93–104, 10.1145/342009.335388.
- A. Aamodt and E. Plaza, Case-based reasoning: Foundational issues, methodological variations, and system approaches, AI Commun. 7, 39 (1994).
- J. Johnson, M. Douze, and H. Jegou, Billion-scale similarity search with GPUs, IEEE Trans. Big Data 7, 535 (2021).
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, Attention is all you need, in Advances in Neural Information Processing Systems (NeurIPS) (Curran Associates, Inc., Red Hook, NY, USA, 2017), Vol. 30, https://proceedings.neurips.cc/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html.
- F. Mayet et al., Toward particle accelerator machine state embeddings as a modality for large language models, in Proc. 20th Int. Conf. Accel. Large Exp. Phys. Control Syst. (ICALEPCS’25) (JACoW Publishing, Geneva, Switzerland, 2025), pp. 1233–1238.
- Y. Gorishniy, I. Rubachev, V. Khrulkov, and A. Babenko, Revisiting deep learning models for tabular data, in Advances in Neural Information Processing Systems (NeurIPS) (Curran Associates, Inc., Red Hook, NY, USA, 2021), Vol. 34, pp. 18932–18943, https://proceedings.neurips.cc/paper/2021/hash/9d86d83f925f2149e9edb0ac3b49229c-Abstract.html.
- P. H. Schönemann, A generalized solution of the orthogonal procrustes problem, Psychometrika 31, 1 (1966).