Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

Improving statistical precision in Monte Carlo samples with negative weights via reweighting and uncertainty quantification

C. Palmer and B. Kronheim

Phys. Rev. D 113, 012003 – Published 12 January, 2026

DOI: https://doi.org/10.1103/k8w6-wn37

Abstract

High statistical precision is critical for Monte Carlo (MC) samples in high energy physics and is degraded by negatively weighted events. This paper investigates a procedure to learn the relationship between the negative and positive weight distributions of any sample, allowing the reduction of statistical uncertainty by reweighting kinematically equivalent events with the same sign. A robust uncertainty quantification method is required for the practical application of such method. Two methods for the estimation of the reweighting uncertainty are developed: one at the event and another one at the final observable level. The latter method is strongly favored. The gains in statistical precision are then quantified. The method is demonstrated on Sherpa vector boson plus jets samples when using all generated events and when restricted to the signal region of a mock analysis. It is demonstrated to significantly reduce stochastic behavior in sparse MC samples while decreasing the overall uncertainty with a sufficiently well-known reweighting function.

View figure in article

Physics Subject Headings (PhySH)

Article Text

References (34)

  1. J. Alwall, M. Herquet, F. Maltoni, O. Mattelaer, and T. Stelzer, madgraph5: Going beyond, J. High Energy Phys. 06 (2011) 128.
  2. J. Alwall, R. Frederix, S. Frixione, V. Hirschi, F. Maltoni, O. Mattelaer, H.-S. Shao, T. Stelzer, P. Torrielli, and M. Zaro, The automated computation of tree-level and next-to-leading order differential cross sections, and their matching to parton shower simulations, J. High Energy Phys. 07 (2014) 079.
  3. S. Frixione, P. Nason, and C. Oleari, Matching NLO QCD computations with parton shower simulations: The powheg method, J. High Energy Phys. 11 (2007) 070.
  4. S. Alioli, P. Nason, C. Oleari, and E. Re, A general framework for implementing NLO calculations in shower Monte Carlo programs: The powheg box, J. High Energy Phys. 06 (2010) 043.
  5. E. Bothmann, L. Flower, C. Gütschow, S. Höche, M. Hoppe, J. Isaacson, M. Knobbe, F. Krauss, P. Meinzinger, D. Napoletano et al., Event generation with Sherpa 3, J. High Energy Phys. 12 (2024) 156.
  6. C. Bierlich, S. Chakraborty, N. Desai, L. Gellersen, I. Helenius, P. Ilten, L. Lönnblad, S. Mrenna, S. Prestel, C. T. Preuss et al., A comprehensive guide to the physics and usage of pythia 8.3, SciPost Phys. Codebases 8, (2022).
  7. J. Bellm et al., Herwig 7.0/Herwig++ 3.0 release note, Eur. Phys. J. C 76, 196 (2016).
  8. P. F. Monni, P. Nason, E. Re, M. Wiesemann, and G. Zanderighi, MINNLOPS: A new method to match NNLO QCD to parton showers, J. High Energy Phys. 05 (2020) 143; 02 (2022) 31.
  9. J. R. Andersen, C. Gütschow, A. Maier, and S. Prestel, A positive resampler for Monte Carlo events with negative weights, Eur. Phys. J. C 80, 1007 (2020).
  10. J. R. Andersen and A. Maier, Unbiased elimination of negative weights in Monte Carlo samples, Eur. Phys. J. C 82, 433 (2022).
  11. B. Nachman and J. Thaler, Neural resampler for Monte Carlo reweighting with preserved uncertainties, Phys. Rev. D 102, 076004 (2020).
  12. A. Andreassen and B. Nachman, Neural networks for full phase-space reweighting and parameter tuning, Phys. Rev. D 101, 091901 (2020).
  13. B. Nachman and D. Noll, Stay positive: Neural refinement of sample weights, Phys. Rev. D 112, 096009 (2025).
  14. B. Efron, Bootstrap methods: Another look at the jackknife, in Breakthroughs in Statistics, edited by S. Kotz and N. Johnson (Springer-Verlag, New York, 1992), p. 569, 10.1007/978-1-4612-4380-9_41.
  15. B. Efron and R. J. Tibshirani, An Introduction to the Bootstrap (Chapman and Hall, New York, 1994), p. 456, 10.1201/9780429246593.
  16. ATLAS Collaboration, ATLAS DAOD_PHYSLITE format MC simulation electroweak boson nominal samples, CERN Open Data Portal, 10.7483/OPENDATA.ATLAS.K5SU.X65Y (2024).
  17. G. Aad et al. (ATLAS Collaboration), The ATLAS experiment at the CERN large hadron collider, J. Instrum. 3, S08003 (2008).
  18. ATLAS Collaboration, ATLAS DAOD_PHYSLITE format MC simulation Higgs nominal samples, CERN Open Data Portal, 10.7483/OPENDATA.ATLAS.Z2J9.709J (2024).
  19. R. Frederix, S. Frixione, S. Prestel, and P. Torrielli, On the reduction of negative weights in mc@nlo-type matching procedures, J. High Energy Phys. 07 (2020) 238.
  20. K. Danziger, S. Höche, and F. Siegert, Reducing negative weights in Monte Carlo event generation with sherpa, arXiv:2110.15211.
  21. S. Catani and M. Seymour, A general algorithm for calculating jet cross sections in NLO QCD, Nucl. Phys. B485, 291 (1997).
  22. S. Höche, F. Krauss, M. Schönherr, and F. Siegert, QCD matrix elements+parton showers. The NLO case, J. High Energy Phys. 04 (2013) 027.
  23. S. Höche, F. Krauss, M. Schönherr, and F. Siegert, A critical appraisal of NLO+PS matching methods, J. High Energy Phys. 09 (2012) 049.
  24. T. Gneiting and A. E. Raftery, Strictly proper scoring rules, prediction, and estimation, J. Am. Stat. Assoc. 102, 359 (2007).
  25. K. Hornik, M. Stinchcombe, and H. White, Multilayer feedforward networks are universal approximators, Neural Netw. 2, 359 (1989).
  26. I. T. Jolliffe, Principal Component Analysis, 2nd ed., Springer Series in Statistics (Springer, New York, 2002), p. 438, 10.1007/b98835.
  27. J. Schaarschmidt, J. Catmore, J. Elmsheuser, L. Heinrich, N. Krumnack, S. Mete, and N. Ozturk, Physlite—a new reduced common data format for atlas, Eur. Phys. J. Web Conf. 295, 06017 (2024).
  28. ATLAS Collaboration, Athena release 22.0.1 (2019).
  29. CERN, Cern open data portal, https://opendata.cern.ch/ (2025), accessed: 2025-08-28.
  30. ATLAS Collaboration, Event generation metadata, https://opendata.atlas.cern/docs/data/for_research/evgen_metadata (2025), accessed: 2025-09-26.
  31. G. Aad et al. (ATLAS Collaboration), Luminosity determination in pp collisions at s=13  TeV using the ATLAS detector at the LHC, Eur. Phys. J. C 83, 982 (2023).
  32. R. Geirhos, J.-H. Jacobsen, C. Michaelis, R. S. Zemel, W. Brendel, M. Bethge, and F. A. Wichmann, Shortcut learning in deep neural networks, Nat. Mach. Intell. 2, 665 (2020).
  33. P. Domingos, A few useful things to know about machine learning, Commun. ACM 55, 78 (2012).
  34. A. Elwood, D. Krücker, and M. Shchedrolosiev, Direct optimization of the discovery significance in machine learning for new physics searches in particle colliders, J. Phys. Conf. Ser. 1525, 012110 (2020).

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation