Update Pythia to 8.309

[mseidel42]

Propose to update Pythia in master to 8.309 as it includes important fixes to the running of alpha_s:

Equation (9.5) in the 2006 RPP [Yao06] has erroneously been taken as a second-order alpha_strong expression, while actually it is a third-order one. This has been corrected, with separate second- and third-order options now available for matrix elements and showers. In practice the difference between second- and third-order running is minor, and furthermore first-order is default throughout.

Also discussed in today's GEN meeting: https://indico.cern.ch/event/1293969/contributions/5438463/attachments/2668515/4624955/GEN%20Meeting%20190623%20v2.pdf#page=16

The changes in our custom 8.306 were taken from the later Pythia versions, so they are all included.

@cms-sw/generators-l2 @amsimone FYI

@smrenna Would it be possible to get the patch fixing the alpha_s bug, so that we could consider a backport to 10_6 (https://github.com/cms-externals/pythia8/tree/cms/240)?

[cmsbuild]

A new Pull Request was created by @mseidel42 (Markus Seidel) for branch IB/CMSSW_13_2_X/master.

@cmsbuild, @smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.
cms-bot commands are listed here

[agrohsje]

Note that the current version in P8.240 branch still has the multiplicity bug. Just that we don't re-introduce this @mseidel42.

[smuzaffar]

please test

[cmsbuild]

-1

Failed Tests: Build
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-515b89/33240/summary.html
COMMIT: 00fff30
CMSSW: CMSSW_13_2_X_2023-06-19-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8552/33240/install.sh to create a dev area with all the needed externals and cmssw changes.

Build

I found compilation error when building:

>> Compiling edm plugin /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_2_X_2023-06-19-1100/src/GeneratorInterface/Pythia8Interface/plugins/JetMatchingHook.cc
>> Compiling edm plugin /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_2_X_2023-06-19-1100/src/GeneratorInterface/Pythia8Interface/plugins/LHAupLesHouches.cc
>> Compiling edm plugin /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_2_X_2023-06-19-1100/src/GeneratorInterface/Pythia8Interface/plugins/PowhegResHook.cc
>> Compiling edm plugin /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_2_X_2023-06-19-1100/src/GeneratorInterface/Pythia8Interface/plugins/Py8toJetInput.cc
>> Compiling edm plugin /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_2_X_2023-06-19-1100/src/GeneratorInterface/Pythia8Interface/plugins/Pythia8Hadronizer.cc
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_2_X_2023-06-19-1100/src/GeneratorInterface/Pythia8Interface/plugins/Pythia8Hadronizer.cc:32:10: fatal error: Pythia8Plugins/PowhegHooksVincia.h: No such file or directory
   32 | #include "Pythia8Plugins/PowhegHooksVincia.h"
      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_2_X_2023-06-19-1100/src/GeneratorInterface/Pythia8Interface/plugins/Pythia8Hadronizer.cc:32:10: fatal error: Pythia8Plugins/PowhegHooksVincia.h: No such file or directory
   32 | #include "Pythia8Plugins/PowhegHooksVincia.h"


[mseidel42]

Ok, looks like this needs some changes in the Pythia8Hadronizer, the standard PowhegHooks should work for all parton showers now.

For a possible 10_6 backport, I prepared the necessary changes here https://github.com/cms-externals/pythia8/compare/cms/240...mseidel42:pythia8:cms/240?expand=1 and wait for green light.

[Saptaparna]

@mseidel42 : can you link to the exact PR. I can't find a PR in 240 branch.

[mseidel42]

@mseidel42 : can you link to the exact PR. I can't find a PR in 240 branch.

Ok, I created one: cms-externals/pythia8#30

Probably to be discussed among interested parties in a GEN meeting.

[mseidel42]

Ok, this needs to go with cms-sw/cmssw#42020

[smuzaffar]

test parameters:

• pull_request = Revert "Powheg+Vincia matching" cmssw#42020

[smuzaffar]

please test

[sihyunjeon]

notes @DickyChant

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-515b89/33246/summary.html
COMMIT: 00fff30
CMSSW: CMSSW_13_2_X_2023-06-19-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8552/33246/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @aloeliger Change L1 2023 Relval Single Jet Bits to Current Menu Bits cmssw#41972
• @bsunanda Run3-gex164X One more alternative suggestion for addressing RPC issue cmssw#41982
• @syuvivida Online DQM: replace the hard-coded output directory name of event display clients with an input argument cmssw#41986
• @bsunanda Phase2-hgx341X Try to provide more realistic names to some of the variables in Geometry/HGCalCommonData/plugins/dd4hep codes cmssw#41984
• @civanch SIM: MC truth interfaces clean-up cmssw#41978
• @bsunanda Run3-gex164Z Modify all Run3 scenarios after fixing the RPC geometry issue cmssw#41990
• @mmusich zeroed mono/stereo cluster counts in SiStripMonitorTrack at each event loop cmssw#41989
• @eyigitba EMTF muon shower unpacker update cmssw#41993
• @aandvalenzuela Update OpenCV to 4.7.0 #8551

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-515b89/33246/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-515b89/33246/git-merge-result

Comparison Summary

Summary:

• You potentially removed 131 lines from the logs
• ROOTFileChecks: Some differences in event products or their sizes found
• Reco comparison results: 59198 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3195998
• DQMHistoTests: Total failures: 268924
• DQMHistoTests: Total nulls: 277
• DQMHistoTests: Total successes: 2926775
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 1135.7340000000002 KiB( 47 files compared)
• DQMHistoSizes: changed ( 10224.0 ): -0.234 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 11634.0,... ): -0.164 KiB L1T/L1TStage2uGT
• DQMHistoSizes: changed ( 11834.0 ): -1.015 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 12434.0,... ): 568.089 KiB HLT/HLTEgammaValidation
• DQMHistoSizes: changed ( 12434.0,... ): 0.492 KiB L1T/L1TStage2uGT
• DQMHistoSizes: changed ( 250202.181 ): -0.404 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 25202.0 ): 0.553 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 312.0 ): 0.164 KiB L1T/L1TStage2uGT
• Checked 207 log files, 159 edm output root files, 48 DQM output files
• TriggerResults: found differences in 17 / 46 workflows

[smuzaffar]

please test

rerun based on newer IB

[smuzaffar]

assign generators

[cmsbuild]

New categories assigned: generators

@mkirsano,@menglu21,@alberto-sanchez,@SiewYan,@GurpreetSinghChahal,@Saptaparna you have been requested to review this Pull request/Issue and eventually sign? Thanks

[menglu21]

+1

[iarspider]

@cms-sw/generators-l2 Can we move to 8.310 instead? It contains a fix for compilation with C++20.

UPD. 8.310 is not yet released, my bad. Can we at least include the patch in the referenced issue?

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-515b89/33260/summary.html
COMMIT: 00fff30
CMSSW: CMSSW_13_2_X_2023-06-19-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8552/33260/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially removed 45 lines from the logs
• ROOTFileChecks: Some differences in event products or their sizes found
• Reco comparison results: 59183 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3197894
• DQMHistoTests: Total failures: 270016
• DQMHistoTests: Total nulls: 261
• DQMHistoTests: Total successes: 2927595
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 1192.8780000000002 KiB( 47 files compared)
• DQMHistoSizes: changed ( 10224.0 ): -0.234 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 11834.0 ): -1.015 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 12434.0,... ): 596.989 KiB HLT/HLTEgammaValidation
• DQMHistoSizes: changed ( 250202.181 ): -0.404 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 25202.0 ): 0.553 KiB SiStrip/MechanicalView
• Checked 207 log files, 159 edm output root files, 48 DQM output files
• TriggerResults: found differences in 17 / 46 workflows

[smuzaffar]

+externals

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_13_2_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

[rappoccio]

+1

[rappoccio]

merge