[14.1.X] Update 2023 and 2024 Heavy Ion relval workflows for 2024 HLT menu #46399

mmusich · 2024-10-15T19:38:28Z

backport of #46418
backport of #46398

PR description:

PR #46376 updates the HIon HLT menu such that it requires a L1T menu (L1Menu_CollisionsHeavyIons2024_v1_0_5_xml ) different from the one used in 2023 (more L1T seeds are required by trigger paths introduced in the meanwhile, see link to payload inspector [1]).
The goal of this PR is to update the 2023 Heavy Ion relval workflows to use the @fake2 menu and to update the 2024 Heavy Ion workflows to use the updated HIon menu (consequently the DQM and validation steps are updated to run the HLT sequences).

PR validation:

Tested successfully

runTheMatrix.py -l 160,160.02,160.03,160.1,160.2,160.3,160.4,160.501,161,161.02,161.03,161.1,161.2,161.3,161.4,180.0,180.1,181,181.1 --ibeos

also:

runTheMatrix.py -l 330.0, 331.0, 332.0 --ibeos

runs fine.

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

Verbatim backport of #46398 and #46418 to CMSSW_14_1_X for 2024 HIon operations.

[1]

L1T menu comparison

mmusich · 2024-10-15T19:38:50Z

test parameters:

workflows = 160, 160.02, 160.03, 160.1, 160.2, 160.3, 160.4, 160.501, 161, 161.02, 161.03, 161.1, 161.2, 161.3, 161.4, 180.0, 180.1, 181, 181.1

cmsbuild · 2024-10-15T19:38:56Z

A new Pull Request was created by @mmusich for CMSSW_14_1_X.

It involves the following packages:

Configuration/PyReleaseValidation (upgrade, pdmv)

@AdrianoDee, @Moanwar, @cmsbuild, @kskovpen, @miquork, @srimanob, @subirsarkar, @sunilUIET can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @fabiocos, @makortel, @missirol, @slomeo this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

Backported from make {DIGI,RECO}HI2024MIX steps consume the HIon HLT menu #46418

cmsbuild · 2024-10-15T19:38:58Z

cms-bot internal usage

mmusich · 2024-10-15T19:39:08Z

@cmsbuild, please test

cmsbuild · 2024-10-15T21:34:42Z

Pull request #46399 was updated. @AdrianoDee, @Moanwar, @cmsbuild, @kskovpen, @miquork, @srimanob, @subirsarkar, @sunilUIET can you please check and sign again.

mmusich · 2024-10-15T21:36:03Z

@cmsbuild, please test

cmsbuild · 2024-10-16T01:33:20Z

+1

Size: This PR adds an extra 60KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-47c55d/42223/summary.html
COMMIT: 19b95e7
CMSSW: CMSSW_14_1_X_2024-10-15-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46399/42223/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 1328 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 546 differences found in the comparisons
DQMHistoTests: Total files compared: 60
DQMHistoTests: Total histograms compared: 4991158
DQMHistoTests: Total failures: 1575
DQMHistoTests: Total nulls: 4
DQMHistoTests: Total successes: 4989559
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 807419.6660000001 KiB( 59 files compared)
DQMHistoSizes: changed ( 161.02,... ): 17547.388 KiB HLT/Tracking
DQMHistoSizes: changed ( 161.02,... ): 12810.146 KiB HLT/EGM
DQMHistoSizes: changed ( 161.02,... ): 10390.469 KiB HLT/SiStrip
DQMHistoSizes: changed ( 161.02,... ): 10237.354 KiB HLT/HCAL
DQMHistoSizes: changed ( 161.02,... ): 9249.430 KiB HLT/Vertexing
DQMHistoSizes: changed ( 161.02,... ): 9066.871 KiB HLT/Pixel
DQMHistoSizes: changed ( 161.02,... ): 8601.007 KiB HLT/Muon
DQMHistoSizes: changed ( 161.02,... ): 8296.829 KiB HLT/BTV
DQMHistoSizes: changed ( 161.02,... ): 5317.474 KiB HLT/SUSYBSM
DQMHistoSizes: changed ( 161.02,... ): 2757.393 KiB HLT/BPH
DQMHistoSizes: changed ( 161.02 ): ...
Checked 280 log files, 243 edm output root files, 60 DQM output files
TriggerResults: found differences in 16 / 58 workflows

mandrenguyen · 2024-10-16T09:21:22Z

urgent

Moanwar · 2024-10-16T09:30:18Z

+Upgrade

AdrianoDee · 2024-10-16T10:02:16Z

+pdmv

cmsbuild · 2024-10-17T09:31:40Z

Pull request #46399 was updated. @AdrianoDee, @Moanwar, @cmsbuild, @kskovpen, @miquork, @srimanob, @subirsarkar, @sunilUIET can you please check and sign again.

mmusich · 2024-10-17T09:33:38Z

test parameters:

workflows = 160, 161, 330.0

mmusich · 2024-10-17T09:33:44Z

@cmsbuild, please test

mmusich · 2024-10-17T12:14:06Z

@cms-sw/pdmv-l2 @cms-sw/upgrade-l2 your signature is required again here as I included the commit from #46418

Moanwar · 2024-10-17T12:40:08Z

+Upgrade

cmsbuild · 2024-10-17T13:28:33Z

+1

Size: This PR adds an extra 60KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-47c55d/42257/summary.html
COMMIT: 44f0d0e
CMSSW: CMSSW_14_1_X_2024-10-16-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46399/42257/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 256 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 73 differences found in the comparisons
DQMHistoTests: Total files compared: 47
DQMHistoTests: Total histograms compared: 3641769
DQMHistoTests: Total failures: 29
DQMHistoTests: Total nulls: 4
DQMHistoTests: Total successes: 3641716
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 201760.30099999998 KiB( 46 files compared)
DQMHistoSizes: changed ( 161.0,... ): 17547.388 KiB HLT/Tracking
DQMHistoSizes: changed ( 161.0,... ): 12810.146 KiB HLT/EGM
DQMHistoSizes: changed ( 161.0,... ): 10390.469 KiB HLT/SiStrip
DQMHistoSizes: changed ( 161.0,... ): 10237.354 KiB HLT/HCAL
DQMHistoSizes: changed ( 161.0,... ): 9249.430 KiB HLT/Vertexing
DQMHistoSizes: changed ( 161.0,... ): 9066.871 KiB HLT/Pixel
DQMHistoSizes: changed ( 161.0,... ): 8601.007 KiB HLT/Muon
DQMHistoSizes: changed ( 161.0,... ): 8296.829 KiB HLT/BTV
DQMHistoSizes: changed ( 161.0,... ): 5317.474 KiB HLT/SUSYBSM
DQMHistoSizes: changed ( 161.0,... ): 2757.393 KiB HLT/BPH
DQMHistoSizes: changed ( 161.0 ): ...
Checked 205 log files, 173 edm output root files, 47 DQM output files
TriggerResults: found differences in 3 / 45 workflows

AdrianoDee · 2024-10-17T15:51:42Z

+pdmv

cmsbuild · 2024-10-17T15:52:05Z

This pull request is fully signed and it will be integrated in one of the next CMSSW_14_1_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_14_2_X is complete. This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @rappoccio, @antoniovilela, @mandrenguyen (and backports should be raised in the release meeting by the corresponding L2)

mandrenguyen · 2024-10-18T06:31:01Z

+1

cmsbuild added this to the CMSSW_14_1_X milestone Oct 15, 2024

cmsbuild added pending-signatures tests-pending orp-pending pdmv-pending backport upgrade-pending labels Oct 15, 2024

cmsbuild added tests-started and removed tests-pending labels Oct 15, 2024

mmusich mentioned this pull request Oct 15, 2024

HLT menu development for 14_1_X (2/N) #46376

Merged

mmusich force-pushed the mm_dev_2023_2024_HIon_relvals_14_1_X branch from aa4a604 to 19b95e7 Compare October 15, 2024 21:34

cmsbuild added tests-pending and removed tests-started labels Oct 15, 2024

cmsbuild added tests-started and removed tests-pending labels Oct 15, 2024

cmsbuild added tests-approved and removed tests-started labels Oct 16, 2024

cmsbuild added the urgent label Oct 16, 2024

cmsbuild added upgrade-approved and removed upgrade-pending labels Oct 16, 2024

cmsbuild added tests-pending pdmv-pending upgrade-pending labels Oct 17, 2024

cmsbuild added backport and removed backport-ok labels Oct 17, 2024

cmsbuild added tests-started and removed tests-pending labels Oct 17, 2024

cmsbuild added upgrade-approved and removed upgrade-pending labels Oct 17, 2024

cmsbuild added tests-approved backport-ok and removed tests-started backport labels Oct 17, 2024

cmsbuild added fully-signed pdmv-approved and removed pending-signatures pdmv-pending labels Oct 17, 2024

cmsbuild added orp-approved and removed orp-pending labels Oct 18, 2024

cmsbuild merged commit bacc266 into cms-sw:CMSSW_14_1_X Oct 18, 2024
10 checks passed

mmusich deleted the mm_dev_2023_2024_HIon_relvals_14_1_X branch October 18, 2024 06:38

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[14.1.X] Update 2023 and 2024 Heavy Ion relval workflows for 2024 HLT menu #46399

[14.1.X] Update 2023 and 2024 Heavy Ion relval workflows for 2024 HLT menu #46399

mmusich commented Oct 15, 2024 •

edited

Loading

mmusich commented Oct 15, 2024

cmsbuild commented Oct 15, 2024 •

edited

Loading

cmsbuild commented Oct 15, 2024 •

edited

Loading

mmusich commented Oct 15, 2024

cmsbuild commented Oct 15, 2024

mmusich commented Oct 15, 2024

cmsbuild commented Oct 16, 2024

mandrenguyen commented Oct 16, 2024

Moanwar commented Oct 16, 2024

AdrianoDee commented Oct 16, 2024

cmsbuild commented Oct 17, 2024

mmusich commented Oct 17, 2024

mmusich commented Oct 17, 2024

mmusich commented Oct 17, 2024 •

edited

Loading

Moanwar commented Oct 17, 2024

cmsbuild commented Oct 17, 2024

AdrianoDee commented Oct 17, 2024

cmsbuild commented Oct 17, 2024

mandrenguyen commented Oct 18, 2024

[14.1.X] Update 2023 and 2024 Heavy Ion relval workflows for 2024 HLT menu #46399

[14.1.X] Update 2023 and 2024 Heavy Ion relval workflows for 2024 HLT menu #46399

Conversation

mmusich commented Oct 15, 2024 • edited Loading

PR description:

PR validation:

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

mmusich commented Oct 15, 2024

cmsbuild commented Oct 15, 2024 • edited Loading

cmsbuild commented Oct 15, 2024 • edited Loading

mmusich commented Oct 15, 2024

cmsbuild commented Oct 15, 2024

mmusich commented Oct 15, 2024

cmsbuild commented Oct 16, 2024

Comparison Summary

mandrenguyen commented Oct 16, 2024

Moanwar commented Oct 16, 2024

AdrianoDee commented Oct 16, 2024

cmsbuild commented Oct 17, 2024

mmusich commented Oct 17, 2024

mmusich commented Oct 17, 2024

mmusich commented Oct 17, 2024 • edited Loading

Moanwar commented Oct 17, 2024

cmsbuild commented Oct 17, 2024

Comparison Summary

AdrianoDee commented Oct 17, 2024

cmsbuild commented Oct 17, 2024

mandrenguyen commented Oct 18, 2024

mmusich commented Oct 15, 2024 •

edited

Loading

cmsbuild commented Oct 15, 2024 •

edited

Loading

cmsbuild commented Oct 15, 2024 •

edited

Loading

mmusich commented Oct 17, 2024 •

edited

Loading