Run3-hcx170B Backport PRs #42463, #42496, #42549, #42550, #42557, #42578 to fix run3 scenario in CMSSW version 13_1_X due to issues in HCAL #42620

bsunanda · 2023-08-21T16:56:13Z

PR description:

Backport PRs #42463, #42496, #42549, #42550, #42557, #42578 to fix run3 scenario in CMSSW version 13_1_X due to issues in HCAL

PR validation:

Use the runTheMatrix test workflows

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

Backport parts of PRs #42463, #42496, #42549, #42550, #42557, #42578

…ms-sw#42557, cms-sw#42578 to fix run3 scenario in CMSSW version 13_1_X due to issues in HCAL

cmsbuild · 2023-08-21T16:56:44Z

A new Pull Request was created by @bsunanda (Sunanda Banerjee) for CMSSW_13_1_X.

It involves the following packages:

Configuration/Geometry (geometry, upgrade)
Geometry/CMSCommonData (geometry, upgrade)
Geometry/HcalCommonData (geometry)
Geometry/HcalSimData (geometry)

@civanch, @Dr15Jones, @bsunanda, @makortel, @mdhildreth, @cmsbuild, @AdrianoDee, @srimanob can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @missirol, @fabiocos, @slomeo, @vargasa this is something you requested to watch as well.
@perrotta, @dpiparo, @antoniovilela, @rappoccio you are the release manager for this.

cms-bot commands are listed here

bsunanda · 2023-08-21T17:00:09Z

@cmsbuild Please test

cmsbuild · 2023-08-21T19:26:19Z

-1

Failed Tests: UnitTests RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3260fe/34391/summary.html
COMMIT: 93cb78f
CMSSW: CMSSW_13_1_X_2023-08-21-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42620/34391/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found errors in the following unit tests:

---> test test2021Geometry had ERRORS

RelVals

11634.911

----- Begin Fatal Exception 21-Aug-2023 19:36:38 CEST-----------------------
An exception of category 'StdException' occurred while
   [0] Processing global begin Run run: 1
   [1] Prefetching for module OscarMTProducer/'g4SimHits'
   [2] Prefetching for EventSetup module MuonOffsetESProducer/'muonOffsetESProducer'
   [3] Prefetching for EventSetup module DDCompactViewESProducer/''
   [4] Calling method for EventSetup module DDDetectorESProducer/''
Exception Message:
A std::exception was thrown.
An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file Geometry/HcalCommonData/data/hcalsens/2021/v2/hcalsenspmf.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42620/34391/CMSSW_13_1_X_2023-08-21-1100/poison:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42620/34391/CMSSW_13_1_X_2023-08-21-1100/src:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42620/34391/CMSSW_13_1_X_2023-08-21-1100/external/el8_amd64_gcc11/data:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02799/el8_amd64_gcc11/cms/cmssw-patch/CMSSW_13_1_X_2023-08-21-1100/poison:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02799/el8_amd64_gcc11/cms/cmssw-patch/CMSSW_13_1_X_2023-08-21-1100/src:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02799/el8_amd64_gcc11/cms/cmssw-patch/CMSSW_13_1_X_2023-08-21-1100/external/el8_amd64_gcc11/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/11634.911_TTbar_14TeV+2021_DD4hep

dd4hep: Error interpreting XML nodes of type <Include/>
dd4hep: Error interpreting XML nodes of type <IncludeSection/>
dd4hep: while parsing /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42620/34391/CMSSW_13_1_X_2023-08-21-1100/src/Geometry/CMSCommonData/data/dd4hep/cmsExtendedGeometry2021.xml
dd4hep: with plugin:DD4hep_CompactLoader
----- End Fatal Exception -------------------------------------------------

cmsbuild · 2023-08-22T01:56:11Z

Pull request #42620 was updated. @civanch, @Dr15Jones, @bsunanda, @makortel, @mdhildreth, @cmsbuild, @AdrianoDee, @srimanob can you please check and sign again.

bsunanda · 2023-08-22T01:58:02Z

@cmsbuild Please test

cmsbuild · 2023-08-22T06:42:01Z

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3260fe/34400/summary.html
COMMIT: fcbe7fa
CMSSW: CMSSW_13_1_X_2023-08-21-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42620/34400/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found errors in the following unit tests:

---> test test2021Geometry had ERRORS

Comparison Summary

Summary:

You potentially added 19 lines to the logs
Reco comparison results: 3039 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3186945
DQMHistoTests: Total failures: 5375
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3181548
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 207 log files, 159 edm output root files, 48 DQM output files
TriggerResults: found differences in 1 / 46 workflows

bsunanda · 2023-08-31T09:21:07Z

+geometry

cmsbuild · 2023-08-31T09:45:03Z

Pull request #42620 was updated. @civanch, @Dr15Jones, @bsunanda, @makortel, @mdhildreth, @cmsbuild, @AdrianoDee, @srimanob can you please check and sign again.

bsunanda · 2023-08-31T11:27:20Z

@cmsbuild Please test

cmsbuild · 2023-08-31T15:14:33Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3260fe/34557/summary.html
COMMIT: 536ac5b
CMSSW: CMSSW_13_1_X_2023-08-31-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/42620/34557/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially removed 16 lines from the logs
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 1
DQMHistoTests: Total histograms compared: 0
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 0
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 207 log files, 159 edm output root files, 1 DQM output files

civanch · 2023-09-13T08:30:06Z

+1

srimanob · 2023-12-12T16:35:17Z

@cms-sw/orp-l2 @bsunanda
How about this PR? Do we still need it?

civanch · 2023-12-12T18:40:05Z

@bsunanda , likely this PR may be closed.

antoniovilela · 2023-12-18T23:46:29Z

@bsunanda , likely this PR may be closed.

Let's close.

antoniovilela · 2023-12-18T23:46:35Z

please close

Backport PRs cms-sw#42463, cms-sw#42496, cms-sw#42549, cms-sw#42550, c…

93cb78f

…ms-sw#42557, cms-sw#42578 to fix run3 scenario in CMSSW version 13_1_X due to issues in HCAL

cmsbuild added this to the CMSSW_13_1_X milestone Aug 21, 2023

cmsbuild added geometry-pending pending-signatures tests-pending orp-pending upgrade-pending labels Aug 21, 2023

cmsbuild added tests-started and removed tests-pending labels Aug 21, 2023

cmsbuild added tests-rejected and removed tests-started labels Aug 21, 2023

Add the missing files

fcbe7fa

cmsbuild added tests-pending and removed tests-rejected labels Aug 22, 2023

cmsbuild added tests-started and removed tests-pending labels Aug 22, 2023

cmsbuild added tests-rejected and removed tests-started labels Aug 22, 2023

cmsbuild added geometry-approved and removed geometry-pending labels Aug 31, 2023

Missed out updates

536ac5b

cmsbuild removed geometry-approved tests-rejected labels Aug 31, 2023

cmsbuild added geometry-pending tests-pending labels Aug 31, 2023

cmsbuild added tests-started and removed tests-pending labels Aug 31, 2023

cmsbuild added tests-approved and removed tests-started labels Aug 31, 2023

cmsbuild added geometry-approved and removed geometry-pending labels Sep 13, 2023

cmsbuild closed this Dec 18, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Run3-hcx170B Backport PRs #42463, #42496, #42549, #42550, #42557, #42578 to fix run3 scenario in CMSSW version 13_1_X due to issues in HCAL #42620

Run3-hcx170B Backport PRs #42463, #42496, #42549, #42550, #42557, #42578 to fix run3 scenario in CMSSW version 13_1_X due to issues in HCAL #42620

bsunanda commented Aug 21, 2023

cmsbuild commented Aug 21, 2023 •

edited

Loading

bsunanda commented Aug 21, 2023

cmsbuild commented Aug 21, 2023

cmsbuild commented Aug 22, 2023

bsunanda commented Aug 22, 2023

cmsbuild commented Aug 22, 2023

bsunanda commented Aug 31, 2023

cmsbuild commented Aug 31, 2023

bsunanda commented Aug 31, 2023

cmsbuild commented Aug 31, 2023

civanch commented Sep 13, 2023

srimanob commented Dec 12, 2023

civanch commented Dec 12, 2023

antoniovilela commented Dec 18, 2023

antoniovilela commented Dec 18, 2023

Run3-hcx170B Backport PRs #42463, #42496, #42549, #42550, #42557, #42578 to fix run3 scenario in CMSSW version 13_1_X due to issues in HCAL #42620

Run3-hcx170B Backport PRs #42463, #42496, #42549, #42550, #42557, #42578 to fix run3 scenario in CMSSW version 13_1_X due to issues in HCAL #42620

Conversation

bsunanda commented Aug 21, 2023

PR description:

PR validation:

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

cmsbuild commented Aug 21, 2023 • edited Loading

bsunanda commented Aug 21, 2023

cmsbuild commented Aug 21, 2023

Unit Tests

RelVals

cmsbuild commented Aug 22, 2023

bsunanda commented Aug 22, 2023

cmsbuild commented Aug 22, 2023

Unit Tests

Comparison Summary

bsunanda commented Aug 31, 2023

cmsbuild commented Aug 31, 2023

bsunanda commented Aug 31, 2023

cmsbuild commented Aug 31, 2023

Comparison Summary

civanch commented Sep 13, 2023

srimanob commented Dec 12, 2023

civanch commented Dec 12, 2023

antoniovilela commented Dec 18, 2023

antoniovilela commented Dec 18, 2023

cmsbuild commented Aug 21, 2023 •

edited

Loading