[Do not merge] Testing flto=auto scram build time

[smuzaffar]

SCRAM build times:

• -flto: 128m (from 22:37 to 00:55)
• -flto=auto: 138m (from 16:27 to 18:45)
• -flto=jobserver: 145m (From 05:23 to 07:48)

[smuzaffar]

test parameters:

• full_cmssw = true

[cmsbuild]

A new Pull Request was created by @smuzaffar (Malik Shahzad Muzaffar) for branch IB/CMSSW_13_3_X/master.

@cmsbuild, @smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.
cms-bot commands are listed here

[smuzaffar]

please test

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a00851/34085/summary.html
COMMIT: dc08e44
CMSSW: CMSSW_13_3_X_2023-08-04-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8636/34085/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @hatakeyamak Updates to PFClusterMatchedToPhotonsSelector for PF ECAL cluster calibration cmssw#42436
• @fabiocos MTD simulation: update trackId for BTL PSimHits cmssw#42455
• @bsunanda Run3-hcx352 Try to avoid wrong list of SD names of HCAL while using DD4hep cmssw#42463
• @bundocka L1T: add puppi jet requirement for filling zpt in L1Ntuples cmssw#42466
• @iarspider AVXVec: replace 2*insertf128 with 1*_mm256_set_m128d cmssw#42446
• @bsunanda Phase2-hgx343 Try to retrieve missing hits in the partial wafers of HGCal for DD4Hep description cmssw#42442
• @fwyzard Extend convertToRaw to support different input collection names cmssw#42457
• @cms-sw Python packages: Updates versions with security fixes #8633
• @cms-sw Fasthadd: move back to master repo after merging cms-sw/cmssw#42228 #8628
• @aandvalenzuela Update ROOT in master with v6.26 patches #8630

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a00851/34085/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a00851/34085/git-merge-result

Comparison Summary

Summary:

• You potentially removed 174 lines from the logs
• Reco comparison results: 3417 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3150821
• DQMHistoTests: Total failures: 1675
• DQMHistoTests: Total nulls: 8
• DQMHistoTests: Total successes: 3149116
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
• Checked 207 log files, 159 edm output root files, 48 DQM output files
• TriggerResults: found differences in 1 / 46 workflows

[smuzaffar]

with -flto scram took 128 mins to compile full cmssw

[smuzaffar]

please test

[cmsbuild]

Pull request #8636 was updated.

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a00851/34098/summary.html
COMMIT: faa7410
CMSSW: CMSSW_13_3_X_2023-08-05-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8636/34098/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @cms-sw drop py3-py package which is now part of pytest #8637

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a00851/34098/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a00851/34098/git-merge-result

Comparison Summary

Summary:

• You potentially removed 163 lines from the logs
• Reco comparison results: 7 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3150821
• DQMHistoTests: Total failures: 3
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3150796
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
• Checked 207 log files, 159 edm output root files, 48 DQM output files
• TriggerResults: no differences found

[smuzaffar]

with -flto=auto build took 138mins [a] (from 16:27 to 18:45)

[smuzaffar]

please test

lets try jobserver option

[cmsbuild]

Pull request #8636 was updated.

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a00851/34103/summary.html
COMMIT: 56578ed
CMSSW: CMSSW_13_3_X_2023-08-05-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8636/34103/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @bsunanda Run3-sim146 Modify the utility to dump sensitive detector for DDD and DD4hep option cmssw#42472
• @aloeliger Add bit wise unity initialization for default LUT arrays cmssw#42390
• @CMS-LUMI-POG Pileup 2023 august cmssw#42474
• @mmusich Fix approximated SiStrip clusters workflow by saving SiStrip FED error information  cmssw#42475
• @cms-sw drop py3-py package which is now part of pytest #8637
• @cms-sw Define c++ standard in one place #8617

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a00851/34103/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a00851/34103/git-merge-result

Comparison Summary

Summary:

• You potentially removed 161 lines from the logs
• Reco comparison results: 3 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3150821
• DQMHistoTests: Total failures: 0
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3150799
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
• Checked 207 log files, 159 edm output root files, 48 DQM output files
• TriggerResults: no differences found