save crab-prod as crab-pre, then bump to v3.231101

[belforte]

after v3.231101 client was validated on all CMSSW release series in our list dmwm/CRABClient#5271

[cmsbuild]

A new Pull Request was created by @belforte (Stefano Belforte) for branch IB/CMSSW_14_0_X/master.

@iarspider, @aandvalenzuela, @smuzaffar, @cmsbuild can you please review it and eventually sign? Thanks.
@rappoccio, @sextonkennedy, @antoniovilela you are the release manager for this.
cms-bot commands are listed here

[smuzaffar]

please test

[smuzaffar]

+externals

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_14_0_X/master IBs after it passes the integration tests. This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @rappoccio, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7475c9/36307/summary.html
COMMIT: bddedc2
CMSSW: CMSSW_14_0_X_2023-12-03-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8856/36307/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @mkirsano upgrade lhapdf to 6.5.4, sets to 6.5.1c #8852

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7475c9/36307/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7475c9/36307/git-merge-result

Comparison Summary

Summary:

• You potentially added 55 lines to the logs
• Reco comparison results: 800 differences found in the comparisons
• DQMHistoTests: Total files compared: 50
• DQMHistoTests: Total histograms compared: 3370032
• DQMHistoTests: Total failures: 4871
• DQMHistoTests: Total nulls: 3
• DQMHistoTests: Total successes: 3365136
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.02 KiB( 49 files compared)
• DQMHistoSizes: changed ( 141.044 ): 0.020 KiB JetMET/SUSYDQM
• Checked 214 log files, 167 edm output root files, 50 DQM output files
• TriggerResults: no differences found