BuildRule: set env SCRAM_ALPAKA_BACKEND for unit tests

[smuzaffar]

New build rules now can set SCRAM_ALPAKA_BACKEND env to one of the valid alpaka backends e.g SerialSync, CudaAsync, ROCmAsync during the scram build runtests.

[smuzaffar]

test parameters:

• full_cmssw = true
• enable = gpu

[cmsbuild]

A new Pull Request was created by @smuzaffar for branch IB/CMSSW_14_1_X/master.

@smuzaffar, @iarspider, @aandvalenzuela, @cmsbuild can you please review it and eventually sign? Thanks.
@rappoccio, @sextonkennedy, @antoniovilela you are the release manager for this.
cms-bot commands are listed here

[cmsbuild]

cms-bot internal usage

[smuzaffar]

please test

[fwyzard]

@smuzaffar, would it be possible to use either

• serial_sync, cuda_async, rocm_async
• or SerialSync, CudaAsync, ROCmAsync

?

We already have two set of names to handle, I would prefer to avoid introducing a third one 🤷🏻‍♂️

[smuzaffar]

scram knows SerialSync, CudaAsync, ROCmAsync , so I can use these

[cmsbuild]

Pull request #9068 was updated.

[smuzaffar]

please test

[cmsbuild]

-1

Failed Tests: GpuUnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e5663a/38104/summary.html
COMMIT: 618f529
CMSSW: CMSSW_14_1_X_2024-03-13-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/9068/38104/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @iarspider [ROOTMaster] Fix include for RNTuple* (redo of #44256) cmssw#44328
• @valsdav Updating ONNXRuntime to 1.17.1 cmssw#44354
• @mmusich add input / output LA TkDetMaps in SiStripLorentzAnglePCLHarvester cmssw#44370
• @fwyzard Update to CUDA 12.4.0 #9046

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e5663a/38104/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e5663a/38104/git-merge-result

GPU Unit Tests

I found 1 errors in the following unit tests:

---> test testTFVisibleDevicesCUDA had ERRORS

Comparison Summary

Summary:

• You potentially removed 72 lines from the logs
• Reco comparison results: 57 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3297383
• DQMHistoTests: Total failures: 6
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3297357
• DQMHistoTests: Total skipped: 20
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
• Checked 202 log files, 165 edm output root files, 48 DQM output files
• TriggerResults: no differences found

GPU Comparison Summary

Summary:

• You potentially removed 8 lines from the logs
• Reco comparison results: 48 differences found in the comparisons
• DQMHistoTests: Total files compared: 3
• DQMHistoTests: Total histograms compared: 39740
• DQMHistoTests: Total failures: 1148
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 38592
• DQMHistoTests: Total skipped: 0
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 2 files compared)
• Checked 8 log files, 10 edm output root files, 3 DQM output files
• TriggerResults: no differences found

[smuzaffar]

+externals

TF gpu unit test is known failure in GPU IBs

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_14_1_X/master IBs (but tests are reportedly failing). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @rappoccio, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)