[Do not merge] Test cmssw build image #8626

aandvalenzuela · 2023-08-01T08:28:51Z

No description provided.

cmsbuild · 2023-08-01T08:29:14Z

A new Pull Request was created by @aandvalenzuela (Andrea Valenzuela) for branch IB/CMSSW_13_3_X/master.

@cmsbuild, @smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.
cms-bot commands are listed here

aandvalenzuela · 2023-08-01T08:31:10Z

test parameters:

full_cmssw = true
container = cmssw/el8:x86_64-buildtime

aandvalenzuela · 2023-08-01T08:32:05Z

please test

cmsbuild · 2023-08-01T08:35:32Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-97e9c4/34004/summary.html
COMMIT: 9cff4f6
CMSSW: CMSSW_13_3_X_2023-07-31-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8626/34004/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation warning when building: See details on the summary page.

aandvalenzuela · 2023-08-01T08:37:46Z

Updating image with the missing pkgs (libaio missing and probably the other lib* packages that we discussed on Friday @smuzaffar)

smuzaffar · 2023-08-01T08:42:38Z

wait @aandvalenzuela , let me check something

aandvalenzuela · 2023-08-01T08:43:51Z

Right, I am checking the bootstrap, because I did not find libaio in my case, but the package is there in the regular driver

smuzaffar · 2023-08-01T08:58:38Z

looks like libaio needs to go in to runtime image as it is needed at runtime ( by oracle libs)

aandvalenzuela · 2023-08-01T09:59:01Z

please test

cmsbuild · 2023-08-01T10:00:30Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-97e9c4/34005/summary.html
COMMIT: 9cff4f6
CMSSW: CMSSW_13_3_X_2023-07-31-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8626/34005/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation warning when building: See details on the summary page.

aandvalenzuela · 2023-08-01T10:05:53Z

My bad, I have only rebuilt runtime image

aandvalenzuela · 2023-08-01T12:45:43Z

please test

cmsbuild · 2023-08-01T13:48:04Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-97e9c4/34010/summary.html
COMMIT: 9cff4f6
CMSSW: CMSSW_13_3_X_2023-08-01-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8626/34010/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation error when building:

config.status: creating config.h
config.status: executing depfiles commands
config.status: executing libtool commands
make[1]: Leaving directory '/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el8_amd64_gcc11/external/gcc/11.4.1-ae3b7c548e2155e5823eb0cc2662564a/binutils-2.40'
make: *** [Makefile:1005: all] Error 2
error: Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.47LE9u (%build)


RPM build errors:
line 35: It's not recommended to have unversioned Obsoletes: Obsoletes: external+gcc+11.4.1-ae3b7c548e2155e5823eb0cc2662564a
Macro expanded in comment on line 364: %{pkginstroot}/lib64

cmsbuild · 2023-08-03T18:14:01Z

-1

Failed Tests: Build
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-97e9c4/34067/summary.html
COMMIT: 9cff4f6
CMSSW: CMSSW_13_3_X_2023-08-03-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8626/34067/install.sh to create a dev area with all the needed externals and cmssw changes.

Build

I found compilation error when building:

>> Compiling edm plugin /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_3_X_2023-08-03-1100/src/CalibCalorimetry/EcalPedestalOffsets/src/testChannel.cc
>> Building edm plugin tmp/el8_amd64_gcc11/src/CalibCalorimetry/EcalPedestalOffsets/src/CalibCalorimetryEcalPedestalOffsets/libCalibCalorimetryEcalPedestalOffsets.so
lto-wrapper: warning: using serial compilation of 2 LTRANS jobs
Leaving library rule at CalibCalorimetry/EcalPedestalOffsets
@@@@ Running edmWriteConfigs for CalibCalorimetryEcalPedestalOffsets
error: edmWriteConfigs caught an exception while loading a plugin library.
The executable will return success (0) so scram will continue,
but no cfi files will be written.
An exception of category 'PluginLibraryLoadError' occurred.
Exception Message:
unable to load /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_13_3_X_2023-08-03-1100/tmp/el8_amd64_gcc11/src/CalibCalorimetry/EcalPedestalOffsets/src/CalibCalorimetryEcalPedestalOffsets/libCalibCalorimetryEcalPedestalOffsets.so because libnsl.so.1: cannot open shared object file: No such file or directory

aandvalenzuela · 2023-08-04T09:53:19Z

please test

cmsbuild · 2023-08-04T15:17:07Z

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-97e9c4/34075/summary.html
COMMIT: 9cff4f6
CMSSW: CMSSW_13_3_X_2023-08-03-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8626/34075/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found errors in the following unit tests:

---> test test_CreateFileLists had ERRORS
---> test validateAlignments had ERRORS
---> test SubmitPVsplit had ERRORS
---> test SubmitPVrbr had ERRORS
and more ...

Comparison Summary

Summary:

You potentially removed 159 lines from the logs
Reco comparison results: 14 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3150821
DQMHistoTests: Total failures: 12
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3150787
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 207 log files, 159 edm output root files, 48 DQM output files
TriggerResults: no differences found

aandvalenzuela · 2023-08-04T16:33:42Z

please test

cmsbuild · 2023-08-05T03:18:07Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-97e9c4/34090/summary.html
COMMIT: 9cff4f6
CMSSW: CMSSW_13_3_X_2023-08-04-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8626/34090/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@hatakeyamak Updates to PFClusterMatchedToPhotonsSelector for PF ECAL cluster calibration cmssw#42436
@fabiocos MTD simulation: update trackId for BTL PSimHits cmssw#42455
@bsunanda Run3-hcx352 Try to avoid wrong list of SD names of HCAL while using DD4hep cmssw#42463
@bundocka L1T: add puppi jet requirement for filling zpt in L1Ntuples cmssw#42466
@iarspider AVXVec: replace 2*insertf128 with 1*_mm256_set_m128d cmssw#42446
@bsunanda Phase2-hgx343 Try to retrieve missing hits in the partial wafers of HGCal for DD4Hep description cmssw#42442
@fwyzard Extend convertToRaw to support different input collection names cmssw#42457
@cms-sw Python packages: Updates versions with security fixes #8633
@cms-sw Fasthadd: move back to master repo after merging cms-sw/cmssw#42228 #8628
@aandvalenzuela Update ROOT in master with v6.26 patches #8630

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-97e9c4/34090/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-97e9c4/34090/git-merge-result

Comparison Summary

Summary:

You potentially removed 180 lines from the logs
Reco comparison results: 3417 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3150821
DQMHistoTests: Total failures: 1675
DQMHistoTests: Total nulls: 8
DQMHistoTests: Total successes: 3149116
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 207 log files, 159 edm output root files, 48 DQM output files
TriggerResults: found differences in 1 / 46 workflows

aandvalenzuela · 2023-08-07T12:22:57Z

please test

rebuilding gcc

cmsbuild · 2023-08-07T12:23:00Z

Pull request #8626 was updated.

cmsbuild · 2023-08-08T03:44:56Z

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-97e9c4/34125/summary.html
COMMIT: 03c44e8
CMSSW: CMSSW_13_3_X_2023-08-07-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8626/34125/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-97e9c4/34125/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-97e9c4/34125/git-merge-result

Unit Tests

I found errors in the following unit tests:

---> test test-das-selected-lumis had ERRORS
---> test test_edmPickEvents had ERRORS

Comparison Summary

Summary:

You potentially removed 185 lines from the logs
Reco comparison results: 8 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3150947
DQMHistoTests: Total failures: 9
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3150916
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 207 log files, 159 edm output root files, 48 DQM output files
TriggerResults: no differences found

aandvalenzuela · 2023-08-08T15:22:04Z

Failing tests are known issues. gcc rebuilds fine.

Dummy comment

9cff4f6

cmsbuild added tests-pending externals-pending pending-signatures orp-pending labels Aug 1, 2023

cmsbuild added tests-started and removed tests-pending labels Aug 1, 2023

cmsbuild added tests-rejected and removed tests-started labels Aug 1, 2023

aandvalenzuela mentioned this pull request Aug 1, 2023

Adding libaio to el8 runtime image cms-sw/cms-docker#199

Merged

cmsbuild added tests-started and removed tests-rejected labels Aug 1, 2023

cmsbuild added tests-rejected and removed tests-started labels Aug 1, 2023

cmsbuild added tests-started and removed tests-rejected labels Aug 1, 2023

cmsbuild removed the tests-started label Aug 1, 2023

cmsbuild added tests-started tests-rejected and removed tests-rejected tests-started labels Aug 3, 2023

cmsbuild added tests-started and removed tests-rejected labels Aug 4, 2023

cmsbuild added tests-rejected and removed tests-started labels Aug 4, 2023

aandvalenzuela mentioned this pull request Aug 4, 2023

Add pkg voms-clients-cpp to el8 runtime image cms-sw/cms-docker#208

Merged

cmsbuild added tests-started and removed tests-rejected labels Aug 4, 2023

cmsbuild added tests-approved and removed tests-started labels Aug 5, 2023

More testing

03c44e8

cmsbuild added tests-pending and removed tests-approved labels Aug 7, 2023

cmsbuild added tests-started and removed tests-pending labels Aug 7, 2023

cmsbuild added tests-rejected and removed tests-started labels Aug 8, 2023

aandvalenzuela closed this Aug 15, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Do not merge] Test cmssw build image #8626

[Do not merge] Test cmssw build image #8626

aandvalenzuela commented Aug 1, 2023

cmsbuild commented Aug 1, 2023

aandvalenzuela commented Aug 1, 2023

aandvalenzuela commented Aug 1, 2023

cmsbuild commented Aug 1, 2023

aandvalenzuela commented Aug 1, 2023 •

edited

Loading

smuzaffar commented Aug 1, 2023

aandvalenzuela commented Aug 1, 2023

smuzaffar commented Aug 1, 2023

aandvalenzuela commented Aug 1, 2023

cmsbuild commented Aug 1, 2023

aandvalenzuela commented Aug 1, 2023

aandvalenzuela commented Aug 1, 2023

cmsbuild commented Aug 1, 2023

cmsbuild commented Aug 3, 2023

aandvalenzuela commented Aug 4, 2023

cmsbuild commented Aug 4, 2023

aandvalenzuela commented Aug 4, 2023

cmsbuild commented Aug 5, 2023

aandvalenzuela commented Aug 7, 2023

cmsbuild commented Aug 7, 2023

cmsbuild commented Aug 8, 2023

aandvalenzuela commented Aug 8, 2023

[Do not merge] Test cmssw build image #8626

[Do not merge] Test cmssw build image #8626

Conversation

aandvalenzuela commented Aug 1, 2023

cmsbuild commented Aug 1, 2023

aandvalenzuela commented Aug 1, 2023

aandvalenzuela commented Aug 1, 2023

cmsbuild commented Aug 1, 2023

External Build

aandvalenzuela commented Aug 1, 2023 • edited Loading

smuzaffar commented Aug 1, 2023

aandvalenzuela commented Aug 1, 2023

smuzaffar commented Aug 1, 2023

aandvalenzuela commented Aug 1, 2023

cmsbuild commented Aug 1, 2023

External Build

aandvalenzuela commented Aug 1, 2023

aandvalenzuela commented Aug 1, 2023

cmsbuild commented Aug 1, 2023

External Build

cmsbuild commented Aug 3, 2023

Build

aandvalenzuela commented Aug 4, 2023

cmsbuild commented Aug 4, 2023

Unit Tests

Comparison Summary

aandvalenzuela commented Aug 4, 2023

cmsbuild commented Aug 5, 2023

Comparison Summary

aandvalenzuela commented Aug 7, 2023

cmsbuild commented Aug 7, 2023

cmsbuild commented Aug 8, 2023

Unit Tests

Comparison Summary

aandvalenzuela commented Aug 8, 2023

aandvalenzuela commented Aug 1, 2023 •

edited

Loading