[Aarch64] Build with -march=armv8-a #7593

smuzaffar · 2022-01-30T10:49:55Z

This PR disables the outline atomics for gcc 11 on aarch64. see cms-sw/cmssw#36788 where we think that aarch64 relvals might be failing due to outline atomics (enabled by defaults for GCC 10.1 and above).

smuzaffar · 2022-01-30T10:50:07Z

please test for slc7_aarch64_gcc11

cmsbuild · 2022-01-30T10:50:19Z

A new Pull Request was created by @smuzaffar (Malik Shahzad Muzaffar) for branch IB/CMSSW_12_3_X/g11.

@smuzaffar, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @qliphy you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2022-01-30T20:34:44Z

-1

Failed Tests: UnitTests RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9e59f8/22083/summary.html
COMMIT: b5f5d63
CMSSW: CMSSW_12_3_X_2022-01-28-2300/slc7_aarch64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/7593/22083/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found errors in the following unit tests:

---> test testFWCoreConcurrency had ERRORS
---> test TestFWCoreServicesDriver had ERRORS
---> test testFWCoreUtilities had ERRORS

RelVals

4.53

----- Begin Fatal Exception 30-Jan-2022 20:38:33 CET-----------------------
An exception of category 'Vertex' occurred while
   [0] Processing  Event run: 194533 lumi: 329 event: 462355458 stream: 0
   [1] Running path 'dqmofflineOnPAT_1_step'
   [2] Prefetching for module SingleTopTChannelLeptonDQM_miniAOD/'singleTopElectronMediumDQM_miniAOD'
   [3] Prefetching for module PATMuonSlimmer/'slimmedMuons'
   [4] Prefetching for module PATMuonSelector/'selectedPatMuons'
   [5] Prefetching for module PATMuonProducer/'patMuons'
   [6] Prefetching for module MuonProducer/'muons'
   [7] Prefetching for module PFProducer/'particleFlowTmp'
   [8] Prefetching for module PFBlockProducer/'particleFlowBlock'
   [9] Prefetching for module PFElecTkProducer/'pfTrackElec'
   [10] Prefetching for module PFConversionProducer/'pfConversions'
   [11] Calling method for module ConversionProducer/'allConversions'
Exception Message:
Refitted track not found in list
----- End Fatal Exception -------------------------------------------------

140.56

----- Begin Fatal Exception 30-Jan-2022 20:47:29 CET-----------------------
An exception of category 'Vertex' occurred while
   [0] Processing  Event run: 326479 lumi: 7 event: 1579493 stream: 0
   [1] Running path 'dqmoffline_8_step'
   [2] Prefetching for module SMPDQM/'SMPDQM'
   [3] Prefetching for module MuonProducer/'muons'
   [4] Prefetching for module PFProducer/'particleFlowTmp'
   [5] Prefetching for module PFBlockProducer/'particleFlowBlock'
   [6] Prefetching for module PFElecTkProducer/'pfTrackElec'
   [7] Prefetching for module PFConversionProducer/'pfConversions'
   [8] Calling method for module ConversionProducer/'allConversions'
Exception Message:
Refitted track not found in list
----- End Fatal Exception -------------------------------------------------

136.874

----- Begin Fatal Exception 30-Jan-2022 21:01:23 CET-----------------------
An exception of category 'Vertex' occurred while
   [0] Processing  Event run: 319450 lumi: 76 event: 106007323 stream: 0
   [1] Running path 'dqmoffline_10_step'
   [2] Prefetching for module SMPDQM/'SMPDQM'
   [3] Prefetching for module MuonProducer/'muons'
   [4] Prefetching for module PFProducer/'particleFlowTmp'
   [5] Prefetching for module PFBlockProducer/'particleFlowBlock'
   [6] Prefetching for module PFElecTkProducer/'pfTrackElec'
   [7] Prefetching for module PFConversionProducer/'pfConversions'
   [8] Calling method for module ConversionProducer/'allConversions'
Exception Message:
Refitted track not found in list
----- End Fatal Exception -------------------------------------------------

smuzaffar · 2022-01-31T06:18:59Z

test parameters:

full_cmssw = true

cmsbuild · 2022-01-31T06:19:05Z

Pull request #7593 was updated.

smuzaffar · 2022-01-31T07:16:00Z

please test

cmsbuild · 2022-01-31T07:16:04Z

Pull request #7593 was updated.

smuzaffar · 2022-01-31T07:22:24Z

please test for slc7_aarch64_gcc11

smuzaffar · 2022-01-31T09:16:45Z

please test for slc7_amd64_gcc11

cmsbuild · 2022-01-31T13:37:35Z

-1

Failed Tests: UnitTests RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9e59f8/22091/summary.html
COMMIT: 0e2b91e
CMSSW: CMSSW_12_3_X_2022-01-28-2300/slc7_aarch64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/7593/22091/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@perrotta Synchronize LHEGenericMassFilter with the latest updates merged in 10_6 cmssw#36838

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9e59f8/22091/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9e59f8/22091/git-merge-result

Unit Tests

I found errors in the following unit tests:

---> test testFWCoreConcurrency had ERRORS
---> test TestFWCoreServicesDriver had ERRORS
---> test testFWCoreUtilities had ERRORS

RelVals

4.53

----- Begin Fatal Exception 31-Jan-2022 13:35:04 CET-----------------------
An exception of category 'Vertex' occurred while
   [0] Processing  Event run: 194533 lumi: 329 event: 462355458 stream: 0
   [1] Running path 'dqmofflineOnPAT_1_step'
   [2] Prefetching for module SingleTopTChannelLeptonDQM_miniAOD/'singleTopElectronMediumDQM_miniAOD'
   [3] Prefetching for module PATMuonSlimmer/'slimmedMuons'
   [4] Prefetching for module PATMuonSelector/'selectedPatMuons'
   [5] Prefetching for module PATMuonProducer/'patMuons'
   [6] Prefetching for module MuonProducer/'muons'
   [7] Prefetching for module PFProducer/'particleFlowTmp'
   [8] Prefetching for module PFBlockProducer/'particleFlowBlock'
   [9] Prefetching for module PFElecTkProducer/'pfTrackElec'
   [10] Prefetching for module PFConversionProducer/'pfConversions'
   [11] Calling method for module ConversionProducer/'allConversions'
Exception Message:
Refitted track not found in list
----- End Fatal Exception -------------------------------------------------

140.56

----- Begin Fatal Exception 31-Jan-2022 13:45:13 CET-----------------------
An exception of category 'Vertex' occurred while
   [0] Processing  Event run: 326479 lumi: 7 event: 1579493 stream: 0
   [1] Running path 'dqmoffline_8_step'
   [2] Prefetching for module SMPDQM/'SMPDQM'
   [3] Prefetching for module MuonProducer/'muons'
   [4] Prefetching for module PFProducer/'particleFlowTmp'
   [5] Prefetching for module PFBlockProducer/'particleFlowBlock'
   [6] Prefetching for module PFElecTkProducer/'pfTrackElec'
   [7] Prefetching for module PFConversionProducer/'pfConversions'
   [8] Calling method for module ConversionProducer/'allConversions'
Exception Message:
Refitted track not found in list
----- End Fatal Exception -------------------------------------------------

136.874

----- Begin Fatal Exception 31-Jan-2022 14:00:14 CET-----------------------
An exception of category 'Vertex' occurred while
   [0] Processing  Event run: 319450 lumi: 76 event: 106007323 stream: 0
   [1] Running path 'dqmoffline_10_step'
   [2] Prefetching for module SMPDQM/'SMPDQM'
   [3] Prefetching for module MuonProducer/'muons'
   [4] Prefetching for module PFProducer/'particleFlowTmp'
   [5] Prefetching for module PFBlockProducer/'particleFlowBlock'
   [6] Prefetching for module PFElecTkProducer/'pfTrackElec'
   [7] Prefetching for module PFConversionProducer/'pfConversions'
   [8] Calling method for module ConversionProducer/'allConversions'
Exception Message:
Refitted track not found in list
----- End Fatal Exception -------------------------------------------------

cmsbuild · 2022-01-31T19:55:12Z

-1

Failed Tests: Build
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9e59f8/22096/summary.html
COMMIT: 0e2b91e
CMSSW: CMSSW_12_3_X_2022-01-26-1100/slc7_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/7593/22096/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9e59f8/22096/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9e59f8/22096/git-merge-result

Build

I found compilation error when building:

Entering library rule at RecoLocalTracker/ClusterParameterEstimator
>> Compiling  /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_12_3_X_2022-01-26-1100/src/RecoLocalTracker/ClusterParameterEstimator/src/module.cc
>> Building  shared library tmp/slc7_amd64_gcc11/src/RecoLocalTracker/ClusterParameterEstimator/src/RecoLocalTrackerClusterParameterEstimator/libRecoLocalTrackerClusterParameterEstimator.so
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/slc7_amd64_gcc11/external/gcc/11.2.1-d3b3c351517711c3f0625e6e9a9a8aec/bin/../lib/gcc/x86_64-unknown-linux-gnu/11.2.1/../../../../x86_64-unknown-linux-gnu/bin/ld: cannot find -lTrackingToolsTrajectoryState
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/slc7_amd64_gcc11/external/gcc/11.2.1-d3b3c351517711c3f0625e6e9a9a8aec/bin/../lib/gcc/x86_64-unknown-linux-gnu/11.2.1/../../../../x86_64-unknown-linux-gnu/bin/ld: cannot find -lTrackingToolsAnalyticalJacobians
collect2: error: ld returned 1 exit status
gmake: *** [tmp/slc7_amd64_gcc11/src/RecoLocalTracker/ClusterParameterEstimator/src/RecoLocalTrackerClusterParameterEstimator/libRecoLocalTrackerClusterParameterEstimator.so] Error 1
Leaving library rule at RecoLocalTracker/ClusterParameterEstimator
>> Leaving Package RecoLocalTracker/ClusterParameterEstimator
>> Leaving Package RecoLocalMuon/CSCValidation
>> Package RecoLocalTracker/ClusterParameterEstimator built

cmsbuild · 2022-02-03T07:06:50Z

Pull request #7593 was updated.

smuzaffar and others added 3 commits January 28, 2022 17:10

build aarch64 with -mcpu=armv8-a

8efa3c7

Update compilation_flags.file

aa85d0c

Update compilation_flags.file

24ba7cd

cmsbuild added externals-pending orp-pending pending-signatures tests-started labels Jan 30, 2022

cmsbuild added tests-rejected and removed tests-started labels Jan 30, 2022

smuzaffar mentioned this pull request Jan 30, 2022

[AArch64] build cmssw aarch64 with -mno-outline-atomics file #7582

Closed

smuzaffar added 2 commits January 31, 2022 07:12

disable gcc outline atomics by default; grpc, root.boot to use armv8a

d06d3c4

fix boost flags

17351ea

smuzaffar force-pushed the smuzaffar-patch-1 branch from b5f5d63 to 17351ea Compare January 31, 2022 06:18

cmsbuild added tests-pending and removed tests-rejected labels Jan 31, 2022

smuzaffar added 2 commits January 31, 2022 08:15

typo fixed for compilation_flags

5dabe1b

fix gcc flags for boost

0e2b91e

cmsbuild added tests-started and removed tests-pending labels Jan 31, 2022

cmsbuild added tests-pending and removed tests-started labels Jan 31, 2022

cmsbuild removed the tests-pending label Jan 31, 2022

cmsbuild added the tests-started label Jan 31, 2022

cmsbuild added tests-rejected and removed tests-started labels Jan 31, 2022

Update gcc.spec

90d12bf

cmsbuild added tests-pending and removed tests-rejected labels Feb 3, 2022

smuzaffar changed the title ~~[Aarch64] Disable outline atomic by default for gcc~~ [Aarch64] Build with -march=armv8-a Feb 3, 2022

smuzaffar closed this Feb 3, 2022

smuzaffar deleted the smuzaffar-patch-1 branch February 3, 2022 07:18

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Aarch64] Build with -march=armv8-a #7593

[Aarch64] Build with -march=armv8-a #7593

smuzaffar commented Jan 30, 2022

smuzaffar commented Jan 30, 2022

cmsbuild commented Jan 30, 2022

cmsbuild commented Jan 30, 2022

smuzaffar commented Jan 31, 2022

cmsbuild commented Jan 31, 2022

smuzaffar commented Jan 31, 2022

cmsbuild commented Jan 31, 2022

smuzaffar commented Jan 31, 2022

smuzaffar commented Jan 31, 2022

cmsbuild commented Jan 31, 2022

cmsbuild commented Jan 31, 2022

cmsbuild commented Feb 3, 2022

[Aarch64] Build with -march=armv8-a #7593

[Aarch64] Build with -march=armv8-a #7593

Conversation

smuzaffar commented Jan 30, 2022

smuzaffar commented Jan 30, 2022

cmsbuild commented Jan 30, 2022

cmsbuild commented Jan 30, 2022

Unit Tests

RelVals

smuzaffar commented Jan 31, 2022

cmsbuild commented Jan 31, 2022

smuzaffar commented Jan 31, 2022

cmsbuild commented Jan 31, 2022

smuzaffar commented Jan 31, 2022

smuzaffar commented Jan 31, 2022

cmsbuild commented Jan 31, 2022

Unit Tests

RelVals

cmsbuild commented Jan 31, 2022

Build

cmsbuild commented Feb 3, 2022