scripts for running MPI jobs in the CMSSW environment

[fwyzard]

PR description:

Add two scripts for running MPI jobs in the CMSSW environment:

• cmsenv_mpirun is a wrapper around mpirun; it uses cmsenv_orted as the remote "agent" and sets its verbose and release flags according to the other MPI flags;
• cmsenv_orted is a wrapper around orted; it loads the CMSSW environment and passes it to the requested command(s).

PR validation:

Tested with testMPI:

$ cmsenv_mpirun --verbose -H localhost -np 1 $CMSSW_RELEASE_BASE/test/$SCRAM_ARCH/testMPI : -H fu-c2a02-37-02.cms -np 3 -oversubscribe $CMSSW_RELEASE_BASE/test/$SCRAM_ARCH/testMPI

        Number of Processes 4
        Number of workSplit First 7
        Number of workSplit Second 0

                (1) Non-Blocking Scatter 


        =============================================================
        || Func ||  Scatter/Send ||   Gather/Receive  || Number Run||
        =============================================================
        ||  1   ||     2.0788    ||        0.1752     ||      5    ||
        =============================================================

[fwyzard]

please test

[fwyzard]

+heterogeneous

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-36109/26608

• This PR adds an extra 12KB to repository

[cmsbuild]

A new Pull Request was created by @fwyzard (Andrea Bocci) for master.

It involves the following packages:

• HeterogeneousCore/MPICore (heterogeneous)

can you please review it and eventually sign? Thanks.
@makortel, @rovere this is something you requested to watch as well.
@perrotta, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-fdd68f/20511/summary.html
COMMIT: 9a3c39a
CMSSW: CMSSW_12_2_X_2021-11-12-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/36109/20511/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 42
• DQMHistoTests: Total histograms compared: 2902040
• DQMHistoTests: Total failures: 0
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 2902018
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 41 files compared)
• Checked 177 log files, 37 edm output root files, 42 DQM output files
• TriggerResults: no differences found

[qliphy]

+1