Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Defect: install.sh ignores -M /opt/amazon/openmpi and wants to install MPICH #736

Open
1 task done
jeffhammond opened this issue Jul 12, 2021 · 1 comment
Open
1 task done
Labels

Comments

@jeffhammond
Copy link
Contributor

The title of the issue should start with Defect: followed by a
succinct title.

Please make sure to put any logs, terminal output, or code in
fenced code blocks. Please also read the contributing guidelines
before submitting a new issue.

Please note we will close your issue without comment if you delete, do not read or do not fill out the issue checklist below and provide ALL the requested information.

  • I am reporting a bug others will be able to reproduce and not asking a question or requesting a new feature.

System information including:

  • OpenCoarrays Version:
[jehammond@ip-10-0-0-25 OpenCoarrays]$ ./install.sh --version
OpenCoarrays 2.9.2

OpenCoarrays installer
Copyright (C) 2015-2016 Sourcery, Inc.
Copyright (C) 2015-2016 Sourcery Institute

OpenCoarrays comes with NO WARRANTY, to the extent permitted by law.
You may redistribute copies of install.sh under the terms of the
BSD 3-Clause License.  For more information about these matters, see
http://www.sourceryinstitute.org/license.html

$ git log -n 1
commit ef8069d94ecd3a0d93e0d4413a63c2366b894130 (HEAD -> main, origin/main, origin/HEAD)
Merge: 5c4bd62 02dce3e
Author: Brad Richardson <everythingfunctional@protonmail.com>
Date:   Wed Mar 17 16:56:47 2021 -0500

    Merge pull request #730 from sourceryinstitute/download-gcc-release-tar-balls
    
    feat(install.sh): download GCC release tar balls
  • Fortran Compiler:
$ gfortran -v
Using built-in specs.
COLLECT_GCC=gfortran
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/aarch64-redhat-linux/7/lto-wrapper
Target: aarch64-redhat-linux
Configured with: ../configure --enable-bootstrap --enable-languages=c,c++,objc,obj-c++,fortran,ada,go,lto --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-shared --enable-threads=posix --enable-checking=release --disable-multilib --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-gcc-major-version-only --with-linker-hash-style=gnu --enable-plugin --enable-initfini-array --with-isl --disable-libmpx --enable-libsanitizer --enable-gnu-indirect-function --disable-libcilkrts --enable-libatomic --disable-libquadmath --enable-libitm --build=aarch64-redhat-linux
Thread model: posix
gcc version 7.3.1 20180712 (Red Hat 7.3.1-13) (GCC) 
  • C compiler used for building lib:
$ gcc -v
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/aarch64-redhat-linux/7/lto-wrapper
Target: aarch64-redhat-linux
Configured with: ../configure --enable-bootstrap --enable-languages=c,c++,objc,obj-c++,fortran,ada,go,lto --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-shared --enable-threads=posix --enable-checking=release --disable-multilib --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-gcc-major-version-only --with-linker-hash-style=gnu --enable-plugin --enable-initfini-array --with-isl --disable-libmpx --enable-libsanitizer --enable-gnu-indirect-function --disable-libcilkrts --enable-libatomic --disable-libquadmath --enable-libitm --build=aarch64-redhat-linux
Thread model: posix
gcc version 7.3.1 20180712 (Red Hat 7.3.1-13) (GCC) 

$ mpicc -v
Using built-in specs.
COLLECT_GCC=/usr/bin/gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/aarch64-redhat-linux/7/lto-wrapper
Target: aarch64-redhat-linux
Configured with: ../configure --enable-bootstrap --enable-languages=c,c++,objc,obj-c++,fortran,ada,go,lto --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-shared --enable-threads=posix --enable-checking=release --disable-multilib --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-gcc-major-version-only --with-linker-hash-style=gnu --enable-plugin --enable-initfini-array --with-isl --disable-libmpx --enable-libsanitizer --enable-gnu-indirect-function --disable-libcilkrts --enable-libatomic --disable-libquadmath --enable-libitm --build=aarch64-redhat-linux
Thread model: posix
gcc version 7.3.1 20180712 (Red Hat 7.3.1-13) (GCC) 
  • Installation method:
    install.sh
  • All flags & options passed to the installer
./install.sh -M /opt/amazon/openmpi
  • Output of uname -a:
$ uname -a
Linux ip-10-0-0-25 4.14.232-177.418.amzn2.aarch64 #1 SMP Tue Jun 15 20:58:11 UTC 2021 aarch64 aarch64 aarch64 GNU/Linux
  • MPI library being used:
$ which mpicc
/opt/amazon/openmpi/bin/mpicc
$ mpicc -show
gcc -I/opt/amazon/openmpi/include -pthread -Wl,-rpath -Wl,/opt/amazon/openmpi/lib64 -Wl,--enable-new-dtags -L/opt/amazon/openmpi/lib64 -lmpi
  • Machine architecture and number of physical cores:

AWS Graviton 2

$ lscpu
Architecture:        aarch64
Byte Order:          Little Endian
CPU(s):              64
On-line CPU(s) list: 0-63
Thread(s) per core:  1
Core(s) per socket:  64
Socket(s):           1
NUMA node(s):        1
Model:               1
BogoMIPS:            243.75
L1d cache:           64K
L1i cache:           64K
L2 cache:            1024K
L3 cache:            32768K
NUMA node0 CPU(s):   0-63
Flags:               fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm lrcpc dcpop asimddp ssbs
  • Version of CMake:
$ cmake --version
cmake version 2.8.12.2

To help us debug your issue please explain:

What you were trying to do (and why)

Install OpenCoarrays on AWS Graviton 2 so that I can build and run the PRK Fortran coarray tests.

What happened (include command output, screenshots, logs, etc.)

$ ./install.sh -M /opt/amazon/openmpi
2021-07-12 13:02:07 UTC [     info] __file: /home/jehammond/OpenCoarrays/install.sh
2021-07-12 13:02:07 UTC [     info] __dir: /home/jehammond/OpenCoarrays
2021-07-12 13:02:07 UTC [     info] __base: install
2021-07-12 13:02:07 UTC [     info] __os: Linux
2021-07-12 13:02:07 UTC [     info] __usage: /home/jehammond/OpenCoarrays/install.sh-usage
2021-07-12 13:02:07 UTC [     info] LOG_LEVEL: 6
2021-07-12 13:02:07 UTC [     info] -b (--install-branch):   
2021-07-12 13:02:07 UTC [     info] -c (--with-c):           
2021-07-12 13:02:07 UTC [     info] -C (--with-cxx):         
2021-07-12 13:02:07 UTC [     info] -d (--debug):            0
2021-07-12 13:02:07 UTC [     info] -D (--print-downloader): 
2021-07-12 13:02:07 UTC [     info] -e (--verbose):          0
2021-07-12 13:02:07 UTC [     info] -f (--with-fortran):     
2021-07-12 13:02:07 UTC [     info] -h (--help):             0
2021-07-12 13:02:07 UTC [     info] -i (--install-prefix):   /home/jehammond/OpenCoarrays/prerequisites/installations//
2021-07-12 13:02:07 UTC [     info] -I (--install-version):  
2021-07-12 13:02:07 UTC [     info] -j (--num-threads):      4
2021-07-12 13:02:07 UTC [     info] -l (--list-packages):    0
2021-07-12 13:02:07 UTC [     info] -m (--with-cmake):       
2021-07-12 13:02:07 UTC [     info] -M (--with-mpi):         /opt/amazon/openmpi
2021-07-12 13:02:07 UTC [     info] -n (--no-color):         0
2021-07-12 13:02:07 UTC [     info] -o (--only-download):    0
2021-07-12 13:02:07 UTC [     info] -p (--package):          opencoarrays
2021-07-12 13:02:07 UTC [     info] -P (--print-path):       
2021-07-12 13:02:07 UTC [     info] -r (--prefix-root):      
2021-07-12 13:02:07 UTC [     info] -u (--from-url):         
2021-07-12 13:02:07 UTC [     info] -U (--print-url):        
2021-07-12 13:02:07 UTC [     info] -v (--version):          0
2021-07-12 13:02:07 UTC [     info] -V (--print-version):    
2021-07-12 13:02:07 UTC [     info] -y (--yes-to-all):       0
2021-07-12 13:02:07 UTC [     info] -Z (--bootstrap):        0
2021-07-12 13:02:07 UTC [     info] num_threads="4"
2021-07-12 13:02:07 UTC [     info] opencoarrays_src_dir=/home/jehammond/OpenCoarrays
2021-07-12 13:02:07 UTC [     info] build_path="/home/jehammond/OpenCoarrays"/prerequisites/builds
2021-07-12 13:02:07 UTC [     info] build_script="/home/jehammond/OpenCoarrays"/prerequisites/build.sh
2021-07-12 13:02:08 UTC [     info] Checking whether the directory /home/jehammond/OpenCoarrays/prerequisites/installations/ exists... 
2021-07-12 13:02:08 UTC [     info] yes
2021-07-12 13:02:08 UTC [     info] Checking whether I have write permissions to /home/jehammond/OpenCoarrays/prerequisites/installations/ ... 
2021-07-12 13:02:08 UTC [     info] yes
__________ Please read these instructions carefully before proceeding. ___________
__________________________________________________________________________________
*** Most end users will find it easier to install OpenCoarrays via the native  ***
*** package manager for the target operating system.  Advanced developers will ***
*** find it best to install via CMake.  Please see the OpenCoarrays README.md  ***
*** for a list of supported package installers or for instructions on using    ***
*** CMake to install.  The current script offers a fallback when other methods ***
*** prove infeasible. This script builds any missing prerequisites from source ***
*** and then builds OpenCoarrays from source.  The process might take a few    ***
*** minutes if the script finds all prerequisites or several hours if the      ***
*** script finds no prerequisites. (Run './install.sh --help' without quotes   ***
*** to see the installation options.)  This script traverses the following     ***
*** dependency tree and asks permission to install packages that are not in    ***
*** your PATH, not in the prerequisites/installations subdirectory of the      ***
*** OpenCoarrays source tree, or have insufficiently recent version numbers:   ***

    opencoarrays
    |__ cmake-3.10.0
    |__ mpich-3.2
        |__ gcc-10.1.0
            |__ flex-2.6.0
            |   |__ bison-3.0.4
            |       |__ m4-1.4.17
            |__ gmp
            |__ mpc
            |__ mpfr

*** For a non-interactive installation, relaunch this script with the command  ***
*** './install.sh --yes-to-all' without quotes to instruct the script to       ***
*** assume affirmative answers to all user queries.                            ***

opencoarrays will be installed in /home/jehammond/OpenCoarrays/prerequisites/installations/

What you expected to happen

I expected to see AWS Open-MPI used instead of MPICH. Because the AWS instances I am using have EFA, it is important to use an MPI that supports this. It is possible that I can get MPICH working with the AWS distribution of libfabric but I do not want to mess around with that right now.

Step-by-step reproduction instructions to reproduce the error/bug

  1. use AWS Graviton 2
  2. git clone https://github.com/sourceryinstitute/OpenCoarrays.git
  3. ./install.sh -M /opt/amazon/openmpi
@stale
Copy link

stale bot commented Sep 7, 2021

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

@stale stale bot added the stale label Sep 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant