Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARM compute images on batch #1830

Merged

Conversation

tilne
Copy link
Contributor

@tilne tilne commented Jun 9, 2020

  • Make dependencies installed in Batch Dockerfile architecture agnostic
  • Modify image build accordingly when using ARM compute instances

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

The process for building the container used in the Batch cluster
compute environments assumed an x86_64 architecture:
* architecture-specific openmpi binaries and libraries were installed
* x86_64 CodeBuild environments and images were used

This commit:
* drops the architecture specifier when installing openmpi, allowing the
package manager to figure out which ones to install
* configures the CodeBuild environment dynamically by passing the
Architecture parameter from the main CFN stack into the Batch substack
* installs hostname, which is used by an integration test

The values used for the ComputeType and Type parameters of the CodeBuild
resource when building for ARM were chosen based on the information at
this link: https://docs.aws.amazon.com/codebuild/latest/userguide/build-env-ref-compute-types.html

Still TODO:
* there are some regional restrictions for the environments needed to
build for ARM, which probably means that we can only support ARM Batch
clusters in those regions. Add validators for those cases.
@tilne tilne force-pushed the arm-compute-images-on-batch branch from a77d917 to f894e4e Compare June 9, 2020 23:48
@codecov-commenter
Copy link

codecov-commenter commented Jun 9, 2020

Codecov Report

Merging #1830 into wip/arm-support-feature-branch will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@                       Coverage Diff                       @@
##           wip/arm-support-feature-branch    #1830   +/-   ##
===============================================================
  Coverage                           54.67%   54.67%           
===============================================================
  Files                                  28       28           
  Lines                                4499     4499           
===============================================================
  Hits                                 2460     2460           
  Misses                               2039     2039           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 408a649...e289b0d. Read the comment docs.

cli/tox.ini Show resolved Hide resolved
@tilne tilne force-pushed the arm-compute-images-on-batch branch from f894e4e to e289b0d Compare June 12, 2020 15:22
@tilne
Copy link
Contributor Author

tilne commented Jun 12, 2020

Clicking through to the travis status link shows that all tests have passed. Because of this and the fact that this is being merged into a feature branch and not develop I'm going to go ahead and merge.

@tilne tilne merged commit 4c62d57 into aws:wip/arm-support-feature-branch Jun 12, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants