Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use spot instances for dask workers #605

Merged
merged 3 commits into from
Aug 15, 2021
Merged

Commits on Aug 13, 2021

  1. Use spot instances for dask workers

    - Don't change the instance type of the dask workers - so no
      mixed instances. This is a straight port of what we have now
      to just use spot instances.
    - x1 spot instances can't be created due to quota issues,
      so we remove them from the pool.
    
    Fixes 2i2c-org#490
    yuvipanda committed Aug 13, 2021
    Configuration menu
    Copy the full SHA
    d99b4b9 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2021

  1. Fix comment typos

    yuvipanda committed Aug 14, 2021
    Configuration menu
    Copy the full SHA
    dc06225 View commit details
    Browse the repository at this point in the history
  2. Use eksctl schema for spot instances too

    For spot instances, `instanceType` can not be set on the
    nodePool object, or eksctl complains. Before this commit,
    we were still just specifying 'instanceType', but magically
    converting it to the appropriate incantation for spot instances.
    This leads to confusion, and missing features (for example,
    the ability to specify multiple instanceTypes).
    
    This commit switches us to using just plain eksctl schema,
    at the cost of a slightly more verbose config
    yuvipanda committed Aug 14, 2021
    Configuration menu
    Copy the full SHA
    facddc6 View commit details
    Browse the repository at this point in the history