Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Optimizer] SkyPilot does not list GPU instances when large num of CPUs are requested #3597

Open
romilbhardwaj opened this issue May 26, 2024 · 0 comments · May be fixed by #3975
Open

[Optimizer] SkyPilot does not list GPU instances when large num of CPUs are requested #3597

romilbhardwaj opened this issue May 26, 2024 · 0 comments · May be fixed by #3975
Labels
good first issue Good for newcomers

Comments

@romilbhardwaj
Copy link
Collaborator

I want to get a 192+ CPU instance through SkyPilot, do not care if it comes with GPU(s). --cpus 192+ does not yield any instance:

$ sky launch --cpus 192+
I 05-26 10:13:04 optimizer.py:1264] No resource satisfying <Cloud>(cpus=150+) on [GCP, AWS, Kubernetes].
sky.exceptions.ResourcesUnavailableError: Catalog and kubernetes cluster does not contain any instances satisfying the request:
Task<name=sky-cmd>(run=<empty>)
  resources: <Cloud>(cpus=150+).

To fix: relax or change the resource requirements.

Hint: sky show-gpus to list available accelerators.
      sky check to check the enabled clouds.

Even though gcp a3-highgpu-8g and AWS p5.48xlarge satisfy this request:

$ sky launch --gpus H100:8
I 05-26 10:12:29 optimizer.py:695] == Optimizer ==
I 05-26 10:12:29 optimizer.py:706] Target: minimizing cost
I 05-26 10:12:29 optimizer.py:718] Estimated cost: $87.8 / hour
I 05-26 10:12:29 optimizer.py:718]
I 05-26 10:12:29 optimizer.py:843] Considered resources (1 node):
I 05-26 10:12:29 optimizer.py:913] ----------------------------------------------------------------------------------------------
I 05-26 10:12:29 optimizer.py:913]  CLOUD   INSTANCE        vCPUs   Mem(GB)   ACCELERATORS   REGION/ZONE     COST ($)   CHOSEN
I 05-26 10:12:29 optimizer.py:913] ----------------------------------------------------------------------------------------------
I 05-26 10:12:29 optimizer.py:913]  GCP     a3-highgpu-8g   208     1872      H100:8         us-central1-a   87.83         ✔
I 05-26 10:12:29 optimizer.py:913]  AWS     p5.48xlarge     192     2048      H100:8         us-east-1       98.32
I 05-26 10:12:29 optimizer.py:913] ----------------------------------------------------------------------------------------------
I 05-26 10:12:29 optimizer.py:913]
@cblmemo cblmemo added the good first issue Good for newcomers label Sep 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants