Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Provixion x1 instances for carbonplan #471

Merged
merged 3 commits into from
Jun 14, 2021
Merged

Provixion x1 instances for carbonplan #471

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
d1bc4f8
Remove max limits on dask worker RAM / CPU
yuvipanda Jun 14, 2021
f181cf8
Set JupyterLab as default for daskhub
yuvipanda Jun 14, 2021
805ee0a
Provixion x1 instances for carbonplan
yuvipanda Jun 14, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 14 additions & 0 deletions config/hubs/carbonplan.cluster.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -92,6 +92,20 @@ hubs:
mem_guarantee: 240G
node_selector:
node.kubernetes.io/instance-type: r5.8xlarge
- display_name: "Very Huge: x1.16xlarge"
description: "~64 CPU, ~976G RAM"
kubespawner_override:
mem_limit: null
mem_guarantee: 940G
node_selector:
node.kubernetes.io/instance-type: x1.16xlarge
- display_name: "Very Very Huge: x1.32xlarge"
description: "~128 CPU, ~1952G RAM"
kubespawner_override:
mem_limit: null
mem_guarantee: 1900G
node_selector:
node.kubernetes.io/instance-type: x1.32xlarge
scheduling:
userPlaceholder:
enabled: false
Expand Down
6 changes: 4 additions & 2 deletions hub-templates/daskhub/values.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,8 @@ basehub:
hook:
enabled: false
singleuser:
# Almost everyone using dask by default wants JupyterLab
defaultUrl: /lab
extraLabels:
hub.jupyter.org/network-access-proxy-http: "true"

Expand Down Expand Up @@ -178,8 +180,8 @@ dask-gateway:
"environment": options.environment,
}
return Options(
Integer("worker_cores", 2, min=1, max=16, label="Worker Cores"),
Float("worker_memory", 4, min=1, max=32, label="Worker Memory (GiB)"),
Integer("worker_cores", 2, min=1, label="Worker Cores"),
Float("worker_memory", 4, min=1, label="Worker Memory (GiB)"),
# The default image is set via DASK_GATEWAY__CLUSTER__OPTIONS__IMAGE env variable
String("image", label="Image"),
Mapping("environment", {}, label="Environment Variables"),
Expand Down
4 changes: 3 additions & 1 deletion kops/carbonplan.jsonnet
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,9 @@ local nodes = [
{spec+: { machineType: "r5.large" }}, // 2CPU, 16G RAM
{spec+: { machineType: "r5.xlarge" }}, // 4CPU, 32G RAM
{spec+: { machineType: "r5.2xlarge" }}, // 8CPU, 64G RAM
{spec+: { machineType: "r5.8xlarge" }} // 32CPU, 256 RAM
{spec+: { machineType: "r5.8xlarge" }}, // 32CPU, 256 RAM
{spec+: { machineType: "x1.16xlarge" }}, // 64CPU, 976G RAM
{spec+: { machineType: "x1.32xlarge" }} // 128CPU, 1952G RAM
];

local data = {
Expand Down
Loading