Skip to content
This repository has been archived by the owner on Jun 6, 2024. It is now read-only.

Update maximum resources in yarn-site.xml #2942

Merged
merged 1 commit into from
Jun 14, 2019
Merged

Conversation

abuccts
Copy link
Member

@abuccts abuccts commented Jun 14, 2019

Update yarn-site.xml to fit DGX-2 maximum resources.

Closes #2740.

Update yarn-site.xml to fit DGX-2 maximum resources.
@abuccts abuccts requested a review from mzmssg June 14, 2019 07:47
<name>yarn.scheduler.maximum-allocation-gpus</name>
<value>8</value>
<value>16</value>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A larger value such as 64? which is the maximum supported value. The same suggestion on cpu & memory.

Copy link
Member Author

@abuccts abuccts Jun 14, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can treat DGX-2 as the upper bond of resources.
You won't find any machines have more than 16 GPU cards except for customized motherboards.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, keep it before a configurition

@coveralls
Copy link

Coverage Status

Coverage increased (+0.01%) to 53.217% when pulling 9c92a82 on xiongyf/update-yarn-config into 12dd8d3 on master.

@abuccts abuccts merged commit 347ef77 into master Jun 14, 2019
@abuccts abuccts deleted the xiongyf/update-yarn-config branch June 14, 2019 11:10
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Deployment] YARN configuration cannot change max resource allocation value dynamically
3 participants