Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

README: Add reference to OKD resource requirements #152

Closed
viniciusferrao opened this issue Apr 16, 2020 · 7 comments
Closed

README: Add reference to OKD resource requirements #152

viniciusferrao opened this issue Apr 16, 2020 · 7 comments
Labels
kind/documentation Categorizes issue or PR as related to documentation.

Comments

@viniciusferrao
Copy link

Hello, I started a lab to test OKD 4.4 with RHV (the new deployment model) and was really shocked with the system requirements:

  • Confirm that the hosts have a combined total of at least 24 CPU cores available exclusively for the RHOCP cluster. These CPUs must be distributed so that each of the 6 virtual machines created during installation can have 4 CPU cores.
  • Confirm that, all together, the hosts have 64 GiB free memory for the following RHOCP nodes:
  • ○ 8 GiB required (16 GiB recommended) for the Bootstrap node, which provides the temporary control plane
  • ○ 8 GiB required (16 GiB recommended) for each of the three master nodes which provide the control plane
  • ○ 16 GiB for each of the two worker nodes, which run the application workloads

I don't have this resources. I do have a good pool, with 36 CPU cores and 192GB of RAM distributed between three nodes. But there's other things running on those machines and I can't eat the entire cluster just with management VMs.

Is this requirements really correct? The CPU requirements appear to be exaggerated, and the RAM requirements too.

@LorbusChris
Copy link
Contributor

Yes, these are indeed the requirements at this time.
It's a stretch goal to lower them, but this is not in scope for this repository at this time.

@viniciusferrao
Copy link
Author

Thanks for confirming @LorbusChris
This info is unavailable on the README here on GitHub.

I still have one question: I can understand the RAM requirements, but I can't understand the CPU requirements. Why we need 24 dedicated cores? Why they can't be shared? The ratio CPU/RAM is extremely disproportional.

@LorbusChris
Copy link
Contributor

You're absolutely right, we should add a section or at least a link to refer to that!
The usual minimal setup that I've seen consists of 6 dedicated machines (3 masters, 3 workers), with a 4 core CPU each. I cannot speak to details of how that requirement is assessed exactly, though. I'll try to find somebody who is able to give you a more informed answer at the start of next week.

Let me re-open and re-name this issue for tracking.

Also, and I should've said that as a first thing, thank you for your interest in OKD! :)

@LorbusChris LorbusChris reopened this Apr 18, 2020
@LorbusChris LorbusChris changed the title OKD 4.4 requirements README: Add reference to OKD hardware requirements Apr 18, 2020
@LorbusChris LorbusChris changed the title README: Add reference to OKD hardware requirements README: Add reference to OKD resource requirements Apr 18, 2020
@LorbusChris
Copy link
Contributor

@viniciusferrao one more thing: Even though it's not recommended, you can mark your masters as schedulable for workload containers (you would probably use openshift-install create install-config to create the manifests and then edit them before proceeding with the installation) and thus get away with a 3 machine setup. I would expect your resources to be sufficient, but there's no guarantee - quite a lot things run by design to ensure high availability and stability, e.g. two monitoring stacks (aka one HA monitoring stack..)

@cgruver
Copy link

cgruver commented Apr 19, 2020

@viniciusferrao Since you are sitting on top of KVM, you can oversubscribe the CPUs. As long as you're not running extreme load, the guest VMs won't know or care that they are sharing CPU with other work loads.

I'm running 2 to 2.5X oversubscription in my lab setup. RAM is really more critical than CPU for a lightly loaded cluster.

If you do a UPI install and use a value of 0 for worker nodes in your install-config.yaml, then your master nodes will automatically be labeled as worker nodes as well.

With that configuration, you only need 3 VMs for your cluster + a temporary bootstrap node.

If you do that, I highly recommend more RAM for the masters. 16 to 24 GB of RAM for the three master nodes.

@cgruver
Copy link

cgruver commented Apr 19, 2020

If you already have master nodes running, and want to make them schedulable after the fact, this should work:

oc patch scheduler cluster --patch '{"spec":{"mastersSchedulable":true}}' --type=merge

@vrutkovs vrutkovs added the kind/documentation Categorizes issue or PR as related to documentation. label Apr 20, 2020
@vrutkovs
Copy link
Member

Requirements may change and should be tracked in official documentation.

Slimming down those requirements is really a different topic, so I'll close this ticket

binnes pushed a commit to binnes/okd that referenced this issue Jul 11, 2023
…okd-project#152)

* README.md: Add dev dependencies.

* New structure.

* Change bg colors of last two sections.

* Add screenshots. Small fixes in layout.

* Deprecation warning for OKD 3.11

* Change 'Changelogs' to 'Releases'.

* Initial blog tests. Not visible on okd.io main site!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/documentation Categorizes issue or PR as related to documentation.
Projects
None yet
Development

No branches or pull requests

4 participants