Deployment with Infra nodes

[ripleyhart]

Tried many deployments with the following configuration and labels for nodes:

3 x Masters
2 x Infra
3 x compute

Installation would fail as registry and router pods would not not create when assigned and scheduled to infra roles, need to be assigned to master.

Here are the node group labels used:

openshift_node_groups=[{'name': 'node-config-master', 'labels': ['node-role.kubernetes.io/master=true', 'node-role.kubernetes.io/compute=true', 'install-monitor=true'], 'edits': [{ 'key': 'kubeletArguments.make-iptables-util-chains','value': ['false']}]}, {'name': 'node-config-infra', 'labels': ['node-role.kubernetes.io/infra=true'], 'edits': [{ 'key': 'kubeletArguments.make-iptables-util-chains','value': ['false']}]}, {'name': 'node-config-compute', 'labels': ['node-role.kubernetes.io/compute=true'], 'edits': [{ 'key': 'kubeletArguments.make-iptables-util-chains','value': ['false']}]}]

Can documentation/option be updated to support this typical OpenShift deployment architecture?

[ripleyhart]

This was tested on OpenShift 3.11.82 as per instructions in the master branch.

[pdellaert]

Hi @arctiqhart,

You can fix this by marking your infra with the label 'node-role.kubernetes.io/compute=true', as well. This is because we need to deploy our Nuage CNI, VRS and Infra pod (which are deployed as part of a daemonset) on the infra nodes as well. We've noticed there are improvements possible that might not require that label in the future, but for now, this is required.

Very valid remark on documentation. I'll be adding this as an extra note.

Regards,
Philippe

[ripleyhart]

@pdellaert I absolutely tried that. The nodes did get labelled properly, however, the Nuage Infra PODS, OCP router and registry would not begin running. I'd like to reproduce this and we can have a look. Definitely something to do with the labelling/node group structure.

Please join our Slack and we can chat on there.

Hart