Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

vSphere UPI: Migrate to steps #9552

Merged

Conversation

jcpowermac
Copy link
Contributor

Moved what was defined in the templates for vSphere
and migrated to steps.

@openshift-ci-robot openshift-ci-robot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jun 8, 2020
@jcpowermac jcpowermac force-pushed the vsphere_upi_steps branch 2 times, most recently from deef822 to 46bdb3d Compare June 9, 2020 13:24
@jcpowermac
Copy link
Contributor Author

/test pj-rehearse

@jcpowermac
Copy link
Contributor Author

/retest

@jcpowermac
Copy link
Contributor Author

/test pj-rehearse

1 similar comment
@jcpowermac
Copy link
Contributor Author

/test pj-rehearse

@jcpowermac
Copy link
Contributor Author

/retest

@jcpowermac
Copy link
Contributor Author

/retest

1 similar comment
@jcpowermac
Copy link
Contributor Author

/retest

@jcpowermac
Copy link
Contributor Author

/test all

2 similar comments
@jcpowermac
Copy link
Contributor Author

/test all

@jcpowermac
Copy link
Contributor Author

/test all

@jcpowermac
Copy link
Contributor Author

/test all
repo timeout errors building containers

@jcpowermac
Copy link
Contributor Author

/test all
repo timeout errors building containers...again

@jcpowermac
Copy link
Contributor Author

/test all

3 similar comments
@jcpowermac
Copy link
Contributor Author

/test all

@jcpowermac
Copy link
Contributor Author

/test all

@jcpowermac
Copy link
Contributor Author

/test all

@jcpowermac
Copy link
Contributor Author

/test pj-rehearse

@jcpowermac
Copy link
Contributor Author

/test all

2 similar comments
@jcpowermac
Copy link
Contributor Author

/test all

@jcpowermac
Copy link
Contributor Author

/test all

@jcpowermac
Copy link
Contributor Author

/test pj-rehearse

1 similar comment
@jcpowermac
Copy link
Contributor Author

/test pj-rehearse

@jcpowermac
Copy link
Contributor Author

/test all

@jcpowermac jcpowermac force-pushed the vsphere_upi_steps branch 3 times, most recently from fa23f5d to fb2dadd Compare June 18, 2020 00:32
@jcpowermac
Copy link
Contributor Author

  • Updated the name to just vsphere-upi
  • Replaced for versions 4.4 and beyond

@jcpowermac
Copy link
Contributor Author

vsphere isn't busy...
/test all

@jcpowermac jcpowermac force-pushed the vsphere_upi_steps branch 2 times, most recently from 4ff4ced to 7338efc Compare June 22, 2020 14:35
@jcpowermac
Copy link
Contributor Author

@wking @abhinavdahiya this is ready to go can you PTAL.
I limited the releases configured to reduce the concurrent clusters created in the vSphere env.
Will follow up with another PR to update versions 4.5-4.7

@jcpowermac
Copy link
Contributor Author

/assign @abhinavdahiya

Copy link
Contributor

@abhinavdahiya abhinavdahiya left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

overall looks good

Comment on lines +120 to +122
# To ease debugging of ip address use
cluster_domain=$(<"${SHARED_DIR}"/clusterdomain.txt)
host -t A "api.${cluster_domain}"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not sure what this is helping with debugging?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suppose there could be a better way to disable what IP addresses were used but its nice to know what is resolvable.
The major reason is if/when there is issues when two clusters overlap ip addresses.

"${dir}/metadata.json" \
${dir}/*.ign

# Removed tar of openshift state. Not enough room in SHARED_DIR with terraform state
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

did we end up creating something for test platform team to help fix this. the 1mb restriction is not helping UPI workflows.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Its a kubernetes limitation for a secret I am not sure how we would be working around that. I might be missing something but for vSphere UPI not sure why we need openshift state.

cc: @wking @stevekuznetsov

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tucking the metadata into the cluster itself is one option, but maybe install failed. In that case, I think the option are:

  • Tucking the data into a separate storage engine like S3 (I think Ahbinav also floated matchbox?).
  • Reducing the amount of data that you need to share. Can we teardown with some subset of the Terraform state?

And it's not clear to me why we'd want to share the installer's state file between steps, even if we didn't have to make room for a large Terraform state dump.

Also in this space, CI jobs can fail if a CI node goes down, which happens sometimes. We'll want a stateless way to reap the resources that sort of hard-termination leaks, and it's possible we can recycle some of that approach for the official teardown step to reduce the amount of state it needs passed in.

@jcpowermac
Copy link
Contributor Author

/test pj-rehearse

@jcpowermac jcpowermac force-pushed the vsphere_upi_steps branch 2 times, most recently from 08b00ed to 04f1da1 Compare July 8, 2020 14:43
Moved what was defined in the templates for vSphere
and migrated to steps.
@jcpowermac
Copy link
Contributor Author

@abhinavdahiya can you take another look when you have a chance?

@openshift-ci-robot
Copy link
Contributor

@jcpowermac: The following tests failed, say /retest to rerun all failed tests:

Test name Commit Details Rerun command
ci/rehearse/openshift/installer/master/e2e-vsphere-upi-steps b360982b303e1d3be3b86e5783c365c31583b5d8 link /test pj-rehearse
ci/rehearse/openshift/installer/release-4.6/e2e-vsphere-upi 4758af2233821c7d9c63c3399484fb7ba4fe7a38 link /test pj-rehearse
ci/rehearse/openshift/installer/release-4.7/e2e-vsphere-upi 4758af2233821c7d9c63c3399484fb7ba4fe7a38 link /test pj-rehearse
ci/rehearse/openshift/installer/release-4.5/e2e-vsphere-upi 04f1da14dad446cf8a5e6f6f153e02db47659737 link /test pj-rehearse
ci/rehearse/openshift/installer/master/e2e-vsphere-upi 8b3db8f link /test pj-rehearse
ci/rehearse/openshift/installer/release-4.4/e2e-vsphere 8b3db8f link /test pj-rehearse
ci/prow/pj-rehearse 8b3db8f link /test pj-rehearse

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@abhinavdahiya
Copy link
Contributor

/approve

@openshift-ci-robot openshift-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jul 9, 2020
@patrickdillon
Copy link
Contributor

/lgtm

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Jul 9, 2020
@openshift-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: abhinavdahiya, jcpowermac, patrickdillon

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-bot
Copy link
Contributor

/retest

Please review the full test history for this PR and help us cut down flakes.

@openshift-merge-robot openshift-merge-robot merged commit 22b13df into openshift:master Jul 9, 2020
@openshift-ci-robot
Copy link
Contributor

@jcpowermac: Updated the following 8 configmaps:

  • job-config-master configmap in namespace ci at cluster api.ci using the following files:
    • key openshift-installer-master-presubmits.yaml using file ci-operator/jobs/openshift/installer/openshift-installer-master-presubmits.yaml
  • job-config-master configmap in namespace ci at cluster app.ci using the following files:
    • key openshift-installer-master-presubmits.yaml using file ci-operator/jobs/openshift/installer/openshift-installer-master-presubmits.yaml
  • job-config-4.4 configmap in namespace ci at cluster api.ci using the following files:
    • key openshift-installer-release-4.4-presubmits.yaml using file ci-operator/jobs/openshift/installer/openshift-installer-release-4.4-presubmits.yaml
  • job-config-4.4 configmap in namespace ci at cluster app.ci using the following files:
    • key openshift-installer-release-4.4-presubmits.yaml using file ci-operator/jobs/openshift/installer/openshift-installer-release-4.4-presubmits.yaml
  • step-registry configmap in namespace ci at cluster api.ci using the following files:
    • key OWNERS using file ci-operator/step-registry/openshift/e2e/vsphere/upi/OWNERS
    • key openshift-e2e-vsphere-upi-workflow.yaml using file ci-operator/step-registry/openshift/e2e/vsphere/upi/openshift-e2e-vsphere-upi-workflow.yaml
    • key OWNERS using file ci-operator/step-registry/upi/conf/vsphere/OWNERS
    • key OWNERS using file ci-operator/step-registry/upi/conf/vsphere/ova/OWNERS
    • key upi-conf-vsphere-ova-commands.sh using file ci-operator/step-registry/upi/conf/vsphere/ova/upi-conf-vsphere-ova-commands.sh
    • key upi-conf-vsphere-ova-ref.yaml using file ci-operator/step-registry/upi/conf/vsphere/ova/upi-conf-vsphere-ova-ref.yaml
    • key upi-conf-vsphere-chain.yaml using file ci-operator/step-registry/upi/conf/vsphere/upi-conf-vsphere-chain.yaml
    • key upi-conf-vsphere-commands.sh using file ci-operator/step-registry/upi/conf/vsphere/upi-conf-vsphere-commands.sh
    • key upi-conf-vsphere-ref.yaml using file ci-operator/step-registry/upi/conf/vsphere/upi-conf-vsphere-ref.yaml
    • key OWNERS using file ci-operator/step-registry/upi/deprovision/vsphere/OWNERS
    • key upi-deprovision-vsphere-commands.sh using file ci-operator/step-registry/upi/deprovision/vsphere/upi-deprovision-vsphere-commands.sh
    • key upi-deprovision-vsphere-ref.yaml using file ci-operator/step-registry/upi/deprovision/vsphere/upi-deprovision-vsphere-ref.yaml
    • key OWNERS using file ci-operator/step-registry/upi/install/vsphere/OWNERS
    • key upi-install-vsphere-commands.sh using file ci-operator/step-registry/upi/install/vsphere/upi-install-vsphere-commands.sh
    • key upi-install-vsphere-ref.yaml using file ci-operator/step-registry/upi/install/vsphere/upi-install-vsphere-ref.yaml
    • key OWNERS using file ci-operator/step-registry/upi/vsphere/OWNERS
    • key OWNERS using file ci-operator/step-registry/upi/vsphere/post/OWNERS
    • key upi-vsphere-post-chain.yaml using file ci-operator/step-registry/upi/vsphere/post/upi-vsphere-post-chain.yaml
    • key OWNERS using file ci-operator/step-registry/upi/vsphere/pre/OWNERS
    • key upi-vsphere-pre-chain.yaml using file ci-operator/step-registry/upi/vsphere/pre/upi-vsphere-pre-chain.yaml
    • key upi-vsphere-workflow.yaml using file ci-operator/step-registry/upi/vsphere/upi-vsphere-workflow.yaml
  • step-registry configmap in namespace ci at cluster app.ci using the following files:
    • key OWNERS using file ci-operator/step-registry/openshift/e2e/vsphere/upi/OWNERS
    • key openshift-e2e-vsphere-upi-workflow.yaml using file ci-operator/step-registry/openshift/e2e/vsphere/upi/openshift-e2e-vsphere-upi-workflow.yaml
    • key OWNERS using file ci-operator/step-registry/upi/conf/vsphere/OWNERS
    • key OWNERS using file ci-operator/step-registry/upi/conf/vsphere/ova/OWNERS
    • key upi-conf-vsphere-ova-commands.sh using file ci-operator/step-registry/upi/conf/vsphere/ova/upi-conf-vsphere-ova-commands.sh
    • key upi-conf-vsphere-ova-ref.yaml using file ci-operator/step-registry/upi/conf/vsphere/ova/upi-conf-vsphere-ova-ref.yaml
    • key upi-conf-vsphere-chain.yaml using file ci-operator/step-registry/upi/conf/vsphere/upi-conf-vsphere-chain.yaml
    • key upi-conf-vsphere-commands.sh using file ci-operator/step-registry/upi/conf/vsphere/upi-conf-vsphere-commands.sh
    • key upi-conf-vsphere-ref.yaml using file ci-operator/step-registry/upi/conf/vsphere/upi-conf-vsphere-ref.yaml
    • key OWNERS using file ci-operator/step-registry/upi/deprovision/vsphere/OWNERS
    • key upi-deprovision-vsphere-commands.sh using file ci-operator/step-registry/upi/deprovision/vsphere/upi-deprovision-vsphere-commands.sh
    • key upi-deprovision-vsphere-ref.yaml using file ci-operator/step-registry/upi/deprovision/vsphere/upi-deprovision-vsphere-ref.yaml
    • key OWNERS using file ci-operator/step-registry/upi/install/vsphere/OWNERS
    • key upi-install-vsphere-commands.sh using file ci-operator/step-registry/upi/install/vsphere/upi-install-vsphere-commands.sh
    • key upi-install-vsphere-ref.yaml using file ci-operator/step-registry/upi/install/vsphere/upi-install-vsphere-ref.yaml
    • key OWNERS using file ci-operator/step-registry/upi/vsphere/OWNERS
    • key OWNERS using file ci-operator/step-registry/upi/vsphere/post/OWNERS
    • key upi-vsphere-post-chain.yaml using file ci-operator/step-registry/upi/vsphere/post/upi-vsphere-post-chain.yaml
    • key OWNERS using file ci-operator/step-registry/upi/vsphere/pre/OWNERS
    • key upi-vsphere-pre-chain.yaml using file ci-operator/step-registry/upi/vsphere/pre/upi-vsphere-pre-chain.yaml
    • key upi-vsphere-workflow.yaml using file ci-operator/step-registry/upi/vsphere/upi-vsphere-workflow.yaml
  • ci-operator-master-configs configmap in namespace ci at cluster app.ci using the following files:
    • key openshift-installer-master.yaml using file ci-operator/config/openshift/installer/openshift-installer-master.yaml
  • ci-operator-4.4-configs configmap in namespace ci at cluster app.ci using the following files:
    • key openshift-installer-release-4.4.yaml using file ci-operator/config/openshift/installer/openshift-installer-release-4.4.yaml

In response to this:

Moved what was defined in the templates for vSphere
and migrated to steps.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants