Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix flaky informers #1649

Conversation

ncdc
Copy link
Member

@ncdc ncdc commented Jul 30, 2022

Summary

Bump Kubernetes to pick up kcp-dev/kubernetes#85. Without this change, in the kcp log file, whenever CRDs are deleted, you'll notice a lot of Terminating all watchers from cacher *unstructured.Unstructured messages. This was happening because whenever a CRD is deleted, the system attempts to delete internal crdInfo "storage" details for any now-deleted CRDs. Unfortunately, because we have a hack where we create simulated UIDs for wildcard partial metadata CR list/watch requests, these UIDs were getting dropped and the storage for them deleted. This resulted in watches being closed prematurely, and then we'd see a lot of too old resource version log messages about watch closures.

With this fix, I don't see either type of log message any more when running the same set of tests that previously were producing a lot of them.

Related issue(s)

Fixes #

@openshift-ci openshift-ci bot requested review from stevekuznetsov and sttts July 30, 2022 02:31
@ncdc ncdc force-pushed the fix-crd-remove-dead-storage-wildcard-partial-metadata branch from 0db6e1b to f0cb024 Compare August 1, 2022 15:50
Update Kubernetes to pull in the commit that retains rest storage for
wildcard partial metadata CRD requests as long as there is at least 1
CRD for that group-resource still in the system.

Signed-off-by: Andy Goldstein <andy.goldstein@redhat.com>
@ncdc ncdc force-pushed the fix-crd-remove-dead-storage-wildcard-partial-metadata branch from f0cb024 to 028fcf4 Compare August 1, 2022 17:22
@sttts
Copy link
Member

sttts commented Aug 1, 2022

/lgtm
/approve

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Aug 1, 2022
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Aug 1, 2022

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: sttts

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Aug 1, 2022
@openshift-merge-robot openshift-merge-robot merged commit 2c76583 into kcp-dev:main Aug 1, 2022
@ncdc ncdc mentioned this pull request Aug 1, 2022
@ncdc ncdc deleted the fix-crd-remove-dead-storage-wildcard-partial-metadata branch August 2, 2022 16:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants