Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run flux e2e test group in GHA's local_e2e_tests job #5625

Closed
wants to merge 4 commits into from

Conversation

beni0888
Copy link
Collaborator

Signed-off-by: Jesús Benito Calzada bjesus@vmware.com

Description of the change

It seems that at some point, a new flux test group has been added to the /script/e2e_test.sh file, but we have forgotten to add it to the GHA's local_e2e_tests job, so this test group is not being run in the GHA workflow.

I have also took advantage of this PR to simplify the local_e2e_tests GHA job by setting a timeout of 6 minutes for every tests group, instead of having a default of 4 and setting it to 6 for the operator's group to avoid flaky tests.

Benefits

  • Run all the e2e tests from GHA.

Possible drawbacks

N/A

Applicable issues

Signed-off-by: Jesús Benito Calzada <bjesus@vmware.com>
@netlify
Copy link

netlify bot commented Nov 10, 2022

Deploy Preview for kubeapps-dev canceled.

Built without sensitive environment variables

Name Link
🔨 Latest commit 3beb4b7
🔍 Latest deploy log https://app.netlify.com/sites/kubeapps-dev/deploys/63749d77c6c72c0009c445c0

@beni0888 beni0888 self-assigned this Nov 10, 2022
@beni0888 beni0888 added component/ci Issue related to kubeapps ci system github_actions Pull requests that update GitHub Actions code labels Nov 10, 2022
@beni0888 beni0888 added this to the Migrate CI to GitHub Actions milestone Nov 10, 2022
@beni0888 beni0888 marked this pull request as ready for review November 10, 2022 11:16
Copy link
Contributor

@antgamdia antgamdia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's see if this fixes the error. However, I don't know why it started failing out of the blue :S

Signed-off-by: Jesús Benito Calzada <bjesus@vmware.com>
Copy link
Contributor

@gfichtenholt gfichtenholt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks

Copy link
Contributor

@absoludity absoludity left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll re-run the e2e test, looks like it failed this time while installing the source controller...

Waiting for deployment "helm-controller" rollout to finish: 0 of 1 updated replicas are available...
deployment "helm-controller" successfully rolled out
+ kubectl rollout status -w deployment/source-controller --namespace=flux-system
Waiting for deployment "source-controller" rollout to finish: 0 of 1 updated replicas are available...
error: deployment "source-controller" exceeded its progress deadline
Error: Process completed with exit code 1.

EDIT: appears to be failing consistently at that point :/

@gfichtenholt
Copy link
Contributor

gfichtenholt commented Nov 10, 2022

I'll re-run the e2e test, looks like it failed this time while installing the source controller...

Waiting for deployment "helm-controller" rollout to finish: 0 of 1 updated replicas are available...
deployment "helm-controller" successfully rolled out
+ kubectl rollout status -w deployment/source-controller --namespace=flux-system
Waiting for deployment "source-controller" rollout to finish: 0 of 1 updated replicas are available...
error: deployment "source-controller" exceeded its progress deadline
Error: Process completed with exit code 1.

EDIT: appears to be failing consistently at that point :/

No idea why this would happen. Maybe we should have retries with kubectl rollout and/or describe deployment if it fails, kind of like libtest.sh is doing? Just replace kubectl rollout with

k8s_wait_for_deployment "${namespace}" helm-controller
 k8s_wait_for_deployment "${namespace}" source-controller

gfichtenholt added a commit that referenced this pull request Nov 18, 2022
Original description from #5625
Description of the change

It seems that at some point, a new flux test group has been added to the
/script/e2e_test.sh file, but we have forgotten to add it to the GHA's
local_e2e_tests job, so this test group is not being run in the GHA
workflow.

I have also took advantage of this PR to simplify the local_e2e_tests
GHA job by setting a timeout of 6 minutes for every tests group, instead
of having a default of 4 and setting it to 6 for the operator's group to
avoid flaky tests.
Benefits

    Run all the e2e tests from GHA.

Possible drawbacks

N/A
@gfichtenholt
Copy link
Contributor

closing because merged PR #5656 has these changes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-not-required component/ci Issue related to kubeapps ci system github_actions Pull requests that update GitHub Actions code
Projects
Status: No status
Development

Successfully merging this pull request may close these issues.

5 participants