Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add GHA to run MCS conformance tests #1642

Draft
wants to merge 1 commit into
base: devel
Choose a base branch
from

Conversation

tpantelis
Copy link
Contributor

The GHA clones the sigs.k8s.io/mcs-api repo with the desired commit and runs go test directly in the directory. v0.1.0 doesn't have the conformance tests so we can't run them via Go import and trying to import a later commit is problematic due incompatible changes to the MCS APIs. Also the conformance tests are really tied to the MCS spec and not specifically to the API version so they'll likely evolve separately anyway.

Fixes #1630

@tpantelis tpantelis self-assigned this Sep 19, 2024
@submariner-bot
Copy link
Contributor

🤖 Created branch: z_pr1642/tpantelis/conformance_gha
🚀 Full E2E won't run until the "ready-to-test" label is applied. I will add it automatically once the PR has 2 approvals, or you can add it manually.

@tpantelis
Copy link
Contributor Author

The ServiceImport VIP test fails right now - we'll need to enable clusterset IP to pass it.

@tpantelis tpantelis force-pushed the conformance_gha branch 15 times, most recently from e809a51 to c45b7c3 Compare September 27, 2024 16:37
@tpantelis tpantelis force-pushed the conformance_gha branch 4 times, most recently from af53279 to 3e20d12 Compare October 3, 2024 12:37
Copy link

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further
activity occurs. Thank you for your contributions.

Copy link

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further
activity occurs. Thank you for your contributions.

@tpantelis tpantelis force-pushed the conformance_gha branch 4 times, most recently from bc9d4a6 to 7efd9bf Compare November 26, 2024 19:22
@tpantelis tpantelis force-pushed the conformance_gha branch 13 times, most recently from 7be0cc9 to 6973d13 Compare December 7, 2024 20:10
The GHA clones the "sigs.k8s.io/mcs-api" repo with the desired commit
and runs `go test` directly in the directory. "v0.1.0"  doesn't have
the conformance tests so we can't run them via Go import and trying to
import a later commit is problematic due  incompatible changes to the
MCS APIs. Also the conformance tests are really tied to the MCS spec
and not specifically to the API version so they'll likely evolve
separately anyway.

The clusterset IP field in the ServiceImport is required by the
spec for ClusterIP services so that conformance test will fail unless
the clusterset IP feature is enabled in Lighthouse. However, with
that enabled, the connectivity conformance tests will fail b/c Submariner
doesn't perform routing in that case. Thus, two separate GHA jobs are
configured, one with clusterset IP enabled and one without, and the
appropriate conformance tests are run/skipped by specifying the
appropriate Ginkgo label filter.

Signed-off-by: Tom Pantelis <tompantelis@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add GHA to run the MCS conformance tests
2 participants