Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Run VSphere tests in self-hosted, refactor test suite into spec per provider, support label filtering, get all tests green #360

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Run VSphere tests in self-hosted, refactor test suite into spec per provider, support label filtering, get all tests green #360

wants to merge 1 commit into from

Commits on Oct 9, 2024

  1. Add self-hosted runner, break E2E tests into labeled Specs 

    * Break provider tests into seperate files with labels
  representing either onprem or cloud providers.
* Add new jobs to CI workflow which dictate where tests
  will run, onprem provider tests like vSphere will run
  on self-hosted runners since they will use internal
  resources to test.  Cloud provider tests will use the
  existing workflow since they can access providers without
  network access and can take advantage of the much larger
  GitHub hosted pool.  Hosted/Self-hosted tests can run
  concurrently.
* Make Cleanup depend on the cloud-e2etest only.
* Use new GINKGO_LABEL_FILTER to manage what tests run
  where.
* Move controller validatation into BeforeSuite since the
  controller needs to be up and ready for each provider test,
  this will also enable us to add controller specific test
  cases later and make those run without the "test e2e" flag.
* Seperate self-hosted and hosted test concurrency groups
* Update docs with test filtering instructions
* Ensure a Release exists for the custom build.version we deploy
* Move all e2e related helpers into e2e dir
  * Add new clusteridentity package for creating ClusterIdentity kind's
  and associated Secret's.
* Merge PR workflows together
* Make sure VERSION gets passed across jobs
* Ensure uniqueness among deployed ManagedClusters, simplify
  MANAGED_CLUSTER_NAME in CI to prevent Azure availabilitySetName
  validation error.
* Default Azure test templates to uswest2 to prevent issues with
  AvailabilityZone.
* Use the same concurrency-group across all jobs, except Cleanup
  which intentionally does not belong to a concurrency-group.
* Use Setup Go across jobs for caching.
* Support patching other hosted clusters to status.ready with a
  common patching helper.
* Move VSphere delete into AfterEach to serve as cleanup.
* Add support for cleaning Azure resources.
* Prevent ginkgo from timing out tests.
* Use azure-disk CSI driver we deploy via templates.

Signed-off-by: Kyle Squizzato <ksquizzato@mirantis.com>
    @squizzi
    squizzi committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    3a4c09c View commit details
    Browse the repository at this point in the history