You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, the CI workflow contains 4 different tests:
unit tests
integ tests agains multi-node cluster (no security)
integ tests against docker image (with security if exists, else no security)
BWC tests
This poses many problems:
extremely long workflow times close to 1 hr
longer time to narrow down failures due to all of the different scenarios captured in this one workflow
possible duplicate/unnecessary integ test runs if no security (2 and 3 listed above)
I see a few solns:
Split these into different workflows
Provide reusable workflow(s) that can be called by other workflows to run tests. For example, a reusable workflow that pulls the github repos and builds them, can then be called by different workflows to kick off unit tests or integ tests, to reduce duplicate setup code. As an example, see this Dashboards functional-test PR.
The text was updated successfully, but these errors were encountered:
I made some progress on splitting up the workflows into bwc, tests against docker image (w/security) and a build workflow (unit, integ and multi node). The last build workflow could be split up more I guess but also means a lot more runners/bigger test matrix. I am not closing this issue yet, but if we are okay with not splitting the unit and integ tests than I can close it with this PR (#710)
Currently, the CI workflow contains 4 different tests:
This poses many problems:
I see a few solns:
The text was updated successfully, but these errors were encountered: