[ci] add a initial version of CI test state machine #42280
Conversation
Signed-off-by: can <can@anyscale.com>
Signed-off-by: can <can@anyscale.com>
can-anyscale
changed the title
|
yess ready for review |
| from ray_release.test import Test, TestState | ||
|
|
||
|
|
||
| class CITestStateMachine(TestStateMachine): |
There was a problem hiding this comment.
how is this different from the other test state machine?
There was a problem hiding this comment.
CI state machine: https://docs.google.com/document/d/1IVgI7LNo21bPJO8kdYTwdWwEdZr5D9VtNrabUeX8gCc/edit
Release state machine: https://docs.google.com/document/d/1hV8avu2Xl16Di3zVXyFtjuhZ8OGFDWhEt7Am319bki0/edit#heading=h.tdxb82dxifm7
I think the main difference is that CI tests have flaky state, which can be computed through automation; while release tests since they run so less frequent, the flaky state is managed by human (the unstable tag)
| f"Managed by OSS Test Policy" | ||
| ), | ||
| labels=labels, | ||
| assignee="can-anyscale", |
There was a problem hiding this comment.
why your name is hard coded here? could you at least declare a constant?
There was a problem hiding this comment.
Totally, I worry it will be spammy (so many flaky tests) so want it go to me first before triaging further; when it's stable i'll find a way to for it go directly to the oncall
Signed-off-by: can <can@anyscale.com>
can-anyscale
force-pushed
the
can-ts05
branch
from
138fa63 to
cc655d1
Compare
A initial version of CI test state machine with some simple movement Signed-off-by: can <can@anyscale.com>
A initial version of CI test state machine with some simple movement
Test: