Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade tests with the flaky detection #6804

Closed
agedemenli opened this issue Mar 29, 2023 · 0 comments · Fixed by #6814
Closed

Upgrade tests with the flaky detection #6804

agedemenli opened this issue Mar 29, 2023 · 0 comments · Fixed by #6814

Comments

@agedemenli
Copy link
Contributor

Upgrade tests do not work well with the flakiness detection.
An example: #6794
Here it is trying to run the before test once and the after test 8 times. The first failure is in the before test due to replication factor > 1
JelteF added a commit that referenced this issue Mar 31, 2023
@JelteF
Make python-regress based tests runnable with run_test.py
9428bf3 
For some tests such as upgrade tests and arbitrary config tests we set
up the citus cluster using Python. This setup is slightly different from
the perl based setup script (`multi_regress.pl`). Most importantly it
uses replication factor 1 by default.

This changes our run_test.py script to be able to run a schedule using
python instead of `multi_regress.pl`, for the tests that require it.

For now arbitrary config tests are still not runnable with
`run_test.py`, but this brings us one step closer to being able to do
that.

Fixes #6804
@JelteF JelteF mentioned this issue Mar 31, 2023
Merged
JelteF added a commit that referenced this issue Mar 31, 2023
@JelteF
Make python-regress based tests runnable with run_test.py
5e4cf11 
For some tests such as upgrade tests and arbitrary config tests we set
up the citus cluster using Python. This setup is slightly different from
the perl based setup script (`multi_regress.pl`). Most importantly it
uses replication factor 1 by default.

This changes our run_test.py script to be able to run a schedule using
python instead of `multi_regress.pl`, for the tests that require it.

For now arbitrary config tests are still not runnable with
`run_test.py`, but this brings us one step closer to being able to do
that.

Fixes #6804
JelteF added a commit that referenced this issue Mar 31, 2023
@JelteF
Make python-regress based tests runnable with run_test.py
77b8f05 
For some tests such as upgrade tests and arbitrary config tests we set
up the citus cluster using Python. This setup is slightly different from
the perl based setup script (`multi_regress.pl`). Most importantly it
uses replication factor 1 by default.

This changes our run_test.py script to be able to run a schedule using
python instead of `multi_regress.pl`, for the tests that require it.

For now arbitrary config tests are still not runnable with
`run_test.py`, but this brings us one step closer to being able to do
that.

Fixes #6804
JelteF added a commit that referenced this issue Mar 31, 2023
@JelteF
Make python-regress based tests runnable with run_test.py
a4a60df 
For some tests such as upgrade tests and arbitrary config tests we set
up the citus cluster using Python. This setup is slightly different from
the perl based setup script (`multi_regress.pl`). Most importantly it
uses replication factor 1 by default.

This changes our run_test.py script to be able to run a schedule using
python instead of `multi_regress.pl`, for the tests that require it.

For now arbitrary config tests are still not runnable with
`run_test.py`, but this brings us one step closer to being able to do
that.

Fixes #6804
JelteF added a commit that referenced this issue Mar 31, 2023
@JelteF
Make python-regress based tests runnable with run_test.py
5e9009c 
For some tests such as upgrade tests and arbitrary config tests we set
up the citus cluster using Python. This setup is slightly different from
the perl based setup script (`multi_regress.pl`). Most importantly it
uses replication factor 1 by default.

This changes our run_test.py script to be able to run a schedule using
python instead of `multi_regress.pl`, for the tests that require it.

For now arbitrary config tests are still not runnable with
`run_test.py`, but this brings us one step closer to being able to do
that.

Fixes #6804
JelteF added a commit that referenced this issue Mar 31, 2023
@JelteF
Make python-regress based tests runnable with run_test.py
a0625b3 
For some tests such as upgrade tests and arbitrary config tests we set
up the citus cluster using Python. This setup is slightly different from
the perl based setup script (`multi_regress.pl`). Most importantly it
uses replication factor 1 by default.

This changes our run_test.py script to be able to run a schedule using
python instead of `multi_regress.pl`, for the tests that require it.

For now arbitrary config tests are still not runnable with
`run_test.py`, but this brings us one step closer to being able to do
that.

Fixes #6804
agedemenli pushed a commit that referenced this issue Mar 31, 2023
@JelteF @agedemenli
Make python-regress based tests runnable with run_test.py
c72e54e 
For some tests such as upgrade tests and arbitrary config tests we set
up the citus cluster using Python. This setup is slightly different from
the perl based setup script (`multi_regress.pl`). Most importantly it
uses replication factor 1 by default.

This changes our run_test.py script to be able to run a schedule using
python instead of `multi_regress.pl`, for the tests that require it.

For now arbitrary config tests are still not runnable with
`run_test.py`, but this brings us one step closer to being able to do
that.

Fixes #6804

(cherry picked from commit a0625b3)
JelteF added a commit that referenced this issue Mar 31, 2023
@JelteF
Make python-regress based tests runnable with run_test.py
72a7898 
For some tests such as upgrade tests and arbitrary config tests we set
up the citus cluster using Python. This setup is slightly different from
the perl based setup script (`multi_regress.pl`). Most importantly it
uses replication factor 1 by default.

This changes our run_test.py script to be able to run a schedule using
python instead of `multi_regress.pl`, for the tests that require it.

For now arbitrary config tests are still not runnable with
`run_test.py`, but this brings us one step closer to being able to do
that.

Fixes #6804
agedemenli pushed a commit that referenced this issue Mar 31, 2023
@JelteF @agedemenli
Make python-regress based tests runnable with run_test.py
5add64a 
For some tests such as upgrade tests and arbitrary config tests we set
up the citus cluster using Python. This setup is slightly different from
the perl based setup script (`multi_regress.pl`). Most importantly it
uses replication factor 1 by default.

This changes our run_test.py script to be able to run a schedule using
python instead of `multi_regress.pl`, for the tests that require it.

For now arbitrary config tests are still not runnable with
`run_test.py`, but this brings us one step closer to being able to do
that.

Fixes #6804

(cherry picked from commit 72a7898)
JelteF added a commit that referenced this issue Mar 31, 2023
@JelteF
Make python-regress based tests runnable with run_test.py (#6814)
92b358f 
For some tests such as upgrade tests and arbitrary config tests we set
up the citus cluster using Python. This setup is slightly different from
the perl based setup script (`multi_regress.pl`). Most importantly it
uses replication factor 1 by default.

This changes our run_test.py script to be able to run a schedule using
python instead of `multi_regress.pl`, for the tests that require it.

For now arbitrary config tests are still not runnable with
`run_test.py`, but this brings us one step closer to being able to do
that.

Fixes #6804
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Make python-regress based tests runnable with run_test.py citusdata/citus
1 participant
@agedemenli