Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lower source-postgres CAT duration #31703

Closed
alafanechere opened this issue Oct 23, 2023 · 1 comment · Fixed by #31699
Closed

Lower source-postgres CAT duration #31703

alafanechere opened this issue Oct 23, 2023 · 1 comment · Fixed by #31699
Assignees

Comments

@alafanechere
Copy link
Contributor

As source-postgres now passes CAT we can work on making it run faster.
We don't want this test suite to be the bottleneck of the source-postgres tests.

Original cat duration: 7mn46

@alafanechere alafanechere self-assigned this Oct 23, 2023
@alafanechere alafanechere changed the title Locer source-postgres CAT duration Lower source-postgres CAT duration Oct 23, 2023
@alafanechere
Copy link
Contributor Author

alafanechere commented Oct 23, 2023

First optimization:

When running CAT against a CDC config the initial_waiting_time setting has a huge impact on the CAT duration. This setting determines the time for which debezium will wait for new records. As we're not inserting records to postgres in CAT this duration can be lowered to a minimum.

Original value: 300s (the default)
New value: 1s

To set this value to 1 we have to set the is_test setting to True, otherwise the config validation fails as normally the lowest acceptable valust is 120s

Speed gain

07mn41s - 03mn54s = 3mn47s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant