Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

java CDK: make DebeziumRecordIterator less time-sensitive in tests #31828

Closed
postamar opened this issue Oct 25, 2023 · 0 comments · Fixed by #31924 or #31976
Closed

java CDK: make DebeziumRecordIterator less time-sensitive in tests #31828

postamar opened this issue Oct 25, 2023 · 0 comments · Fixed by #31924 or #31976
Assignees
@postamar
Labels
team/db-dw-sources Backlog for Database and Data Warehouse Sources team

Comments

@postamar
Copy link
Contributor

Topic

No response

Relevant information

We decide that the DebeziumEngine is not going to be sending us any more records by waiting a certain amount of time and then giving up.

For tests, at least, this isn't desirable. Shouldn't we be able to decide that the WAL isn't going to have anything interesting in it using some LSN offset arithmetic? Something needs to be done here. This is a major cause of latency in the source-postgres CI: #31298 (comment)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@postamar postamar

Labels
team/db-dw-sources Backlog for Database and Data Warehouse Sources team
Projects
None yet
Milestone
No milestone
1 participant
@postamar