SPIKE: Investigate order guarantees for log replication in SQL databases

[edgarrmondragon]

Singer SDK Version

0.32.0

Is this a regression?

• Yes

Python Version

NA

Bug scope

Taps (catalog, state, etc.)

Operating System

NA

Description

#1951 (shipped in v0.32.0) made sure that SQL streams are treated as sorted when a replication key is set, which is the case for INCREMENTAL replication.

However, LOG_BASED replication may also set a replication key on the stream, but some databases (at least Postgres) do not guarantee order under log replication. This means that the original assumption was wrong, so we may need to survey order guarantees in SQL databases to decide if we should update this library.

In the meantime, MeltanoLabs/tap-postgres#301 was opened to address this issue for Postgres.

Code

No response