Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update postgres.md #27325

Merged
merged 4 commits into from
Jun 20, 2023
Merged

Update postgres.md #27325

Changes from 2 commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
22d16fe
Update postgres.md
evantahler Jun 13, 2023
362718b
Update postgres.md
evantahler Jun 14, 2023
81f6a5c
Update postgres.md
evantahler Jun 20, 2023
bd21a7a
Merge branch 'master' into evantahler-patch-1
evantahler Jun 20, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions docs/integrations/sources/postgres.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -168,6 +168,7 @@ Airbyte uses [logical replication](https://www.postgresql.org/docs/10/logical-re
- Schema changes are not supported automatically for CDC sources. Reset and resync data if you make a schema change.
- The records produced by `DELETE` statements only contain primary keys. All other data fields are unset.
- Log-based replication only works for master instances of Postgres. CDC cannot be run from a read-replica of your primary database.
- Am Airbyte database source using CDC replication can only be used with a single Airbyte destination. This is due to how Postgres CDC is implemented - each destination would recieve only part of the data available in the replication slot.
evantahler marked this conversation as resolved.
Show resolved Hide resolved
- Using logical replication increases disk space used on the database server. The additional data is stored until it is consumed.
- Set frequent syncs for CDC to ensure that the data doesn't fill up your disk space.
- If you stop syncing a CDC-configured Postgres instance with Airbyte, delete the replication slot. Otherwise, it may fill up your disk space.
Expand Down