Skip to content

Commit

Permalink
Don't hold walproposer WAL in memory (#141)
Browse files Browse the repository at this point in the history
WAL is no longer in memory to prevent OOM in the compute. Removed in-memory queue because it's not needed anymore. When streaming, WAL is now read directly from disk. Every safekeeper has a separate XLogReader. walproposer will now read as much WAL as it can for a single AppendRequest message, it can help with recovering lagging safekeepers. Because Recovery needs to save WAL for streaming, now walproposer can write WAL to disk and `--sync-safekeepers` mode will create pg_wal directory if needed. Replication slot `restart_lsn` is now synced with `truncate_lsn` to prevent truncation of disk WAL until needed.
  • Loading branch information
petuhovskiy authored and tristan957 committed Aug 9, 2023
1 parent ee31c09 commit 573dfe5
Show file tree
Hide file tree
Showing 4 changed files with 323 additions and 276 deletions.
Loading

0 comments on commit 573dfe5

Please sign in to comment.