/exp/services/ledgerexporter: resumable export, check data storage for optimal starting point#5264

Merged

sreuland merged 41 commits intostellar:masterfrom

sreuland:resume_exporter

Apr 30, 2024

Commits on Mar 28, 2024

#hubble-272: add resumability, adjusting the requested start ledger based on latest data in data storage layer, avoiding export of data that already exists on storage.
sreuland
committed
Merge remote-tracking branch 'upstream/master' into resume_exporter
sreuland
committed
#hubble-272: app will prevent export if resume determines range is already on data store
sreuland
committed
#hubble-272: fix comments for gofmt
sreuland
committed
#hubble-272: updated reference toml for datastore config params
sreuland
committed
Merge remote-tracking branch 'upstream/master' into resume_exporter
sreuland
committed
#hubble-272: fixed errors found with integration test on fake gcs
sreuland
committed
#hubble-272: fixed fmt warning
sreuland
committed

Commits on Mar 30, 2024

#hubble-272: process review feedback, renamed gcs destination_url to destination_bucket_path, prevent divide by zero on boundary method
sreuland
committed

Commits on Apr 1, 2024

#hubble-272: process review feedback, add 2 checkpoint padding on end range for unbounded resume
sreuland
committed

Commits on Apr 8, 2024

#hubble-272: review feedback, use go's sort.Search built-in for binary search
sreuland
committed

Commits on Apr 22, 2024

Commits on Apr 23, 2024

Commits on Apr 24, 2024

#hubble-272: validate ledgers per file on during resume from remote data store
sreuland
committed

Commits on Apr 25, 2024

Commits on Apr 27, 2024