Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CBG-4035: [3.1.9 backport] Skipped Sequence Optimisations #6925

Merged
merged 8 commits into from
Jul 9, 2024

Conversation

gregns1
Copy link
Contributor

@gregns1 gregns1 commented Jun 27, 2024

CBG-4035

All optimisations for skipped sequences

Integration Tests

@gregns1 gregns1 self-assigned this Jun 27, 2024
gregns1 and others added 8 commits July 5, 2024 11:48
…e slice (#6747)

* CBG-3852: implementation of single sequence entry for skipped sequence slice

* minor updates to make setLastSeq no-op for single values

* updates for review round

* remove not needed comment

* updates based off review
…6789)

* CBG-3854: Integeration of the skipped sequence slice into the cache

* remove old chnages not needed anymore + gh actions failures

* updates based of review. Move stat update to updateStats and alter soem naming. Test updates to reflect stat chnages too.

* remove incorrect incrementing of num current sequences inside PushSkippedSequenceEntry

* Fix race condition in updateStats()

* updates off review

* tidy CleanSkippedSequenceQueue
* CBG-3855: support for seqeuence range removal

* add comment to function + remove repeated code

* refactor error handling, simplify stat calculation update
* CBG-3850: Optimise releaseUnusedSequenceRange function + support for ranges in pending queue

* updates to add _pushRangeToPending and _removeSubsetOfRangeFromSkipped to process duplicates sequences between unused rnage and pending/skipped lists

* fix race condition in test

* fix for incorrect logic for removing skipped range

* updates based off review

* updates to fix incorrect code + add extra test coverage of changes

* change error name
@gregns1 gregns1 merged commit ea40269 into release/3.1.9 Jul 9, 2024
24 checks passed
@gregns1 gregns1 deleted the CBG-4035 branch July 9, 2024 09:43
bbrks added a commit that referenced this pull request Nov 11, 2024
bbrks added a commit that referenced this pull request Nov 11, 2024
* Revert "CBG-4218 [3.1.11 backport] Move duplicate checks for pending sequences to read side (#7105)"

This reverts commit b6127c1.

* Revert "CBG-4221 [3.1.11 backport] Don't increment high sequence cached for unused sequences on pendingLogs (#7106)"

This reverts commit 5ba7cd0.

* Revert "CBG-4035: [3.1.9 backport] Skipped Sequence Optimisations (#6925)"

This reverts commit ea40269.

* Re-add tests
bbrks added a commit that referenced this pull request Jan 29, 2025
adamcfraser pushed a commit that referenced this pull request Jan 29, 2025
…ith later optimisations applied (#7330)

* Revert "CBG-4218 [3.1.11 backport] Move duplicate checks for pending sequences to read side (#7105)"

This reverts commit b6127c1.

* Revert "CBG-4221 [3.1.11 backport] Don't increment high sequence cached for unused sequences on pendingLogs (#7106)"

This reverts commit 5ba7cd0.

* Revert "CBG-4035: [3.1.9 backport] Skipped Sequence Optimisations (#6925)"

This reverts commit ea40269.

* Re-add tests

* Restore stats and deprecate them

* CBG-4360: Add uinx timestamp to skipped list entry (#7193)

* Undeprecate Go code because linter is too strict but deprecate the actual stat definition for external users

* remove unnecessary type conversion

* Deprecate existing stat and keep NumCurrentSeqsSkipped

---------

Co-authored-by: Gregory Newman-Smith <109068393+gregns1@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants