You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Mar 5, 2024. It is now read-only.
We currently store a t2b'd list of t2b'd ledger_poc_v2 records. This record itself is full of binaries, so we don't preserve sub binary refernces (using more ram) and t2b over t2b seems silly.
Propose we use a real binary packing scheme to pack the binaries, and the list of the poc records more efficently so we can pull them out of the db faster with less ram usage.
The text was updated successfully, but these errors were encountered:
I would propose additionally that we calculate and store the maximum height of any poc in any given poc list. This will allow us to GC without decoding, which will speed that process up immensely.
By store, I mean <<Vers:1/bytes, MaxHeight:64/unsigned-native, KVList/binary>> or something similar, so that we don't need to decode the kvlist at all, just iterate over the CF and delete once the entire list is available for GC.
Sign up for freeto subscribe to this conversation on GitHub.
Already have an account?
Sign in.
We currently store a t2b'd list of t2b'd ledger_poc_v2 records. This record itself is full of binaries, so we don't preserve sub binary refernces (using more ram) and t2b over t2b seems silly.
Propose we use a real binary packing scheme to pack the binaries, and the list of the poc records more efficently so we can pull them out of the db faster with less ram usage.
The text was updated successfully, but these errors were encountered: