You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The current SSTable layout works like the following : ref
// Then we have key-value pairs with length prefix
// ╭─────────┬────────────────┬────────────┬──────────────────╮
// │keyLength│ key │ valueLength│ value │
// ├─────────┼────────────────┼────────────┼──────────────────┤ ... repeat key-value pairs
// │4 bytes │ keyLength bytes│ 4 bytes │ valueLength bytes│
// ╰─────────┴────────────────┴────────────┴──────────────────╯
// Then we have 'index' which maps each key to its offset in the above key-value pairs
// SSTable.indexOffset refers to this point where 'index' begins
Use a combination of varint + run length encoding on both the key and value length data which were static 4 bytes prior
for both keys and values if they have a specific data type with certain kind of redundancy, e.g keys with prefixes or repeated null values we can employ some form of compression to handle redundant data.
The text was updated successfully, but these errors were encountered:
The current SSTable layout works like the following : ref
Suggestion to change the layout to the following
This would allow for
The text was updated successfully, but these errors were encountered: