pack struct with all fixed width fields #3173
Comments
broccoliSpicy
added a commit
that referenced
this issue
Dec 10, 2024
This PR tries to add packed struct encoding. During encoding, it packs a struct with fixed width fields, producing a row oriented `FixedWidthDataBlock`, then use `ValueCompressor` to compressor to a `MiniBlock Layout`. during decoding, it first uses `ValueDecompressor` to get the row-oriented `FixedWidthDataBlock`, then construct a `StructDataBlock` for output. #3173 #2601
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I wang to create a new page layout for
packed struct with all fixed width fieldsrather than using the current miniblock page layoutreasons:
the decode scheduling logic are different
the 8188 chunk bytes limitation in miniblock layout
why do we still need definition levels in packed struct encoding?
new layout design:
just zip all values.
one byte nulls for
number of fields < 8two bytes nulls for
number of fields < 16The text was updated successfully, but these errors were encountered: