Code

feat: packed struct encoding#3186

Code

Merged

broccoliSpicy merged 21 commits intolancedb:mainlancedb/lance:mainfrom broccoliSpicy:packed-struct-encodingbroccoliSpicy/lance:packed-struct-encodingCopy head branch name to clipboardDec 10, 2024

+447-52

Commits

Commits on Dec 4, 2024

• packed-struct encoding

  broccoliSpicy

  committed
  72d6920

• correct estimated_bytes computation

  broccoliSpicy

  committed
  409a465

Commits on Dec 5, 2024

• a workable version for schema with more than one columns

  broccoliSpicy

  committed
  cd8343e

• remove fixed-size-list field in benchmark script

  broccoliSpicy

  committed
  90f82e7

• Merge branch 'main' into packed-struct-encoding

  broccoliSpicy

  authored
  4297877

• remove the added statistics gathering for FixedSizeListBlock

  broccoliSpicy

  committed
  5bfc8c8

• Merge remote-tracking branch 'origin/packed-struct-encoding'

  broccoliSpicy

  committed
  292f0d7

• fix merge error

  broccoliSpicy

  committed
  ba4c6d6

• fmt

  broccoliSpicy

  committed
  ce89ff1

• fmt

  broccoliSpicy

  committed
  9a5a13f

Commits on Dec 6, 2024

• fix bug with create_structural_field_scheduler

  broccoliSpicy

  committed
  c38ed70

Commits on Dec 9, 2024

• correct estimate size in StructDataBlockBuilder.

  broccoliSpicy

  committed
  c28b3cf

• add check in PrimitiveStructuralEncoder::do_flush to make sure fields

  Show description for 40e29c9
  broccoliSpicy

  committed
  40e29c9

• use random float number in test_packed_struct.py

  broccoliSpicy

  committed
  f54c873

• fmt

  broccoliSpicy

  committed
  5f632f5

• Merge branch 'main' into packed-struct-encoding

  broccoliSpicy

  authored
  ac74812

Commits on Dec 10, 2024

• address PR comments

  broccoliSpicy

  committed
  bf73273

• Merge remote-tracking branch 'origin/packed-struct-encoding'

  broccoliSpicy

  committed
  e2b6c9a

• Merge branch 'main' into packed-struct-encoding

  broccoliSpicy

  authored
  b15eec9

• address PR comments

  broccoliSpicy

  committed
  d4b5a00

• Merge remote-tracking branch 'origin/packed-struct-encoding'

  broccoliSpicy

  committed
  7bab88c