Code

Parquet reader list microkernel#16538

Code

Merged

rapids-bot[bot] merged 52 commits intorapidsai:branch-24.12rapidsai/cudf:branch-24.12from pmattione-nvidia:parquet_list_kernelpmattione-nvidia/cudf:parquet_list_kernelCopy head branch name to clipboardOct 29, 2024

+615-123

Commits

Commits on Aug 12, 2024

• work in progress

  pmattione-nvidia

  committed
  b5ec22e

  Copy full SHA for b5ec22e

Commits on Aug 16, 2024

• Further work in list code

  pmattione-nvidia

  committed
  2ca9618

  Copy full SHA for 2ca9618

Commits on Aug 27, 2024

• Tests working

  pmattione-nvidia

  committed
  4b5f91a

  Copy full SHA for 4b5f91a

Commits on Aug 28, 2024

• Revert page_decode changes

  pmattione-nvidia

  committed
  ead17b8

  Copy full SHA for ead17b8

• Merge branch 'branch-24.10' into parquet_list_kernel

  pmattione-nvidia

  authored
  cc32409

  Copy full SHA for cc32409

Commits on Sep 5, 2024

• Add debugging

  pmattione-nvidia

  committed
  0dccec5

  Copy full SHA for 0dccec5

Commits on Sep 7, 2024

• Tests working

  pmattione-nvidia

  committed
  e239e79

  Copy full SHA for e239e79

• Merge branch 'branch-24.10' into parquet_list_kernel

  pmattione-nvidia

  committed
  8f25453

  Copy full SHA for 8f25453

Commits on Sep 9, 2024

• compile fixes

  pmattione-nvidia

  committed
  24c9ab1

  Copy full SHA for 24c9ab1

Commits on Sep 10, 2024

• No need to decode def levels if not nullable

  pmattione-nvidia

  committed
  342c2f4

  Copy full SHA for 342c2f4

• Manual block scan

  pmattione-nvidia

  committed
  50bbc94

  Copy full SHA for 50bbc94

Commits on Sep 18, 2024

• Optimize parquet reader block scans, simplify and consolidate non-nullable column code

  pmattione-nvidia

  committed
  5390661

  Copy full SHA for 5390661

• tweak syncing

  pmattione-nvidia

  committed
  3ef7b0d

  Copy full SHA for 3ef7b0d

• small tweaks

  pmattione-nvidia

  committed
  7882879

  Copy full SHA for 7882879

• Merge branch 'branch-24.10' into parquet_list_kernel

  pmattione-nvidia

  committed
  8852839

  Copy full SHA for 8852839

Commits on Sep 23, 2024

• Add skipping to rle_stream, use for lists (chunked reads)

  pmattione-nvidia

  committed
  e285fbf

  Copy full SHA for e285fbf

Commits on Sep 24, 2024

• tweak scan interface for linked lists

  pmattione-nvidia

  committed
  254f3e9

  Copy full SHA for 254f3e9

Commits on Sep 25, 2024

• Merge branch 'branch-24.12' into mukernels_fixedwidth_optimize

  pmattione-nvidia

  authored
  18d989c

  Copy full SHA for 18d989c

• style fixes

  pmattione-nvidia

  committed
  8ea1e0e

  Copy full SHA for 8ea1e0e

• Merge branch 'mukernels_fixedwidth_optimize' of https://github.com/pmattione-nvidia/cudf into mukernels_fixedwidth_optimize

  pmattione-nvidia

  committed
  326b386

  Copy full SHA for 326b386

Commits on Sep 26, 2024

• Update cpp/src/io/parquet/decode_fixed.cu

  Show description for 41cb982
  

  pmattione-nvidia

  and

  nvdbaranec

  authored
  41cb982

  Copy full SHA for 41cb982

• Update cpp/src/io/parquet/decode_fixed.cu

  Show description for 6e70554
  

  pmattione-nvidia

  and

  nvdbaranec

  authored
  6e70554

  Copy full SHA for 6e70554

• Update cpp/src/io/parquet/decode_fixed.cu

  Show description for 9ad4415
  

  pmattione-nvidia

  and

  nvdbaranec

  authored
  9ad4415

  Copy full SHA for 9ad4415

• Unroll block-count loop

  pmattione-nvidia

  committed
  3a1fc95

  Copy full SHA for 3a1fc95

• Merge branch 'mukernels_fixedwidth_optimize' of https://github.com/pmattione-nvidia/cudf into mukernels_fixedwidth_optimize

  pmattione-nvidia

  committed
  0babf46

  Copy full SHA for 0babf46

• more style fixes

  pmattione-nvidia

  committed
  5ab9829

  Copy full SHA for 5ab9829

Commits on Sep 27, 2024

• Merge branch 'branch-24.12' into mukernels_fixedwidth_optimize

  pmattione-nvidia

  authored
  310d50c

  Copy full SHA for 310d50c

Commits on Oct 2, 2024

• Disable manual block scan for non-lists

  pmattione-nvidia

  committed
  4471022

  Copy full SHA for 4471022

Commits on Oct 4, 2024

• Update cpp/src/io/parquet/decode_fixed.cu

  Show description for c0ed2cb
  

  pmattione-nvidia

  and

  vuule

  authored
  c0ed2cb

  Copy full SHA for c0ed2cb

• Merge branch 'mukernels_fixedwidth_optimize' of https://github.com/pmattione-nvidia/cudf into mukernels_fixedwidth_optimize

  pmattione-nvidia

  committed
  c2139ef

  Copy full SHA for c2139ef

• Style fixes

  pmattione-nvidia

  committed
  b898cba

  Copy full SHA for b898cba

Commits on Oct 7, 2024

• renaming

  pmattione-nvidia

  committed
  b0ee9fc

  Copy full SHA for b0ee9fc

• Merge branch 'mukernels_fixedwidth_optimize' into parquet_list_kernel

  pmattione-nvidia

  committed
  36d026e

  Copy full SHA for 36d026e

• minor tweaks

  pmattione-nvidia

  committed
  4b7d1df

  Copy full SHA for 4b7d1df

• delete some debug printing

  pmattione-nvidia

  committed
  b36b3b2

  Copy full SHA for b36b3b2

• Remove more prints

  pmattione-nvidia

  committed
  5b15704

  Copy full SHA for 5b15704

Commits on Oct 8, 2024

• cleanup

  pmattione-nvidia

  committed
  e84af82

  Copy full SHA for e84af82

• cleanup comments

  pmattione-nvidia

  committed
  f200748

  Copy full SHA for f200748

• style changes

  pmattione-nvidia

  committed
  3fc76ee

  Copy full SHA for 3fc76ee

• Merge branch 'rapidsai:branch-24.12' into parquet_list_kernel

  pmattione-nvidia

  authored
  8c58d2b

  Copy full SHA for 8c58d2b

• Merge branch 'parquet_list_kernel' of https://github.com/pmattione-nvidia/cudf into parquet_list_kernel

  pmattione-nvidia

  committed
  ae8e193

  Copy full SHA for ae8e193

Commits on Oct 11, 2024

• constify variables

  pmattione-nvidia

  committed
  edc56bd

  Copy full SHA for edc56bd

• revert cmakelists change

  pmattione-nvidia

  committed
  e51406c

  Copy full SHA for e51406c

• Merge branch 'branch-24.12' into parquet_list_kernel

  pmattione-nvidia

  authored
  0237e5c

  Copy full SHA for 0237e5c

Commits on Oct 18, 2024

• Update cpp/src/io/parquet/rle_stream.cuh

  Show description for 07ffbf2
  

  pmattione-nvidia

  and

  nvdbaranec

  authored
  07ffbf2

  Copy full SHA for 07ffbf2

• refactor rle_stream

  pmattione-nvidia

  committed
  32fe8b9

  Copy full SHA for 32fe8b9

Commits on Oct 23, 2024

• Use divide function

  pmattione-nvidia

  committed
  031ac6b

  Copy full SHA for 031ac6b

• Merge branch 'branch-24.12' into parquet_list_kernel

  pmattione-nvidia

  authored
  a82ae40

  Copy full SHA for a82ae40

Commits on Oct 25, 2024

• address comments

  pmattione-nvidia

  committed
  534e67d

  Copy full SHA for 534e67d

• Merge branch 'parquet_list_kernel' of https://github.com/pmattione-nvidia/cudf into parquet_list_kernel

  pmattione-nvidia

  committed
  45c00b8

  Copy full SHA for 45c00b8

Commits on Oct 28, 2024

• Change scan interface to pass in shared memory to avoid sync issues

  pmattione-nvidia

  committed
  a6adb0d

  Copy full SHA for a6adb0d

Commits on Oct 29, 2024

• switch to sharing memory between scans

  pmattione-nvidia

  committed
  f4aedb9

  Copy full SHA for f4aedb9