Code

Parquet Modular Encryption support#6637

Code

Draft

rok wants to merge 27 commits intoapache:mainapache/arrow-rs:mainfrom rok:decryption-basics-forkrok/arrow-rs:decryption-basics-forkCopy head branch name to clipboard

+1,290-82

Commits

Commits on Nov 21, 2024

• first commit

  

  ggershinsky

  authored and

  rok

  committed
  9f663ba

Commits on Nov 23, 2024

• Use ParquetMetaDataReader

  rok

  committed
  6f055f9

• Fix CI

  rok

  committed
  d263510

Commits on Dec 3, 2024

• test

  rok

  committed
  3f9a143

Commits on Dec 11, 2024

• save progress

  rok

  committed
  9d17990

Commits on Dec 16, 2024

• work

  rok

  committed
  29d55eb

Commits on Dec 17, 2024

• Review feedback

  rok

  committed
  657f005

• page decompression issue

  rok

  committed
  bb6d3e8

• add update_aad

  rok

  committed
  cf4c54d

Commits on Dec 18, 2024

• Change encrypt and decrypt to return Results

  adamreeve

  committed
  b8fdff1

• Use correct page ordinal and module type in AADs

  adamreeve

  committed
  7f27a97

• Tidy up ordinal types

  adamreeve

  committed
  56419be

• Lint

  rok

  committed
  aa74618

• Fix regular deserialization path

  rok

  committed
  ae29610

• cleaning

  rok

  committed
  8243d38

Commits on Dec 19, 2024

• Update data checks in test

  adamreeve

  committed
  42695b4

• start non-uniform decryption

  rok

  committed
  2334eb3

Commits on Dec 20, 2024

• Add missing doc comments

  adamreeve

  committed
  31405dd

• Make encryption an optional feature

  adamreeve

  committed
  9030f3a

• Handle when a file is encrypted but encryption is disabled or no decryption properties are provided

  adamreeve

  committed
  7db06cc

Commits on Dec 22, 2024

• Allow for plaintext footer

  rok

  committed
  c1e33ba

Commits on Dec 23, 2024

• work

  rok

  committed
  1125f97

Commits on Jan 3, 2025

• Fix method name

  adamreeve

  committed
  5e20821

• Update parquet-testing to use encrypted files with correct repetition levels

  adamreeve

  committed
  36623ac

Commits on Jan 4, 2025

• work

  rok

  committed
  b493d4d

Commits on Jan 6, 2025

• Minor

  rok

  committed
  1123b1a

Commits on Jan 7, 2025

• work

  rok

  committed
  a4105d5