Code

Add experimental blosc2 support#107

Code

Merged

milesgranger merged 172 commits intomastermilesgranger/cramjam:masterfrom blosc2milesgranger/cramjam:blosc2Copy head branch name to clipboardApr 16, 2024

+1,672-36,838

Commits

Commits on May 11, 2023

• Add Silesia Corpus data files and bzip

  milesgranger

  committed
  0f54c2f

  Copy full SHA for 0f54c2f

Commits on Jun 23, 2023

• Initial impl of blosc2 in libcramjam

  milesgranger

  committed
  7f7dae0

  Copy full SHA for 7f7dae0

Commits on Mar 16, 2024

• Merge branch 'master' into blosc2

  milesgranger

  committed
  21ecfd3

  Copy full SHA for 21ecfd3

• Move blosc2 into experimental [skip ci]

  milesgranger

  committed
  2a91ddf

  Copy full SHA for 2a91ddf

Commits on Mar 19, 2024

• Propagate use-system-blosc2 feature to python-cramjam

  milesgranger

  committed
  c3f4181

  Copy full SHA for c3f4181

• Fix submodule init for experimental.blosc2

  milesgranger

  committed
  1a615c8

  Copy full SHA for 1a615c8

Commits on Mar 20, 2024

• Use blosc2 from crates.io

  milesgranger

  committed
  c79d5f4

  Copy full SHA for c79d5f4

• Fixup

  milesgranger

  committed
  cd9d4b0

  Copy full SHA for cd9d4b0

• Try again

  milesgranger

  committed
  6d03e73

  Copy full SHA for 6d03e73

• Try again

  milesgranger

  committed
  8a3ee99

  Copy full SHA for 8a3ee99

• Fix segfault in blosc2

  milesgranger

  committed
  1b25416

  Copy full SHA for 1b25416

Commits on Mar 21, 2024

• bleh

  milesgranger

  committed
  d19759d

  Copy full SHA for d19759d

• Merge remote-tracking branch 'origin/master' into blosc2

  milesgranger

  committed
  8aa7f48

  Copy full SHA for 8aa7f48

• fixup

  milesgranger

  committed
  4d19823

  Copy full SHA for 4d19823

• fixup

  milesgranger

  committed
  38babb6

  Copy full SHA for 38babb6

• Fixup

  milesgranger

  committed
  1d1fec3

  Copy full SHA for 1d1fec3

• fixup

  milesgranger

  committed
  43feadd

  Copy full SHA for 43feadd

• Remove target

  milesgranger

  committed
  9b98c70

  Copy full SHA for 9b98c70

Commits on Mar 22, 2024

• try ssh

  milesgranger

  committed
  ffb8561

  Copy full SHA for ffb8561

• fixup

  milesgranger

  committed
  522416d

  Copy full SHA for 522416d

• reset to main

  milesgranger

  committed
  4c4b8cc

  Copy full SHA for 4c4b8cc

• micromamba

  milesgranger

  committed
  d8a3780

  Copy full SHA for d8a3780

• micromamba

  milesgranger

  committed
  979795a

  Copy full SHA for 979795a

• fixup

  milesgranger

  committed
  b24a84d

  Copy full SHA for b24a84d

Commits on Apr 1, 2024

• fixup

  milesgranger

  committed
  17ce5d6

  Copy full SHA for 17ce5d6

• more tries

  milesgranger

  committed
  ec6362f

  Copy full SHA for ec6362f

• chkpt

  milesgranger

  committed
  2e36460

  Copy full SHA for 2e36460

• fiupx

  milesgranger

  committed
  af063f5

  Copy full SHA for af063f5

• fiupx

  milesgranger

  committed
  319480b

  Copy full SHA for 319480b

• fixup

  milesgranger

  committed
  89f87a8

  Copy full SHA for 89f87a8

Commits on Apr 2, 2024

• fixup

  milesgranger

  committed
  35dac2c

  Copy full SHA for 35dac2c

• fixup

  milesgranger

  committed
  36de12d

  Copy full SHA for 36de12d

• fixup

  milesgranger

  committed
  c3a7c4c

  Copy full SHA for c3a7c4c

• fixup

  milesgranger

  committed
  774b8af

  Copy full SHA for 774b8af

• fixup

  milesgranger

  committed
  94b0745

  Copy full SHA for 94b0745

Commits on Apr 7, 2024

• Fixup - try updated blosc2 crate

  milesgranger

  committed
  21866ff

  Copy full SHA for 21866ff

• Update git fetching in config.toml

  milesgranger

  committed
  3b7cb37

  Copy full SHA for 3b7cb37

• another attempt

  milesgranger

  committed
  8115631

  Copy full SHA for 8115631

• change back

  milesgranger

  committed
  2f8015a

  Copy full SHA for 2f8015a

• don't use cli

  milesgranger

  committed
  fc156d5

  Copy full SHA for fc156d5

• fixup

  milesgranger

  committed
  f5362ef

  Copy full SHA for f5362ef

• use ssh

  milesgranger

  committed
  219aab4

  Copy full SHA for 219aab4

• use ssh

  milesgranger

  committed
  7e90878

  Copy full SHA for 7e90878

• Fixup

  milesgranger

  committed
  a749ce3

  Copy full SHA for a749ce3

• use https

  milesgranger

  committed
  ea831cc

  Copy full SHA for ea831cc

• fixup

  milesgranger

  committed
  606ea5b

  Copy full SHA for 606ea5b

• Debug segfault in compress impl

  milesgranger

  committed
  0a7b269

  Copy full SHA for 0a7b269

• try delocate

  milesgranger

  committed
  087999f

  Copy full SHA for 087999f

• another try

  milesgranger

  committed
  64779c1

  Copy full SHA for 64779c1

Commits on Apr 8, 2024

• try just testing cramjam-python

  milesgranger

  committed
  1457e43

  Copy full SHA for 1457e43

• fix universal also

  milesgranger

  committed
  6d03507

  Copy full SHA for 6d03507

• Try better parametrization

  milesgranger

  committed
  5c07b73

  Copy full SHA for 5c07b73

• also try aarch64

  milesgranger

  committed
  586ee73

  Copy full SHA for 586ee73

• fixup

  milesgranger

  committed
  f1b46e5

  Copy full SHA for f1b46e5

• fixup

  milesgranger

  committed
  6767ba7

  Copy full SHA for 6767ba7

• Fixup

  milesgranger

  committed
  77e59ba

  Copy full SHA for 77e59ba

• fixup

  milesgranger

  committed
  e4126c4

  Copy full SHA for e4126c4

• Fixup

  milesgranger

  committed
  169cad2

  Copy full SHA for 169cad2

• try setting rpath

  milesgranger

  committed
  b905a95

  Copy full SHA for b905a95

• Fixup - rpath in python crate

  milesgranger

  committed
  406a652

  Copy full SHA for 406a652

• Fixup - move profile to root

  milesgranger

  committed
  31d282d

  Copy full SHA for 31d282d

• remove profile

  milesgranger

  committed
  4edad98

  Copy full SHA for 4edad98

• use maturin directly maybe

  milesgranger

  committed
  a5e21fd

  Copy full SHA for a5e21fd

• Fix blosc2 imports

  milesgranger

  committed
  ea1cc61

  Copy full SHA for ea1cc61

• universal2 target and updated osx deployment target

  milesgranger

  committed
  1a47cfc

  Copy full SHA for 1a47cfc

• xfail blosc2 compress_into cramjam.File output

  milesgranger

  committed
  08b6f9d

  Copy full SHA for 08b6f9d

• Allow dead_code for now in cli

  milesgranger

  committed
  1fe4bb4

  Copy full SHA for 1fe4bb4

• Try to add aarch64 and remaining parameters to matrix

  milesgranger

  committed
  0d4f3c9

  Copy full SHA for 0d4f3c9

• Add cache

  milesgranger

  committed
  28864d0

  Copy full SHA for 28864d0

• Install cramjam for cramjam-cli tests

  milesgranger

  committed
  a1009a2

  Copy full SHA for a1009a2

• Add aarch64 target

  milesgranger

  committed
  db7ae26

  Copy full SHA for db7ae26

• Only install and run tests if universal2

  milesgranger

  committed
  da1bca5

  Copy full SHA for da1bca5

• Just run rust tests on arm64 target

  milesgranger

  committed
  bdea0bd

  Copy full SHA for bdea0bd

• Fix target vs arch

  milesgranger

  committed
  4645aae

  Copy full SHA for 4645aae

• fixup - try static again

  milesgranger

  committed
  ac63f9b

  Copy full SHA for ac63f9b

• Remove static link feature

  milesgranger

  committed
  0dffd0d

  Copy full SHA for 0dffd0d

• try static again and no install prefix

  milesgranger

  committed
  df3f271

  Copy full SHA for df3f271

• Back to macos-13

  milesgranger

  committed
  62f4f91

  Copy full SHA for 62f4f91

• non-static link

  milesgranger

  committed
  5b651f1

  Copy full SHA for 5b651f1

• Skippg the compress_into File tests for blosc2

  milesgranger

  committed
  a4f59f3

  Copy full SHA for a4f59f3

Commits on Apr 9, 2024

• Ensure wheel isn't using system blosc2

  milesgranger

  committed
  fbadfb5

  Copy full SHA for fbadfb5

• chkpt - try to add ubuntu-latest

  milesgranger

  committed
  2947b25

  Copy full SHA for 2947b25

• Fix matrix impl in workflow

  milesgranger

  committed
  35be641

  Copy full SHA for 35be641

• Skip testing on cross compiled wheels

  milesgranger

  committed
  e118531

  Copy full SHA for e118531

• fixup

  milesgranger

  committed
  accaddd

  Copy full SHA for accaddd

• Missing clang

  milesgranger

  committed
  70a49c4

  Copy full SHA for 70a49c4

• use upload-artifact@v4

  milesgranger

  committed
  f026a1f

  Copy full SHA for f026a1f

• chkpt: start work on windows ci

  milesgranger

  committed
  1f62ca3

  Copy full SHA for 1f62ca3

• fixup - missing wheel build

  milesgranger

  committed
  483884d

  Copy full SHA for 483884d

• Try setting python arch

  milesgranger

  committed
  f766c70

  Copy full SHA for f766c70

• fixup - skip rust testing on x86

  milesgranger

  committed
  1f7a6a5

  Copy full SHA for 1f7a6a5

• Try removing target-triple

  milesgranger

  committed
  3ad16ab

  Copy full SHA for 3ad16ab

• Fix missing conf.target for windows

  milesgranger

  committed
  74af1ac

  Copy full SHA for 74af1ac

Commits on Apr 10, 2024

• try maturin directly - prev fails w/ missing dll

  milesgranger

  committed
  85bc94f

  Copy full SHA for 85bc94f

• Fix multiline cmd

  milesgranger

  committed
  f14c781

  Copy full SHA for f14c781

• Fix target triple windows

  milesgranger

  committed
  f626703

  Copy full SHA for f626703

• Try fixing the path to wheel

  milesgranger

  committed
  b88c3b1

  Copy full SHA for b88c3b1

• Add lib path

  milesgranger

  committed
  d6026ed

  Copy full SHA for d6026ed

• write back out to dist

  milesgranger

  committed
  78194b2

  Copy full SHA for 78194b2

• Skip benchmarks

  milesgranger

  committed
  a284f68

  Copy full SHA for a284f68

• Add pytest-benchmark

  milesgranger

  committed
  0020f2d

  Copy full SHA for 0020f2d

• remove memory profiler use

  milesgranger

  committed
  e1b82c0

  Copy full SHA for e1b82c0

• Fix path

  milesgranger

  committed
  3a17443

  Copy full SHA for 3a17443

• Prev working, uncomment ubuntu and mac again

  milesgranger

  committed
  70b806b

  Copy full SHA for 70b806b

• fixup - build when skipping tests and single target for macos

  milesgranger

  committed
  5e01462

  Copy full SHA for 5e01462

• Try disabling cache [WORKING]

  milesgranger

  committed
  a43b1d6

  Copy full SHA for a43b1d6

• try add back cache

  milesgranger

  committed
  8220291

  Copy full SHA for 8220291

• Remove windows sdist

  milesgranger

  committed
  6f6ef50

  Copy full SHA for 6f6ef50

• Attempt everything

  milesgranger

  committed
  a5ca31a

  Copy full SHA for a5ca31a

• fixup

  milesgranger

  committed
  d90fd84

  Copy full SHA for d90fd84

• Fixup

  milesgranger

  committed
  37678f3

  Copy full SHA for 37678f3

• fixup

  milesgranger

  committed
  1374caa

  Copy full SHA for 1374caa

• Fixup

  milesgranger

  committed
  285abd6

  Copy full SHA for 285abd6

• fixup

  milesgranger

  committed
  9e8573a

  Copy full SHA for 9e8573a

• Fixup

  milesgranger

  committed
  3ba52ad

  Copy full SHA for 3ba52ad

• fixup

  milesgranger

  committed
  95c658a

  Copy full SHA for 95c658a

• fixup

  milesgranger

  committed
  70badb4

  Copy full SHA for 70badb4

• fixup

  milesgranger

  committed
  c24c91c

  Copy full SHA for c24c91c

• fixup

  milesgranger

  committed
  15e9965

  Copy full SHA for 15e9965

• fixup

  milesgranger

  committed
  33bbd26

  Copy full SHA for 33bbd26

• only use exclude

  milesgranger

  committed
  f0a4988

  Copy full SHA for f0a4988

• fixup

  milesgranger

  committed
  198917b

  Copy full SHA for 198917b

• fixup

  milesgranger

  committed
  bb90a87

  Copy full SHA for bb90a87

• try yum and apt

  milesgranger

  committed
  a65cf92

  Copy full SHA for a65cf92

• Slowly debug

  milesgranger

  committed
  77ec470

  Copy full SHA for 77ec470

• Limit libdeflater <1.20

  milesgranger

  committed
  95e5472

  Copy full SHA for 95e5472

• Debug aarch64 ubuntu build

  milesgranger

  committed
  577b2b6

  Copy full SHA for 577b2b6

• fixup

  milesgranger

  committed
  032347b

  Copy full SHA for 032347b

• fixup

  milesgranger

  committed
  8a5d65b

  Copy full SHA for 8a5d65b

• Move blosc2/experimental into opt in feature

  milesgranger

  committed
  21eb9e5

  Copy full SHA for 21eb9e5

• Run all

  milesgranger

  committed
  c1a63c9

  Copy full SHA for c1a63c9

• Only enable blosc2 on x86_64 linux

  milesgranger

  committed
  3b044a7

  Copy full SHA for 3b044a7

Commits on Apr 11, 2024

• restrict libdeflate-sys due to gcc

  milesgranger

  committed
  b5a5d2b

  Copy full SHA for b5a5d2b

• bypass blosc2 when not installed

  milesgranger

  committed
  4527f1c

  Copy full SHA for 4527f1c

• updates

  milesgranger

  committed
  60274f1

  Copy full SHA for 60274f1

• try to fix features in env vars2

  milesgranger

  committed
  96ef5af

  Copy full SHA for 96ef5af

• fixup

  milesgranger

  committed
  2ab6068

  Copy full SHA for 2ab6068

• Fixes

  milesgranger

  committed
  e45f2cf

  Copy full SHA for e45f2cf

• don't test musllinx wheels

  milesgranger

  committed
  efa4109

  Copy full SHA for efa4109

• Add features to cache key

  milesgranger

  committed
  9a0a36d

  Copy full SHA for 9a0a36d

• A few more fixes

  milesgranger

  committed
  f10ed28

  Copy full SHA for f10ed28

• Fixup - run everything

  milesgranger

  committed
  e60c0a0

  Copy full SHA for e60c0a0

• fixes

  milesgranger

  committed
  869e6c7

  Copy full SHA for 869e6c7

• Add experimental to cramjam-cli

  milesgranger

  committed
  eca2049

  Copy full SHA for eca2049

• rerun

  milesgranger

  committed
  44ce491

  Copy full SHA for 44ce491

• Update for blosc2-rs using cc not cmake crate

  milesgranger

  committed
  466991e

  Copy full SHA for 466991e

• Another go with updated blosc2-rs build

  milesgranger

  committed
  76c5adb

  Copy full SHA for 76c5adb

• Merge remote-tracking branch 'origin/master' into blosc2

  milesgranger

  committed
  d53e135

  Copy full SHA for d53e135

• try to switch to macos-14

  milesgranger

  committed
  059fb5a

  Copy full SHA for 059fb5a

• 3.8 not on macos-14

  milesgranger

  committed
  004087e

  Copy full SHA for 004087e

• macos-14 no python arch

  milesgranger

  committed
  a832f53

  Copy full SHA for a832f53

• try downloading existing blosc2 for macos-13

  milesgranger

  committed
  ebfb8c8

  Copy full SHA for ebfb8c8

• Fixes for updated blosc2-rs

  milesgranger

  committed
  534e8d4

  Copy full SHA for 534e8d4

• Fixup

  milesgranger

  committed
  4d79c83

  Copy full SHA for 4d79c83

• Fixup

  milesgranger

  committed
  b02280b

  Copy full SHA for b02280b

• Fixup

  milesgranger

  committed
  91b3cb3

  Copy full SHA for 91b3cb3

Commits on Apr 12, 2024

• Try new blosc2-rs

  milesgranger

  committed
  38d4bcd

  Copy full SHA for 38d4bcd

• Anotehr go

  milesgranger

  committed
  c0a582d

  Copy full SHA for c0a582d

• set macos fallback lib path

  milesgranger

  committed
  a960041

  Copy full SHA for a960041

• change out and fixed wheel dir for windows

  milesgranger

  committed
  495d412

  Copy full SHA for 495d412

• fixup

  milesgranger

  committed
  d4ddc2c

  Copy full SHA for d4ddc2c

• fixup

  milesgranger

  committed
  b837472

  Copy full SHA for b837472

• Update windows repair logic and comment out cramjam-cli

  milesgranger

  committed
  590cf76

  Copy full SHA for 590cf76

• Previous worked except for windows i686 - try static as well now

  milesgranger

  committed
  e373902

  Copy full SHA for e373902

• Add cache and try other arch for experimental

  milesgranger

  committed
  b3594b3

  Copy full SHA for b3594b3

• Try updated blosc2

  milesgranger

  committed
  8812025

  Copy full SHA for 8812025

• Try updated blosc2

  milesgranger

  committed
  590d645

  Copy full SHA for 590d645

• Try updated blosc2

  milesgranger

  committed
  7a0c8a1

  Copy full SHA for 7a0c8a1

• Try updated blosc2

  milesgranger

  committed
  9e26734

  Copy full SHA for 9e26734

Commits on Apr 15, 2024

• Fix CI for blosc2 integration (#153)

  milesgranger

  authored
  6e555c2

  Copy full SHA for 6e555c2

• native test logic fix maybe

  milesgranger

  committed
  28d1c7a

  Copy full SHA for 28d1c7a

Commits on Apr 16, 2024

• Other fixes

  milesgranger

  committed
  df8ff4d

  Copy full SHA for df8ff4d