Code

Add experimental blosc2 support#107

Code

Merged

milesgranger merged 172 commits intomastermilesgranger/cramjam:masterfrom blosc2milesgranger/cramjam:blosc2Copy head branch name to clipboardApr 16, 2024

+1,672-36,838

Commits

Commits on May 11, 2023

• Add Silesia Corpus data files and bzip

  milesgranger

  committed
  0f54c2f

Commits on Jun 23, 2023

• Initial impl of blosc2 in libcramjam

  milesgranger

  committed
  7f7dae0

Commits on Mar 16, 2024

• Merge branch 'master' into blosc2

  milesgranger

  committed
  21ecfd3

• Move blosc2 into experimental [skip ci]

  milesgranger

  committed
  2a91ddf

Commits on Mar 19, 2024

• Propagate use-system-blosc2 feature to python-cramjam

  milesgranger

  committed
  c3f4181

• Fix submodule init for experimental.blosc2

  milesgranger

  committed
  1a615c8

Commits on Mar 20, 2024

• Use blosc2 from crates.io

  milesgranger

  committed
  c79d5f4

• Fixup

  milesgranger

  committed
  cd9d4b0

• Try again

  milesgranger

  committed
  6d03e73

• Try again

  milesgranger

  committed
  8a3ee99

• Fix segfault in blosc2

  milesgranger

  committed
  1b25416

Commits on Mar 21, 2024

• bleh

  milesgranger

  committed
  d19759d

• Merge remote-tracking branch 'origin/master' into blosc2

  milesgranger

  committed
  8aa7f48

• fixup

  milesgranger

  committed
  4d19823

• fixup

  milesgranger

  committed
  38babb6

• Fixup

  milesgranger

  committed
  1d1fec3

• fixup

  milesgranger

  committed
  43feadd

• Remove target

  milesgranger

  committed
  9b98c70

Commits on Mar 22, 2024

• try ssh

  milesgranger

  committed
  ffb8561

• fixup

  milesgranger

  committed
  522416d

• reset to main

  milesgranger

  committed
  4c4b8cc

• micromamba

  milesgranger

  committed
  d8a3780

• micromamba

  milesgranger

  committed
  979795a

• fixup

  milesgranger

  committed
  b24a84d

Commits on Apr 1, 2024

• fixup

  milesgranger

  committed
  17ce5d6

• more tries

  milesgranger

  committed
  ec6362f

• chkpt

  milesgranger

  committed
  2e36460

• fiupx

  milesgranger

  committed
  af063f5

• fiupx

  milesgranger

  committed
  319480b

• fixup

  milesgranger

  committed
  89f87a8

Commits on Apr 2, 2024

• fixup

  milesgranger

  committed
  35dac2c

• fixup

  milesgranger

  committed
  36de12d

• fixup

  milesgranger

  committed
  c3a7c4c

• fixup

  milesgranger

  committed
  774b8af

• fixup

  milesgranger

  committed
  94b0745

Commits on Apr 7, 2024

• Fixup - try updated blosc2 crate

  milesgranger

  committed
  21866ff

• Update git fetching in config.toml

  milesgranger

  committed
  3b7cb37

• another attempt

  milesgranger

  committed
  8115631

• change back

  milesgranger

  committed
  2f8015a

• don't use cli

  milesgranger

  committed
  fc156d5

• fixup

  milesgranger

  committed
  f5362ef

• use ssh

  milesgranger

  committed
  219aab4

• use ssh

  milesgranger

  committed
  7e90878

• Fixup

  milesgranger

  committed
  a749ce3

• use https

  milesgranger

  committed
  ea831cc

• fixup

  milesgranger

  committed
  606ea5b

• Debug segfault in compress impl

  milesgranger

  committed
  0a7b269

• try delocate

  milesgranger

  committed
  087999f

• another try

  milesgranger

  committed
  64779c1

Commits on Apr 8, 2024

• try just testing cramjam-python

  milesgranger

  committed
  1457e43

• fix universal also

  milesgranger

  committed
  6d03507

• Try better parametrization

  milesgranger

  committed
  5c07b73

• also try aarch64

  milesgranger

  committed
  586ee73

• fixup

  milesgranger

  committed
  f1b46e5

• fixup

  milesgranger

  committed
  6767ba7

• Fixup

  milesgranger

  committed
  77e59ba

• fixup

  milesgranger

  committed
  e4126c4

• Fixup

  milesgranger

  committed
  169cad2

• try setting rpath

  milesgranger

  committed
  b905a95

• Fixup - rpath in python crate

  milesgranger

  committed
  406a652

• Fixup - move profile to root

  milesgranger

  committed
  31d282d

• remove profile

  milesgranger

  committed
  4edad98

• use maturin directly maybe

  milesgranger

  committed
  a5e21fd

• Fix blosc2 imports

  milesgranger

  committed
  ea1cc61

• universal2 target and updated osx deployment target

  milesgranger

  committed
  1a47cfc

• xfail blosc2 compress_into cramjam.File output

  milesgranger

  committed
  08b6f9d

• Allow dead_code for now in cli

  milesgranger

  committed
  1fe4bb4

• Try to add aarch64 and remaining parameters to matrix

  milesgranger

  committed
  0d4f3c9

• Add cache

  milesgranger

  committed
  28864d0

• Install cramjam for cramjam-cli tests

  milesgranger

  committed
  a1009a2

• Add aarch64 target

  milesgranger

  committed
  db7ae26

• Only install and run tests if universal2

  milesgranger

  committed
  da1bca5

• Just run rust tests on arm64 target

  milesgranger

  committed
  bdea0bd

• Fix target vs arch

  milesgranger

  committed
  4645aae

• fixup - try static again

  milesgranger

  committed
  ac63f9b

• Remove static link feature

  milesgranger

  committed
  0dffd0d

• try static again and no install prefix

  milesgranger

  committed
  df3f271

• Back to macos-13

  milesgranger

  committed
  62f4f91

• non-static link

  milesgranger

  committed
  5b651f1

• Skippg the compress_into File tests for blosc2

  milesgranger

  committed
  a4f59f3

Commits on Apr 9, 2024

• Ensure wheel isn't using system blosc2

  milesgranger

  committed
  fbadfb5

• chkpt - try to add ubuntu-latest

  milesgranger

  committed
  2947b25

• Fix matrix impl in workflow

  milesgranger

  committed
  35be641

• Skip testing on cross compiled wheels

  milesgranger

  committed
  e118531

• fixup

  milesgranger

  committed
  accaddd

• Missing clang

  milesgranger

  committed
  70a49c4

• use upload-artifact@v4

  milesgranger

  committed
  f026a1f

• chkpt: start work on windows ci

  milesgranger

  committed
  1f62ca3

• fixup - missing wheel build

  milesgranger

  committed
  483884d

• Try setting python arch

  milesgranger

  committed
  f766c70

• fixup - skip rust testing on x86

  milesgranger

  committed
  1f7a6a5

• Try removing target-triple

  milesgranger

  committed
  3ad16ab

• Fix missing conf.target for windows

  milesgranger

  committed
  74af1ac

Commits on Apr 10, 2024

• try maturin directly - prev fails w/ missing dll

  milesgranger

  committed
  85bc94f

• Fix multiline cmd

  milesgranger

  committed
  f14c781

• Fix target triple windows

  milesgranger

  committed
  f626703

• Try fixing the path to wheel

  milesgranger

  committed
  b88c3b1

• Add lib path

  milesgranger

  committed
  d6026ed

• write back out to dist

  milesgranger

  committed
  78194b2

• Skip benchmarks

  milesgranger

  committed
  a284f68

• Add pytest-benchmark

  milesgranger

  committed
  0020f2d

• remove memory profiler use

  milesgranger

  committed
  e1b82c0

• Fix path

  milesgranger

  committed
  3a17443

• Prev working, uncomment ubuntu and mac again

  milesgranger

  committed
  70b806b

• fixup - build when skipping tests and single target for macos

  milesgranger

  committed
  5e01462

• Try disabling cache [WORKING]

  milesgranger

  committed
  a43b1d6

• try add back cache

  milesgranger

  committed
  8220291

• Remove windows sdist

  milesgranger

  committed
  6f6ef50

• Attempt everything

  milesgranger

  committed
  a5ca31a

• fixup

  milesgranger

  committed
  d90fd84

• Fixup

  milesgranger

  committed
  37678f3

• fixup

  milesgranger

  committed
  1374caa

• Fixup

  milesgranger

  committed
  285abd6

• fixup

  milesgranger

  committed
  9e8573a

• Fixup

  milesgranger

  committed
  3ba52ad

• fixup

  milesgranger

  committed
  95c658a

• fixup

  milesgranger

  committed
  70badb4

• fixup

  milesgranger

  committed
  c24c91c

• fixup

  milesgranger

  committed
  15e9965

• fixup

  milesgranger

  committed
  33bbd26

• only use exclude

  milesgranger

  committed
  f0a4988

• fixup

  milesgranger

  committed
  198917b

• fixup

  milesgranger

  committed
  bb90a87

• try yum and apt

  milesgranger

  committed
  a65cf92

• Slowly debug

  milesgranger

  committed
  77ec470

• Limit libdeflater <1.20

  milesgranger

  committed
  95e5472

• Debug aarch64 ubuntu build

  milesgranger

  committed
  577b2b6

• fixup

  milesgranger

  committed
  032347b

• fixup

  milesgranger

  committed
  8a5d65b

• Move blosc2/experimental into opt in feature

  milesgranger

  committed
  21eb9e5

• Run all

  milesgranger

  committed
  c1a63c9

• Only enable blosc2 on x86_64 linux

  milesgranger

  committed
  3b044a7

Commits on Apr 11, 2024

• restrict libdeflate-sys due to gcc

  milesgranger

  committed
  b5a5d2b

• bypass blosc2 when not installed

  milesgranger

  committed
  4527f1c

• updates

  milesgranger

  committed
  60274f1

• try to fix features in env vars2

  milesgranger

  committed
  96ef5af

• fixup

  milesgranger

  committed
  2ab6068

• Fixes

  milesgranger

  committed
  e45f2cf

• don't test musllinx wheels

  milesgranger

  committed
  efa4109

• Add features to cache key

  milesgranger

  committed
  9a0a36d

• A few more fixes

  milesgranger

  committed
  f10ed28

• Fixup - run everything

  milesgranger

  committed
  e60c0a0

• fixes

  milesgranger

  committed
  869e6c7

• Add experimental to cramjam-cli

  milesgranger

  committed
  eca2049

• rerun

  milesgranger

  committed
  44ce491

• Update for blosc2-rs using cc not cmake crate

  milesgranger

  committed
  466991e

• Another go with updated blosc2-rs build

  milesgranger

  committed
  76c5adb

• Merge remote-tracking branch 'origin/master' into blosc2

  milesgranger

  committed
  d53e135

• try to switch to macos-14

  milesgranger

  committed
  059fb5a

• 3.8 not on macos-14

  milesgranger

  committed
  004087e

• macos-14 no python arch

  milesgranger

  committed
  a832f53

• try downloading existing blosc2 for macos-13

  milesgranger

  committed
  ebfb8c8

• Fixes for updated blosc2-rs

  milesgranger

  committed
  534e8d4

• Fixup

  milesgranger

  committed
  4d79c83

• Fixup

  milesgranger

  committed
  b02280b

• Fixup

  milesgranger

  committed
  91b3cb3

Commits on Apr 12, 2024

• Try new blosc2-rs

  milesgranger

  committed
  38d4bcd

• Anotehr go

  milesgranger

  committed
  c0a582d

• set macos fallback lib path

  milesgranger

  committed
  a960041

• change out and fixed wheel dir for windows

  milesgranger

  committed
  495d412

• fixup

  milesgranger

  committed
  d4ddc2c

• fixup

  milesgranger

  committed
  b837472

• Update windows repair logic and comment out cramjam-cli

  milesgranger

  committed
  590cf76

• Previous worked except for windows i686 - try static as well now

  milesgranger

  committed
  e373902

• Add cache and try other arch for experimental

  milesgranger

  committed
  b3594b3

• Try updated blosc2

  milesgranger

  committed
  8812025

• Try updated blosc2

  milesgranger

  committed
  590d645

• Try updated blosc2

  milesgranger

  committed
  7a0c8a1

• Try updated blosc2

  milesgranger

  committed
  9e26734

Commits on Apr 15, 2024

• Fix CI for blosc2 integration (#153)

  milesgranger

  authored
  6e555c2

• native test logic fix maybe

  milesgranger

  committed
  28d1c7a

Commits on Apr 16, 2024

• Other fixes

  milesgranger

  committed
  df8ff4d