Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
166 commits
Select commit Hold shift + click to select a range
a5a6864
Feature: add `into_mut` methods on mask and buffer (#5214)
connortsui20 Nov 7, 2025
47c0dea
fix[pco]: cast condition check (#5239)
joseph-isaacs Nov 7, 2025
c304946
chore: Slightly nicer fuzzer assertions (#5240)
robert3005 Nov 7, 2025
6375e50
Fix: remove TPC-H SF 1000 from nightly benchmarks (#5235)
connortsui20 Nov 7, 2025
0cb2132
Feature: add `into_mut` to vectors (#5221)
connortsui20 Nov 7, 2025
54fd5c4
chore: Convert DuckDB vectors directly to vortex vectors (#5228)
robert3005 Nov 7, 2025
4796478
fix[array]: take propagate isconstant if indices all_valid (#5241)
joseph-isaacs Nov 7, 2025
bdfa4c2
Add conversions from Vectors into ArrayRef (#5243)
gatesn Nov 7, 2025
33e8cf0
Batch execution API (#5242)
gatesn Nov 7, 2025
86f3bf9
Fix: make `Filter` compute take `self` instead of `&self` (#5248)
connortsui20 Nov 7, 2025
8f218ae
fix[fuzz]: apply mask to validity in baseline (#5249)
joseph-isaacs Nov 7, 2025
ca770ed
Fix: silence codspeed warning (#5253)
connortsui20 Nov 7, 2025
6a12a20
Chore: remove feature gates from vortex-compute (#5254)
connortsui20 Nov 8, 2025
1c7c759
Feature: add in-place filter for `BufferMut` + benchmarks (#5238)
connortsui20 Nov 8, 2025
5125ce4
Fix: casting Zstd array to non nullable requires decompression (#5258)
robert3005 Nov 9, 2025
fc4581e
Update crate-ci/typos action to v1.39.0 (#5260)
renovate[bot] Nov 10, 2025
f231932
Update all patch updates (#5259)
renovate[bot] Nov 10, 2025
d6b73e2
chore: Fix fuzzers baseline nullability for decimal fill_null (#5257)
robert3005 Nov 10, 2025
f0d6048
Bump codspeed (action and dependency) (#5261)
AdamGS Nov 10, 2025
7cfc405
chore: Fix fuzzers baseline nullability for compare and take (#5255)
robert3005 Nov 10, 2025
7541a3b
Bump DF to 50.3.0 (#5263)
AdamGS Nov 10, 2025
45cd6c1
[DataFusion] Don't pushdown empty filters (#5264)
AdamGS Nov 10, 2025
4fa4ec5
Pipeline execution (#5251)
gatesn Nov 10, 2025
fe7aef6
chore: serialize for `Mask` (#5267)
blaginin Nov 10, 2025
243deeb
chore[array/expr]: move `vortex-expr` into `vortex_array::expr` (#5269)
joseph-isaacs Nov 10, 2025
e59b5d3
fix: compare for struct with constant items (#5271)
a10y Nov 10, 2025
32d0834
feat: use Sparse compression for floats, strings (#5237)
a10y Nov 10, 2025
a9b602a
document reproducible writes (#5280)
onursatici Nov 11, 2025
c4b40e3
handle null views correctly on varbinview compaction (#5279)
onursatici Nov 11, 2025
1c1a3ff
chore: add slack to readme (#5281)
lwwmanning Nov 11, 2025
374e089
feat: impl `expand` for `Buffer` & `BufferMut` (#5270)
0ax1 Nov 11, 2025
c4240f1
API and partial implementation of sparse pipelined exection (#5284)
gatesn Nov 11, 2025
5f998ed
fix: vortex-tui browse with search (#5282)
a10y Nov 11, 2025
fcf2d98
fix[array]: sum with initial value to fix op assoc (#5278)
joseph-isaacs Nov 12, 2025
ef87e49
Clarify calling convention for pipeline kernels (#5286)
gatesn Nov 12, 2025
69377e1
fix[vortex-dict]: avoid full materialization in min_max (#5268)
asubiotto Nov 12, 2025
e262a87
Pipeline Calling Convention 2 (#5291)
gatesn Nov 12, 2025
1cb7a39
fix[vortex-datafusion]: check field exists in get_field pushdown (#5295)
asubiotto Nov 12, 2025
f7dcd01
Feature: add aligned bitpacked pipeline kernel (#5299)
connortsui20 Nov 12, 2025
86c065d
move vortex-dict into vortex-array (#5289)
onursatici Nov 12, 2025
9b76ef5
chore: make ArrayAccessor infallible (#5303)
a10y Nov 12, 2025
b454508
Unblock release by publishing GPU crates (#5293)
AdamGS Nov 13, 2025
d8f4b2b
Chore: move filter files around (#5300)
connortsui20 Nov 13, 2025
96196d3
chore(deps): update actions/upload-artifact action to v5 (#5306)
renovate[bot] Nov 13, 2025
91f27af
chore(deps): update actions/download-artifact action to v6 (#5305)
renovate[bot] Nov 13, 2025
20f420c
fix(deps): update dependency ch.qos.logback:logback-classic to v1.5.2…
renovate[bot] Nov 13, 2025
4cf8fbf
chore(deps): update plugin com.palantir.consistent-versions to v3.7.0…
renovate[bot] Nov 13, 2025
9a39ebe
chore(deps): update plugin com.vanniktech.maven.publish to v0.35.0 (#…
renovate[bot] Nov 13, 2025
e95ea1e
chore(deps): update plugin com.palantir.git-version to v4.2.0 (#5309)
renovate[bot] Nov 13, 2025
4552c10
chore(deps): update dependency gradle to v9 (#4085)
renovate[bot] Nov 13, 2025
6d747a6
chore: bump claude-code-action to v1.0.16 (#5312)
joseph-isaacs Nov 13, 2025
0932f92
feat: automated fuzzing issue creation with Claude (#5292)
joseph-isaacs Nov 13, 2025
e866f75
fix vortex-gpu compilation (#5315)
onursatici Nov 13, 2025
5ee3983
fix: update Claude Code Action to v1 parameter format (#5314)
joseph-isaacs Nov 13, 2025
ecb43e5
feat: Add Stage 2 automated fix workflow for fuzzer crashes (#5319)
joseph-isaacs Nov 13, 2025
3b9f233
perf: optimize `expand` (#5285)
0ax1 Nov 13, 2025
956f5c2
Fix zero-copy pipeline input (#5324)
gatesn Nov 13, 2025
f401792
arrow -> vortex for dict arrays (#5316)
onursatici Nov 13, 2025
192a9d1
refactor: optimize BitBuffer::from(Vec<bool>) using 64-bit packing (#…
joseph-isaacs Nov 13, 2025
31b5671
chore[claude]: update claude.md (#5318)
joseph-isaacs Nov 13, 2025
3615760
Chore: add todo and clean a bit in pipeline step (#5334)
connortsui20 Nov 13, 2025
6e49a95
chore: implement Filter for new MaskIndices type for all vectors (#5333)
a10y Nov 13, 2025
8bc0df8
Fix: handle validity in bitpack pipeline kernel (#5330)
connortsui20 Nov 13, 2025
6043a57
fix: unblock the fuzzers (#5335)
a10y Nov 14, 2025
dbda77c
chore: add automated crash reporting for array_ops fuzzing (#5317)
joseph-isaacs Nov 14, 2025
9d938cd
feat: bump duckdb to 1.4.2 (#5337)
0ax1 Nov 14, 2025
ed51819
test: more `iter_bits` test cases (#5336)
0ax1 Nov 14, 2025
5405737
chore: bump duckdb version to 1.4.2 in gh actions (#5339)
0ax1 Nov 14, 2025
bd6e37a
feat: add manual trigger support to fuzzer fix automation (#5323)
joseph-isaacs Nov 14, 2025
613af3f
chore: duckdb e2e roundtrip tests (#5342)
0ax1 Nov 14, 2025
d9fb43f
fix: `SequenceVTable` bounds check (#5341)
blaginin Nov 14, 2025
2fd4660
fix: cfg disable unix-specific operations (#5326)
danking Nov 14, 2025
ed8d7a9
fix: add permissions to fuzzer fix automation workflow (#5345)
joseph-isaacs Nov 14, 2025
68873b3
chore: document Expr.__getitem__ (get a field of a struct array) (#5344)
danking Nov 14, 2025
e113864
chore: bug is not a sufficient label (#5351)
danking Nov 14, 2025
33a5553
Move BitView to vortex-buffer and make generic over N (#5353)
gatesn Nov 15, 2025
ca09810
chore(deps): update all patch updates (#5357)
renovate[bot] Nov 17, 2025
615bfef
chore(deps): update rust crate bytes to v1.11.0 (#5358)
renovate[bot] Nov 17, 2025
76aeed6
chore: All of vortex-gpu requires compiler flag (#5362)
robert3005 Nov 17, 2025
48a528d
chore: documentation is a valid PR tag (#5350)
danking Nov 17, 2025
cbf93fd
Mooooaarrrrr generics (#5367)
gatesn Nov 17, 2025
f48976e
chore: gpu_bitunpack bench is behind cfg flag (#5369)
robert3005 Nov 17, 2025
8f7b707
fix: yo dawg, I heard you like inlining (#5363)
a10y Nov 17, 2025
b1054d0
Use the specified concurrency value when reading from a ObjectStoreIo…
nrc Nov 18, 2025
d9fcf06
feat[vortex-expr]: better debug print (#5374)
joseph-isaacs Nov 18, 2025
1aac9ca
chore: Fix compilation of benchmarks if gpu_unstable is not enabled (…
robert3005 Nov 18, 2025
35d12a3
Faster Pipelines (#5352)
gatesn Nov 18, 2025
3c5d9fd
chore[vortex-gpu]: remove vortex-gpu (#5376)
joseph-isaacs Nov 18, 2025
9cf954f
fix[vortex-dict]: faster min_max for dict array (#5288)
joseph-isaacs Nov 18, 2025
aa5c138
fix[vortex-array]: correct convert to arrow from vortex (#5378)
joseph-isaacs Nov 18, 2025
1f50f1c
chore(deps): update codspeedhq/action digest to 6a8e2b8 (#5138)
renovate[bot] Nov 18, 2025
07f5039
fix: VarBin overflow on take (#5361)
a10y Nov 18, 2025
34a6ac1
Revert "chore[vortex-gpu]: remove vortex-gpu" (#5384)
joseph-isaacs Nov 18, 2025
4c990b4
fix: cast must cast its stats too (#5386)
danking Nov 18, 2025
60492c4
feat[vortex-expr]: add expr rewrite rules (#5348)
joseph-isaacs Nov 18, 2025
e269163
fix: performance regression for filtering ListView (#5390)
a10y Nov 18, 2025
e1c8435
chore: suggest using a cast for float-float and int-int comparisons (…
danking Nov 18, 2025
39004fc
chore: better expression error messages on failure (#5392)
danking Nov 18, 2025
d404eea
feat: PyExpr::evaluate (#5388)
danking Nov 18, 2025
28f0989
chore[vortex-array]: remove SerdeVTable (#5387)
joseph-isaacs Nov 19, 2025
7c76e43
fix: BitView slice filter (#5381)
a10y Nov 19, 2025
d17d54f
feat: cast expression (#5389)
danking Nov 19, 2025
23967d7
chore[vortex-array]: rename `reduce_children` -> `reduce` (#5375)
joseph-isaacs Nov 19, 2025
dc03c4f
chore[vortex-array]: remove ser/de type constraint from Metadata (#5397)
joseph-isaacs Nov 19, 2025
cff218e
fix: vx_struct_fields_field_dtype takes usize instead of u64 (#5396)
robert3005 Nov 19, 2025
63aa58c
feat[vortex-expr]: `reduce_parent` has typed parent (#5398)
joseph-isaacs Nov 19, 2025
e25c0a2
actually make ZCTL (#5402)
a10y Nov 19, 2025
3df9296
chore[vortex-expr]: allow `Arc`ed ref to the rewrite rule (#5401)
joseph-isaacs Nov 19, 2025
b4c0f8d
chore[vortex-array]: clean up doc str (#5403)
joseph-isaacs Nov 19, 2025
4321359
chore[vortex-array]: remove unused experimental `compute` arrays (#5404)
joseph-isaacs Nov 19, 2025
50ddc86
feat[vortex-array]: expr array that represents lazy computation (#5400)
joseph-isaacs Nov 19, 2025
1d5d34a
Add VectorOps::clear (#5409)
gatesn Nov 19, 2025
4968607
perf[vortex-expr]: replace can stop looking at subtree if it finds a …
joseph-isaacs Nov 20, 2025
46e0630
perf[dict]: all_values_referenced to allow pushdown optimisation. (#5…
joseph-isaacs Nov 20, 2025
c95c475
fix: add missing dependency: typing-extensions (#5420)
danking Nov 20, 2025
611d049
chore[ci]: unify the benchmark table analysis thresholds (#5413)
joseph-isaacs Nov 20, 2025
8294dd6
chore: less emojis in top-level readme (#5422)
0ax1 Nov 20, 2025
7226a1b
feat: pipeline pcodec (#5415)
0ax1 Nov 20, 2025
e38ae64
Pipeline use immutable vectors (#5418)
gatesn Nov 20, 2025
aaf5245
fix[ci]: use run_id in the s3 benchmark runs (#5421)
joseph-isaacs Nov 20, 2025
71f0f00
Fix: incorrect offset for nulls + don't chunk elements (#5423)
connortsui20 Nov 20, 2025
815a4e2
Handwritten pipeline benchmark and analysis (#5408)
connortsui20 Nov 20, 2025
cb46737
Remove selection mask from batch vtable (#5424)
gatesn Nov 20, 2025
79d3984
Feature: add `spare_capacity_mut` to `PVectorMut` (#5287)
connortsui20 Nov 20, 2025
5cf5ff5
feat[vortex-array] add an array session rule registry (#5414)
joseph-isaacs Nov 20, 2025
3438bca
Chore: Use `MaybeUninit` instead of `UninitRange` for bit unpacking (…
connortsui20 Nov 20, 2025
df9edda
Chore: rename unpack functions (#5428)
connortsui20 Nov 20, 2025
c2303e5
Docs: document `chunk_offsets` in `Patches` (#5429)
connortsui20 Nov 20, 2025
a891151
Chore: rename apply patches (#5430)
connortsui20 Nov 20, 2025
557afef
Consolidate into stat_expression function (#5366)
gatesn Nov 20, 2025
bec5098
Chore: add set functions to mask mut (#5432)
connortsui20 Nov 21, 2025
2013eff
feat[vortex-array] chunked array has owned chunk_offsets child (#5426)
joseph-isaacs Nov 21, 2025
79b0763
Fix: Correctly handle inconsistent file and table schema order in vor…
brancz Nov 21, 2025
fd5a013
feat: publish vortex-spark-all assembly JAR (#5435)
a10y Nov 21, 2025
d72618d
chore[vortex-dict]: numeric pushdown & clean up the dict ctor (#5438)
joseph-isaacs Nov 21, 2025
20d88e3
fix: FFI returns a string/binary instead of requiring the caller to g…
robert3005 Nov 21, 2025
aafe376
chore: Shard codspeed into 8 runs (#5440)
robert3005 Nov 21, 2025
68895ac
Fix: remove unreachable cases in bitpack patches (#5444)
connortsui20 Nov 21, 2025
63b759f
chore[ci]: add windows test to CI (#5439)
joseph-isaacs Nov 21, 2025
95972bc
feat[vortex-array]: added debug to expr/array reduce rules (#5442)
joseph-isaacs Nov 21, 2025
c83ec8a
Revert "chore[ci]: add windows test to CI (#5439)" (#5449)
0ax1 Nov 21, 2025
d96a3f3
Chore: refactor `for` module (#5451)
connortsui20 Nov 21, 2025
e1fee19
Chore: refactor `delta` module (#5452)
connortsui20 Nov 21, 2025
878f9b1
Chore: refactor `rle` module (#5455)
connortsui20 Nov 21, 2025
2adb2dc
Feature: implement bitpacking batch execute (#5446)
connortsui20 Nov 21, 2025
5dbe73e
feature: Support std_file on windows as it's used by cxx bindings (#5…
robert3005 Nov 21, 2025
d2e6eb2
Chore: make apply patches its own method (#5458)
connortsui20 Nov 21, 2025
52ee607
Introduces a new set of issue/discussion templates (#5456)
gatesn Nov 21, 2025
4ec0f68
fix: handling of struct fields in Spark (#5453)
a10y Nov 23, 2025
a9bde6b
More vector scalars (#5459)
gatesn Nov 23, 2025
90977be
Update Rust crate dyn-hash to v1 (#5465)
renovate[bot] Nov 23, 2025
5b420a0
Update GitHub Artifact Actions to v5 (major) (#5464)
renovate[bot] Nov 23, 2025
0e72652
Update CodSpeedHQ/action digest to 346a2d8 (#5463)
renovate[bot] Nov 23, 2025
0d5d343
Update actions/download-artifact action to v6 (#5469)
renovate[bot] Nov 23, 2025
845dc3e
Update actions/checkout action to v6 (#5468)
renovate[bot] Nov 23, 2025
c467a7a
Update Rust crate lance to 0.39.0 (#5466)
renovate[bot] Nov 23, 2025
cc131e1
Update plugin com.diffplug.spotless to v8.1.0 (#5471)
renovate[bot] Nov 23, 2025
cc75552
Update Rust crate cudarc to 0.18.0 (#5473)
renovate[bot] Nov 23, 2025
4d42c08
Update protobuf monorepo to v4.33.1 (#5472)
renovate[bot] Nov 23, 2025
85ce10b
Update Rust crate noodles-bgzf to 0.44.0 (#5476)
renovate[bot] Nov 23, 2025
837914d
Update all patch updates (#5470)
renovate[bot] Nov 23, 2025
60d4b71
Update Rust crate insta to v1.44.1 (#5475)
renovate[bot] Nov 23, 2025
b24a639
Update Rust crate tokio to v1.48.0 (#5480)
renovate[bot] Nov 23, 2025
faaab0f
Update Rust crate goldenfile to v1.9.1 (#5474)
renovate[bot] Nov 23, 2025
f52dbf0
Update Rust crate pyo3 to 0.27.0 (#5478)
renovate[bot] Nov 23, 2025
15ae0a7
Merge branch 'develop' into peasee-downstream-1
peasee Nov 24, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
65 changes: 65 additions & 0 deletions .github/DISCUSSION_TEMPLATE/issue-triage.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,65 @@
labels: ["needs-confirmation"]
body:
- type: markdown
attributes:
value: |
> [!IMPORTANT]
> Please check for both existing [Discussions](https://github.com/vortex-data/vortex/discussions) and [Issues](https://github.com/vortex-data/vortex/issues) prior to opening a new Discussion.
- type: markdown
attributes:
value: "# Issue Details"
- type: textarea
attributes:
label: Issue Description
description: |
Provide a detailed description of the issue. Include relevant information, such as:
- Which integration you are using if any, e.g. DataFusion, DuckDB, Polars, etc.
- Which language you are using, e.g. Python, Rust, Java, etc.
- The Vortex package version you are using.
- If this is a regression of an existing issue that was closed or resolved, please include the previous item reference (Discussion, Issue, PR, commit) in your description.
validations:
required: true
- type: textarea
attributes:
label: Expected Behavior
description: |
Describe how you expect Vortex to behave in this situation. Include any relevant documentation links.
validations:
required: true
- type: textarea
attributes:
label: Actual Behavior
description: |
Describe how Vortex actually behaves in this situation. If it is not immediately obvious how the actual behavior differs from the expected behavior described above, please be sure to mention the deviation specifically.
validations:
required: true
- type: textarea
attributes:
label: Reproduction Steps
description: |
Provide a detailed set of step-by-step instructions for reproducing this issue.
validations:
required: true
- type: input
attributes:
label: OS Version Information
description: |
Please tell us what operating system (name and version) you are using.
placeholder: Ubuntu 24.04.1 (Noble Numbat)
validations:
required: true

- type: markdown
attributes:
value: |
# User Acknowledgements
> [!TIP]
> Use these links to review the existing Vortex [Discussions](https://github.com/vortex-data/vortex/discussions) and [Issues](https://github.com/vortex-data/vortex/issues).
- type: checkboxes
attributes:
label: "I acknowledge that:"
options:
- label: I have searched the Vortex repository (both open and closed Discussions and Issues) and confirm this is not a duplicate of an existing issue or discussion.
required: true
- label: I have checked the "Preview" tab on all text fields to ensure that everything looks right, and have wrapped all configuration and code in code blocks with a group of three backticks (` ``` `) on separate lines.
required: true
27 changes: 0 additions & 27 deletions .github/ISSUE_TEMPLATE/bug_report.yml

This file was deleted.

5 changes: 5 additions & 0 deletions .github/ISSUE_TEMPLATE/config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
blank_issues_enabled: false
contact_links:
- name: Features, Bug Reports, Questions
url: https://github.com/vortex-data/vortex/discussions/new/choose
about: Our preferred starting point if you have any questions or suggestions about configuration, features or behavior.
9 changes: 9 additions & 0 deletions .github/ISSUE_TEMPLATE/preapproved.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
---
name: Pre-Discussed and Approved Topics
about: |-
Only for topics already discussed and approved in the GitHub Discussions section.
---

**DO NOT OPEN A NEW ISSUE. PLEASE USE THE DISCUSSIONS SECTION.**

**I DIDN'T READ THE ABOVE LINE. PLEASE CLOSE THIS ISSUE.**
3 changes: 3 additions & 0 deletions .github/release-drafter.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,9 @@ categories:
collapse-after: 8
labels:
- "fix"
- title: "📖 Documentation"
labels:
- "documentation"
- title: "🧰 Maintenance"
labels:
- "chore"
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/bench-pr.yml
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ jobs:
if: github.event.pull_request.head.repo.fork == false
with:
sccache: s3
- uses: actions/checkout@v5
- uses: actions/checkout@v6
with:
ref: ${{ github.event.pull_request.head.sha }}
- uses: ./.github/actions/setup-rust
Expand All @@ -58,7 +58,7 @@ jobs:

- name: Install DuckDB
run: |
wget -qO- https://github.com/duckdb/duckdb/releases/download/v1.3.2/duckdb_cli-linux-amd64.zip | funzip > duckdb
wget -qO- https://github.com/duckdb/duckdb/releases/download/v1.4.2/duckdb_cli-linux-amd64.zip | funzip > duckdb
chmod +x duckdb
echo "$PWD" >> $GITHUB_PATH

Expand Down Expand Up @@ -94,7 +94,7 @@ jobs:
aws-region: us-east-1

- name: Install uv
uses: spiraldb/actions/.github/actions/setup-uv@0.18.2
uses: spiraldb/actions/.github/actions/setup-uv@0.18.5
with:
sync: false

Expand Down
14 changes: 7 additions & 7 deletions .github/workflows/bench.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ jobs:
runs-on: ubuntu-latest
timeout-minutes: 120
steps:
- uses: actions/checkout@v5
- uses: actions/checkout@v6
- name: Setup AWS CLI
uses: aws-actions/configure-aws-credentials@v5
with:
Expand Down Expand Up @@ -52,14 +52,14 @@ jobs:
- uses: runs-on/action@v2
with:
sccache: s3
- uses: actions/checkout@v5
- uses: actions/checkout@v6
- uses: ./.github/actions/setup-rust
with:
repo-token: ${{ secrets.GITHUB_TOKEN }}

- name: Install DuckDB
run: |
wget -qO- https://github.com/duckdb/duckdb/releases/download/v1.3.2/duckdb_cli-linux-amd64.zip | funzip > duckdb
wget -qO- https://github.com/duckdb/duckdb/releases/download/v1.4.2/duckdb_cli-linux-amd64.zip | funzip > duckdb
chmod +x duckdb
echo "$PWD" >> $GITHUB_PATH

Expand Down Expand Up @@ -124,7 +124,7 @@ jobs:
"subcommand": "tpch",
"name": "TPC-H SF=1 on S3",
"local_dir": "bench-vortex/data/tpch/1.0",
"remote_storage": "s3://vortex-bench-dev-eu/${{github.ref_name}}/tpch/1.0/",
"remote_storage": "s3://vortex-bench-dev-eu/${{github.ref_name}}/${{github.run_id}}/tpch/1.0/",
"targets": "datafusion:parquet,datafusion:vortex,datafusion:vortex-compact,datafusion:lance,duckdb:parquet,duckdb:vortex,duckdb:vortex-compact",
"scale_factor": "--scale-factor 1.0",
"build_args": "--features lance"
Expand All @@ -142,7 +142,7 @@ jobs:
"subcommand": "tpch",
"name": "TPC-H SF=10 on S3",
"local_dir": "bench-vortex/data/tpch/10.0",
"remote_storage": "s3://vortex-bench-dev-eu/${{github.ref_name}}/tpch/10.0/",
"remote_storage": "s3://vortex-bench-dev-eu/${{github.ref_name}}/${{github.run_id}}/tpch/10.0/",
"targets": "datafusion:parquet,datafusion:vortex,datafusion:vortex-compact,datafusion:lance,duckdb:parquet,duckdb:vortex,duckdb:vortex-compact",
"scale_factor": "--scale-factor 10.0",
"build_args": "--features lance"
Expand Down Expand Up @@ -174,7 +174,7 @@ jobs:
"subcommand": "fineweb",
"name": "FineWeb S3",
"local_dir": "bench-vortex/data/fineweb",
"remote_storage": "s3://vortex-bench-dev-eu/${{github.ref_name}}/fineweb/",
"remote_storage": "s3://vortex-bench-dev-eu/${{github.ref_name}}/${{github.run_id}}/fineweb/",
"targets": "datafusion:parquet,datafusion:vortex,datafusion:vortex-compact,duckdb:parquet,duckdb:vortex,duckdb:vortex-compact",
"scale_factor": "--scale-factor 100"
},
Expand All @@ -190,7 +190,7 @@ jobs:
"subcommand": "gharchive",
"name": "GitHub Archive (S3)",
"local_dir": "bench-vortex/data/gharchive",
"remote_storage": "s3://vortex-bench-dev-eu/${{github.ref_name}}/gharchive/",
"remote_storage": "s3://vortex-bench-dev-eu/${{github.ref_name}}/${{github.run_id}}/gharchive/",
"targets": "datafusion:parquet,datafusion:vortex,datafusion:vortex-compact,duckdb:parquet,duckdb:vortex,duckdb:vortex-compact",
"scale_factor": "--scale-factor 100"
},
Expand Down
Loading
Loading