Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: duckdb 1.1.0 #16

Open
wants to merge 182 commits into
base: main
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
182 commits
Select commit Hold shift + click to select a range
059228f
Emscripten: remove redundant EXPORT_ALL
carlopi Jan 17, 2024
f25219d
Remove most exported functions from generated JavaScript
carlopi Jan 17, 2024
13e7f43
Modify awk filter to avoid also globalized contants
carlopi Jan 17, 2024
45883a5
CI: add meausing on duckdb-wasm npm library
carlopi Jan 17, 2024
60024fa
Remove boost
carlopi Jan 18, 2024
06ee5a2
fix(deps): bump actions/cache from 3 to 4
dependabot[bot] Jan 22, 2024
8a09639
fix(deps): bump mymindstorm/setup-emsdk from 13 to 14
dependabot[bot] Jan 22, 2024
ab53718
fix(deps): bump classnames from 2.3.2 to 2.5.1
dependabot[bot] Jan 22, 2024
8fc83a3
chore(deps-dev): bump copy-webpack-plugin from 11.0.0 to 12.0.2
dependabot[bot] Jan 22, 2024
1b55a07
chore(deps-dev): bump puppeteer from 21.6.1 to 21.7.0
dependabot[bot] Jan 22, 2024
aea52a0
fix(deps): bump react-router-dom from 6.21.2 to 6.21.3
dependabot[bot] Jan 22, 2024
d1c1ce0
chore(deps-dev): bump typedoc from 0.25.4 to 0.25.7
dependabot[bot] Jan 22, 2024
45e15a2
chore(deps-dev): bump esbuild from 0.19.10 to 0.20.0
dependabot[bot] Jan 29, 2024
86b8087
fix(deps): bump framer-motion from 10.16.1 to 11.0.3
dependabot[bot] Jan 29, 2024
1572cd2
chore(deps-dev): bump js-sha256 from 0.10.1 to 0.11.0
dependabot[bot] Jan 29, 2024
3e55766
chore(deps-dev): bump prettier from 3.2.2 to 3.2.4
dependabot[bot] Jan 29, 2024
bb62b45
fix(deps): bump sql.js from 1.9.0 to 1.10.2
dependabot[bot] Jan 29, 2024
8e4d4bf
Extensions: Optimize build to remove most exports via SIDE_MODULE=2
carlopi Jan 22, 2024
b1a07a3
Remove unused imports
ravwojdyla Jan 26, 2024
b07d981
Publish dev version on npm to @next instead of @latest
carlopi Jan 29, 2024
06723f9
Fix sharing button for deployments from non-root situations
carlopi Jan 29, 2024
6e7b603
Add fail if npm package size is bigger than 150MB
carlopi Jan 29, 2024
dff0054
Fix deployment of tag next
carlopi Jan 30, 2024
5e522a7
Revert "Fix sharing button for deployments from non-root situations"
carlopi Jan 30, 2024
e0271a9
Proper formatting / highlighting for queries URL encoded
carlopi Feb 2, 2024
6b19e1a
Bump to DuckDB v0.10.0 (with patch)
carlopi Feb 14, 2024
0a77642
Bump extensions further
carlopi Feb 14, 2024
4011939
Add platform
carlopi Feb 14, 2024
bd6e5dc
Avoid building the shell as part of duckdb_wasm
carlopi Feb 14, 2024
b712ed9
Skip native tests
carlopi Feb 14, 2024
77cda68
Skip test on remote very old remote db
carlopi Feb 14, 2024
f1dc93a
Bump by 1 handled times
carlopi Feb 14, 2024
fde2db6
Skip for now handling of uhugeint
carlopi Feb 14, 2024
a8bce20
Patch also path to extensions
carlopi Feb 15, 2024
c62b461
Test to be less strict
carlopi Feb 15, 2024
457a779
registerEmptyFileBuffer to be a NOP
carlopi Feb 15, 2024
e4a88df
Cleanup non-existent script
carlopi Feb 15, 2024
10271a1
Remove from Makefile to script variables
carlopi Feb 15, 2024
840c500
Change detection of node
carlopi Feb 15, 2024
fddbdf5
Remove unnecessary code leftovers
carlopi Feb 15, 2024
2355234
fix(deps): bump apache-arrow from 14.0.2 to 15.0.0
dependabot[bot] Feb 5, 2024
caa6796
chore(deps-dev): bump mini-css-extract-plugin from 2.7.6 to 2.8.0
dependabot[bot] Feb 5, 2024
ff3c922
chore(deps-dev): bump @typescript-eslint/parser from 6.18.0 to 6.21.0
dependabot[bot] Feb 12, 2024
dd723fc
chore(deps-dev): bump @typescript-eslint/eslint-plugin
dependabot[bot] Feb 12, 2024
3d1129b
Exported function to JS: ___dl_seterr to be whitelisted
carlopi Feb 19, 2024
465bcfb
Save built extensions in build/extension_repository folder
carlopi Feb 16, 2024
64c2c4d
Use just built extension_repository also for serving them
carlopi Feb 16, 2024
9238b9a
Cleanup .github/config/extension_config_wasm.cmake
carlopi Feb 16, 2024
7704412
Remove serve_loadable target, add make serve or make serve_local
carlopi Feb 16, 2024
f764144
Remove outdated Makefile instruction
carlopi Feb 21, 2024
44ea341
Remove external repository from extensions configurations
carlopi Feb 26, 2024
51beb8a
Add wasm_threads compatible changes in wasm_build_lib
carlopi Feb 26, 2024
1cf5569
Changes to scripts/build_loadable
carlopi Feb 26, 2024
bb6137d
wasm_thread target: More cmake / lib fixes
carlopi Feb 26, 2024
dcf0062
Fixup Makefile
carlopi Feb 26, 2024
ac6f20f
make clean to also cleanup submodules/duckdb/build
carlopi Feb 26, 2024
3c1c62f
Add wasm_threads (loadable) to CI workflow
carlopi Feb 26, 2024
55aad8a
Update duckdb.patch
carlopi Feb 26, 2024
38e44c4
Add origin trial for shell.duckdb.org
carlopi Feb 26, 2024
a4d20d8
Skip bunlding tests in npm package
carlopi Feb 26, 2024
f11c8df
Skip mvp js.map due to size constraints
carlopi Feb 26, 2024
455b615
Worker runtime: avoid errors in JSON.parse to bubble up
carlopi Feb 29, 2024
219480b
chore(deps-dev): bump css-loader from 6.8.1 to 6.10.0
dependabot[bot] Feb 26, 2024
c2c5f50
chore(deps-dev): bump webpack from 5.89.0 to 5.90.3
dependabot[bot] Feb 26, 2024
7bfcae4
chore(deps-dev): bump source-map-loader from 4.0.2 to 5.0.0
dependabot[bot] Feb 26, 2024
5362119
chore(deps-dev): bump esbuild from 0.20.0 to 0.20.1
dependabot[bot] Feb 26, 2024
2cdc981
Add `allowUnsignedExtensions` to DuckDB Config
Y-- Feb 29, 2024
5598e19
Added plain html example
dberardo-com Feb 13, 2024
53e41fe
fix(deps): bump bootstrap from 5.3.2 to 5.3.3
dependabot[bot] Mar 4, 2024
917d565
chore(deps-dev): bump karma-firefox-launcher from 2.1.2 to 2.1.3
dependabot[bot] Mar 4, 2024
36cbd5b
chore(deps-dev): bump style-loader from 3.3.3 to 3.3.4
dependabot[bot] Mar 4, 2024
244c99b
chore(deps-dev): bump webpack-dev-server from 4.15.1 to 5.0.2
dependabot[bot] Mar 4, 2024
614f01c
Minor Makefile fixes
carlopi Mar 11, 2024
eff509f
Temporarily patch Makefile
carlopi Mar 11, 2024
fd6c8b6
script/generate_tpch_duckdb to be independent of local build
carlopi Mar 11, 2024
2525977
chore(deps-dev): bump eslint-plugin-react from 7.33.2 to 7.34.0
dependabot[bot] Mar 11, 2024
3bf715d
chore(deps-dev): bump jasmine-core from 5.1.1 to 5.1.2
dependabot[bot] Mar 11, 2024
efc0d98
fix(deps): bump react-router-dom from 6.21.3 to 6.22.3
dependabot[bot] Mar 11, 2024
03a2335
chore(deps-dev): bump @types/node from 20.11.16 to 20.11.25
dependabot[bot] Mar 11, 2024
c7fc746
Avoid autoloading on DuckDB's httpfs setting [eg s3_url_style] not ho…
carlopi Mar 13, 2024
9a4a492
Add test on erorr message on not supported setting
carlopi Mar 13, 2024
1067062
Minor Makefile fix
carlopi Mar 13, 2024
5fd5e40
Bump to DuckDB v0.10.1
carlopi Mar 18, 2024
da62771
Remove newly added types from test (to be fixed)
carlopi Mar 21, 2024
cb6d24f
Fix up CSV detection in test (after improvement DuckDB side)
carlopi Mar 21, 2024
973b560
chore: upgrade CI image
jcolot Mar 24, 2024
9d78b7b
Revert "Add test on erorr message on not supported setting"
carlopi Mar 29, 2024
887c560
Revert: 'Avoid autoloading on DuckDB's httpfs setting'
carlopi Mar 29, 2024
61c8705
chore(deps-dev): bump @types/node from 20.11.25 to 20.11.30
dependabot[bot] Mar 25, 2024
caa6b2e
chore(deps-dev): bump prettier from 3.2.4 to 3.2.5
dependabot[bot] Mar 18, 2024
91335e0
fix(deps): bump immutable from 4.3.4 to 4.3.5
dependabot[bot] Mar 18, 2024
26245e6
Apply additional checks on dynamic_casts to references
carlopi Apr 11, 2024
546ecad
Rework FileSystem abstraction, using FileOpenFlags and optional_ptr<F…
carlopi Apr 15, 2024
58fcb9a
Fix condition, to be reviewed
carlopi Apr 17, 2024
b4d2182
Fixup FileFlags condition
carlopi Apr 23, 2024
22935ce
fix(deps): bump duckdb/duckdb-wasm-ci-env (#1722)
dependabot[bot] Apr 29, 2024
9d1b5be
adding logic to detect whether range requests are supported even if H…
carstonhernke Apr 15, 2024
b1b835d
Actually enable always
carlopi Apr 24, 2024
9da6e9a
Update platform.ts
keller-mark Mar 28, 2024
ffad6b4
pass DUCKDB_EXTERNAL_PLATFORM to duckdb submodule cmake
Mar 23, 2024
57318b6
chore(deps-dev): bump @types/node from 20.11.30 to 20.12.7
dependabot[bot] Apr 29, 2024
f16105a
chore(deps-dev): bump css-loader from 6.10.0 to 7.1.1
dependabot[bot] Apr 29, 2024
fc26b54
Revert "chore(deps-dev): bump css-loader from 6.10.0 to 7.1.1"
carlopi Apr 30, 2024
4bdb579
chore(deps-dev): bump eslint from 8.56.0 to 8.57.0
dependabot[bot] May 6, 2024
4bf0566
chore(deps-dev): bump esbuild from 0.20.1 to 0.20.2
dependabot[bot] May 6, 2024
b22b361
chore(deps-dev): bump webpack-dev-server from 5.0.2 to 5.0.4
dependabot[bot] May 6, 2024
192ccfd
Properly return 0 instead of emtpy return
carlopi May 8, 2024
436b36c
chore(deps-dev): bump puppeteer from 21.7.0 to 22.8.0
dependabot[bot] May 13, 2024
8fc61f0
Add yyjson to cmake
carlopi May 29, 2024
9f2c7ca
shared_ptr changes
carlopi May 29, 2024
b970ab3
Apply duckdb patch
carlopi May 22, 2024
4429064
Bump arrow submodule
carlopi May 29, 2024
7b7e852
Fixup duckdb patch
carlopi May 29, 2024
c9d82c8
git apply --3way
carlopi May 29, 2024
d453201
Split unneded stuff from patch
carlopi May 29, 2024
9a9dbbd
Do not package browser blocking version
carlopi May 29, 2024
36e29b1
No npm_measure_lib
carlopi May 29, 2024
cbab143
Modify patch: Proper handling for custom_extension_repository
carlopi May 29, 2024
3abe92e
set duckdb_api, by @elefeint
carlopi May 29, 2024
329a186
Avoid bundling excel
carlopi May 29, 2024
60d3093
Always use --3way apply
carlopi May 29, 2024
3f7419e
Propagate infos
carlopi May 29, 2024
5f0d36d
Add uglify-js to yarn.lock
carlopi May 30, 2024
cb83bce
Move duckdb to main
carlopi May 29, 2024
e95fb69
Check flags before rethrowing errors
carlopi Jun 4, 2024
aeda1d3
PROTOTYPE: Avoid HEAD requests that might produce unreliable output
carlopi Jun 5, 2024
b85b133
Add setting reliableHeadRequests
carlopi Jun 5, 2024
f9f7111
Fixup Rust side, move to snake casing
carlopi Jun 5, 2024
97bb13b
Add possibility to 'SET reliable_head_requests' via SQL
carlopi Jun 10, 2024
eddf034
Add patch on handling remote files attach
carlopi Jun 11, 2024
8ec2e46
Throw binder exception on attaching READ_WRITE remote databases
carlopi Jun 11, 2024
1e422d0
Default is AUTOMATIC, instead of UNDEFINED, for attached DBs
carlopi Jun 12, 2024
472d866
Propagate nullptr in case of failure in OpenFile
carlopi Jun 12, 2024
e0cca3f
More fixes: first fetch, then create ID (relevant if nullptr is retur…
carlopi Jun 12, 2024
747dd4a
chore(deps-dev): bump typedoc from 0.25.7 to 0.25.13
dependabot[bot] May 13, 2024
1af8645
fix(deps): bump immutable from 4.3.5 to 4.3.6
dependabot[bot] May 20, 2024
8356dee
Add duckdb_web_query_run_buffer to run queries on a buffer
carlopi Jun 17, 2024
89240db
runQuery to call duckdb_web_query_run_buffer, so it can handle longer…
carlopi Jun 17, 2024
c408da6
Add parametrizable test on generated long query
carlopi Jun 17, 2024
4142caa
Bump to apache-arrow 16.0.0
carlopi May 29, 2024
33a9b40
Bump to latest arrow crate
carlopi Jun 17, 2024
bd7b7d8
Also cargolock
carlopi Jun 17, 2024
b658106
Explicitly use new Date()
carlopi Jun 17, 2024
53551e9
Bump packages
carlopi Jun 17, 2024
f8995d6
Adapt workflow to avoid lable 'High Priority'
carlopi Jun 18, 2024
cae603a
Add also community_signature
carlopi Jun 26, 2024
722b92b
Fixup 'Add also community_signature'
carlopi Jun 27, 2024
762beeb
Move patches
carlopi Jul 12, 2024
3bc0b9e
Add make_patch to Makefile
carlopi Jul 12, 2024
1b071d7
Move from monolithical patch to multiple patches
carlopi Jul 12, 2024
9f081ca
Cherry-pick 'Improve compiler compatibility'
carlopi Jul 12, 2024
841a1f6
Fixup IsRemoteFile patch
carlopi Jul 12, 2024
175dd23
Fixup build to allow patches already applied
carlopi Jul 16, 2024
00e2265
Use external cmake to point to extensions to be built
carlopi Jul 19, 2024
66a4819
Add additional folder to 'make clean'
carlopi Jul 19, 2024
733c3b0
docs: add missing space
domoritz Jul 26, 2024
cd42c15
Patches to nested directory
carlopi Jul 31, 2024
a8c094c
Add arrow patch, to fix inclusion of emscripten.h within extern C in …
carlopi Jul 31, 2024
a85fc19
feat: update arrow dependency to version 17
domoritz Aug 1, 2024
c40bfb7
Add alternative name
carlopi Aug 2, 2024
cf2048b
Move to alternative name
carlopi Aug 2, 2024
b8b9717
Add issue mirroring workflow (#1820)
szarnyasg Aug 20, 2024
fe964a1
fix(deps): bump react-router-dom from 6.22.3 to 6.26.1
dependabot[bot] Aug 19, 2024
5f91ffc
explicitly depend on http-server
isaacbrodsky Mar 10, 2024
a26aed2
revert dev dependency
isaacbrodsky Mar 11, 2024
4ae98af
option to set custom user agent
hrl20 Aug 21, 2024
9ed77b6
update ts api
hrl20 Aug 21, 2024
9b5991a
Use npx for http-server
domoritz Aug 21, 2024
202e00c
Better handling for unicodes in JS-API prepared statements
carlopi Aug 21, 2024
3946612
Add test on better handling for unicode in JS-side prepared statement
carlopi Aug 21, 2024
cd0ae4f
Avoid creating internal issues for 'under_review'
carlopi Aug 23, 2024
1937133
Handle EXECUTION_FINISHED and BLOCKED properly
carlopi Jul 22, 2024
65424bd
Move to main duckdb (22 Jul 2024)
carlopi Sep 9, 2024
535c993
Bump to latest duckdb
carlopi Sep 9, 2024
f939bfd
varint is not a supported type
carlopi Aug 23, 2024
3575723
Bump patches
carlopi Aug 26, 2024
28bf8a6
Change API
carlopi Aug 26, 2024
e5fa544
remove inet
carlopi Aug 27, 2024
b31e5d7
Fixup varint exclusion
carlopi Aug 27, 2024
f5835f8
Fixup ordering in parquet join test
carlopi Aug 27, 2024
3950cbe
Bump arrow
carlopi Sep 9, 2024
7b98422
add: workflow change
vpbs2 Sep 13, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
feat: update arrow dependency to version 17
  • Loading branch information
domoritz authored and carlopi committed Aug 1, 2024

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
commit a85fc1943fc1b4b86dd536ba40a13d7996a39fe7
2 changes: 1 addition & 1 deletion packages/benchmarks/package.json
Original file line number Diff line number Diff line change
@@ -5,7 +5,7 @@
"private": true,
"dependencies": {
"@duckdb/duckdb-wasm": "file:../duckdb-wasm",
"apache-arrow": "^16.0.0",
"apache-arrow": "^17.0.0",
"apache-arrow-3": "npm:apache-arrow@^3.0.0",
"arquero": "^5.4.0",
"buffalo-bench": "^2.0.0",
2 changes: 1 addition & 1 deletion packages/duckdb-wasm-app/package.json
Original file line number Diff line number Diff line change
@@ -20,7 +20,7 @@
"dependencies": {
"@duckdb/duckdb-wasm": "file:../duckdb-wasm",
"@duckdb/duckdb-wasm-shell": "file:../duckdb-wasm-shell",
"apache-arrow": "^16.0.0",
"apache-arrow": "^17.0.0",
"bootstrap": "^5.3.3",
"classnames": "^2.5.1",
"framer-motion": "^11.0.3",
2 changes: 1 addition & 1 deletion packages/duckdb-wasm/package.json
Original file line number Diff line number Diff line change
@@ -23,7 +23,7 @@
"csv"
],
"dependencies": {
"apache-arrow": "^16.0.0"
"apache-arrow": "^17.0.0"
},
"devDependencies": {
"@types/emscripten": "^1.39.10",
34 changes: 18 additions & 16 deletions yarn.lock
Original file line number Diff line number Diff line change
@@ -468,7 +468,7 @@
"@duckdb/duckdb-wasm@file:packages/duckdb-wasm":
version "1.11.0"
dependencies:
apache-arrow "^16.0.0"
apache-arrow "^17.0.0"

"@emotion/is-prop-valid@^0.8.2":
version "0.8.8"
@@ -889,10 +889,10 @@
dependencies:
tslib "^2.4.0"

"@swc/helpers@^0.5.10":
version "0.5.11"
resolved "https://registry.yarnpkg.com/@swc/helpers/-/helpers-0.5.11.tgz#5bab8c660a6e23c13b2d23fcd1ee44a2db1b0cb7"
integrity sha512-YNlnKRWF2sVojTpIyzwou9XoTNbzbzONwRhOoniEioF1AtaitTvVZblaQRrAzChWQ1bLYyYSWzM18y4WwgzJ+A==
"@swc/helpers@^0.5.11":
version "0.5.12"
resolved "https://registry.yarnpkg.com/@swc/helpers/-/helpers-0.5.12.tgz#37aaca95284019eb5d2207101249435659709f4b"
integrity sha512-KMZNXiGibsW9kvZAO1Pam2JPTDBm+KSHMMHWdsyI/1DbIZjT2A6Gy3hblVXUMEDvUAKq+e0vL0X0o54owWji7g==
dependencies:
tslib "^2.4.0"

@@ -1107,6 +1107,13 @@
resolved "https://registry.yarnpkg.com/@types/node/-/node-12.20.27.tgz#4141fcad57c332a120591de883e26fe4bb14aaea"
integrity sha512-qZdePUDSLAZRXXV234bLBEUM0nAQjoxbcSwp1rqSMUe1rZ47mwU6OjciR/JvF1Oo8mc0ys6GE0ks0HGgqAZoGg==

"@types/node@^20.13.0":
version "20.14.13"
resolved "https://registry.yarnpkg.com/@types/node/-/node-20.14.13.tgz#bf4fe8959ae1c43bc284de78bd6c01730933736b"
integrity sha512-+bHoGiZb8UiQ0+WEtmph2IWQCjIqg8MDZMAV+ppRRhUZnquF5mQkP/9vpSwJClEiSM/C7fZZExPzfU0vJTyp8w==
dependencies:
undici-types "~5.26.4"

"@types/pad-left@2.1.1":
version "2.1.1"
resolved "https://registry.yarnpkg.com/@types/pad-left/-/pad-left-2.1.1.tgz#17d906fc75804e1cc722da73623f1d978f16a137"
@@ -1714,15 +1721,15 @@ apache-arrow@^14.0.2:
pad-left "^2.1.0"
tslib "^2.5.3"

apache-arrow@^16.0.0:
version "16.1.0"
resolved "https://registry.yarnpkg.com/apache-arrow/-/apache-arrow-16.1.0.tgz#7aa8d0d436dd0995d9dc5c36febf380d5b207209"
integrity sha512-G6GiM6tzPDdGnKUnVkvVr1Nt5+hUaCMBISiasMSiJwI5L5GKDv5Du7Avc2kxlFfB/LEK2LTqh2GKSxutMdf8vQ==
apache-arrow@^17.0.0:
version "17.0.0"
resolved "https://registry.yarnpkg.com/apache-arrow/-/apache-arrow-17.0.0.tgz#73d98566c86352c9a0314c03890dbd7211073827"
integrity sha512-X0p7auzdnGuhYMVKYINdQssS4EcKec9TCXyez/qtJt32DrIMGbzqiaMiQ0X6fQlQpw8Fl0Qygcv4dfRAr5Gu9Q==
dependencies:
"@swc/helpers" "^0.5.10"
"@swc/helpers" "^0.5.11"
"@types/command-line-args" "^5.2.3"
"@types/command-line-usage" "^5.0.4"
"@types/node" "^20.12.7"
"@types/node" "^20.13.0"
command-line-args "^5.2.1"
command-line-usage "^7.0.1"
flatbuffers "^24.3.25"
@@ -7930,11 +7937,6 @@ ua-parser-js@^0.7.30:
resolved "https://registry.yarnpkg.com/ua-parser-js/-/ua-parser-js-0.7.30.tgz#4cf5170e8b55ac553fe8b38df3a82f0669671f0b"
integrity sha512-uXEtSresNUlXQ1QL4/3dQORcGv7+J2ookOG2ybA/ga9+HYEXueT2o+8dUJQkpedsyTyCJ6jCCirRcKtdtx1kbg==

uglify-js@^3.17.4:
version "3.17.4"
resolved "https://registry.yarnpkg.com/uglify-js/-/uglify-js-3.17.4.tgz#61678cf5fa3f5b7eb789bb345df29afb8257c22c"
integrity sha512-T9q82TJI9e/C1TAxYvfb16xO120tMVFZrGA3f9/P4424DNu6ypK103y0GPFVa17yotwSyZW5iYXgjYHkGrJW/g==

unbox-primitive@^1.0.1:
version "1.0.1"
resolved "https://registry.yarnpkg.com/unbox-primitive/-/unbox-primitive-1.0.1.tgz#085e215625ec3162574dc8859abee78a59b14471"