Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rebase Upstream #2

Closed
wants to merge 236 commits into from
Closed

Rebase Upstream #2

wants to merge 236 commits into from

Conversation

chenzl25
Copy link
Collaborator

@chenzl25 chenzl25 commented Sep 9, 2024

No description provided.

Xuanwo and others added 30 commits December 26, 2023 08:45
* feat: Add website layout

Signed-off-by: Xuanwo <github@xuanwo.io>

* publish to rust.i.a.o

Signed-off-by: Xuanwo <github@xuanwo.io>

* Fix license

Signed-off-by: Xuanwo <github@xuanwo.io>

* Let's try mdbook action

Signed-off-by: Xuanwo <github@xuanwo.io>

* use cargo install

Signed-off-by: Xuanwo <github@xuanwo.io>

* disable section

Signed-off-by: Xuanwo <github@xuanwo.io>

* Add docs for website

Signed-off-by: Xuanwo <github@xuanwo.io>

* Fix license

Signed-off-by: Xuanwo <github@xuanwo.io>

* action approved

Signed-off-by: Xuanwo <github@xuanwo.io>

---------

Signed-off-by: Xuanwo <github@xuanwo.io>
* feat: Expressions

* Fix comments

* Refactor expression to be more similar to iceberg model

* Fix typo
Signed-off-by: Xuanwo <github@xuanwo.io>
* feat: Add roadmap and features status in README.md

* Fix

* Fix

* Add more details according to comments

* Revert unnecessary new line break

* Nits

---------

Co-authored-by: Fokko Driesprong <fokko@apache.org>
Bumps [peaceiris/actions-gh-pages](https://github.com/peaceiris/actions-gh-pages) from 3.9.2 to 3.9.3.
- [Release notes](https://github.com/peaceiris/actions-gh-pages/releases)
- [Changelog](https://github.com/peaceiris/actions-gh-pages/blob/main/CHANGELOG.md)
- [Commits](peaceiris/actions-gh-pages@v3.9.2...v3.9.3)

---
updated-dependencies:
- dependency-name: peaceiris/actions-gh-pages
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Updates the requirements on [opendal](https://github.com/apache/incubator-opendal) to permit the latest version.
- [Release notes](https://github.com/apache/incubator-opendal/releases)
- [Changelog](https://github.com/apache/incubator-opendal/blob/main/CHANGELOG.md)
- [Commits](apache/opendal@v0.43.0...v0.43.0)

---
updated-dependencies:
- dependency-name: opendal
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Code complete

* Resolve

* Done

* Fix comments

* Fix comments

* Fix comments

* Fix

* Fix comment
* chore: Update reader api status

* Restore unnecessary change
* Add formatting for toml files

* Update call to taplo

* Add command to format and a command to check
Updates the requirements on [env_logger](https://github.com/rust-cli/env_logger) to permit the latest version.
- [Release notes](https://github.com/rust-cli/env_logger/releases)
- [Changelog](https://github.com/rust-cli/env_logger/blob/main/CHANGELOG.md)
- [Commits](rust-cli/env_logger@v0.10.0...v0.10.2)

---
updated-dependencies:
- dependency-name: env_logger
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* init file writer interface

* refine

---------

Co-authored-by: ZENOTME <st810918843@gmail.com>
* fix: Manifest parsing should consider schema evolution.

* Fix ut
* Add

* Fix format

* Add license header
…175)

Updates the requirements on [derive_builder](https://github.com/colin-kiegel/rust-derive-builder) to permit the latest version.
- [Release notes](https://github.com/colin-kiegel/rust-derive-builder/releases)
- [Commits](colin-kiegel/rust-derive-builder@v0.12.0...v0.12.0)

---
updated-dependencies:
- dependency-name: derive_builder
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* add handwritten serialize

* revert expect

* remove expect
Co-authored-by: Fokko Driesprong <fokko@apache.org>
* feat: Bump version 0.2.0 to prepare for release.

* Update dependencies
Updates the requirements on [opendal](https://github.com/apache/opendal) to permit the latest version.
- [Release notes](https://github.com/apache/opendal/releases)
- [Changelog](https://github.com/apache/opendal/blob/main/CHANGELOG.md)
- [Commits](apache/opendal@v0.44.0...v0.44.2)

---
updated-dependencies:
- dependency-name: opendal
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
sdd and others added 29 commits August 16, 2024 09:47
…en the storage-s3 and storage-gcs features are enabled (#552)
* add memory catalog

* fix style

* fix style
…ce (#512)

* feat: adds ObjectCache, to cache Manifests and ManifestLists

* refactor: change obj cache method names and use more readable default usize value

* chore: improve error message

Co-authored-by: Renjie Liu <liurenjie2008@gmail.com>

* fix: change object cache retrieval method visibility

Co-authored-by: Renjie Liu <liurenjie2008@gmail.com>

* feat: improved error message in object cache get_manifest

* test(object-cache): add unit tests for object cache manifest and manifest list retrieval

* fix: ensure that object cache insertions are weighted by size

* test: fix test typo

* fix: ensure object cache weight is that of the wrapped item, not the Arc

---------

Co-authored-by: Renjie Liu <liurenjie2008@gmail.com>
This is in line with the paths above, and also with the previous version:

https://dist.apache.org/repos/dist/release/iceberg/
Signed-off-by: Xuanwo <github@xuanwo.io>
* fix: ensure that RestCatalog passes user config to FileIO

* docs: added some doc comments to clarify override order for config
Both licenses can be moved to the `allowed` section:

- **adler32** [ships](https://github.com/remram44/adler32-rs/blob/master/LICENSE) with a **zlib** license and is a category A-license
- **unicode-ident** ships with a **UNICODE, INC. LICENSE AGREEMENT - DATA FILES AND SOFTWARE** which is also a category A-license

The **ring** license is a bit [more involved](https://github.com/briansmith/ring/blob/main/LICENSE) and carries a lot of history, I think it is best to keep that as an exception for now, since the OpenSSL license is also not explicitly listed on the ASF page. I don't see anything alarming in the `LICENSE` file.

ASF page on the subject: https://www.apache.org/legal/resolved.html#category-a
Signed-off-by: Xuanwo <github@xuanwo.io>
)

* feat(timestamp_ns): first commit

* feat(timestamp_ns): Add mappings for timestamp_ns/timestamptz_ns

* feat(timestamp_ns): Remove unused dep

* feat(timestamp_ns): Fix unit test

* feat(timestamp_ns): Fix test_all_type_for_write()

* feat(timestamp_ns): fix test_transform_days_literal

* feat(timestamp_ns): fix math for timestamptz_nanos

* chore: formatting

* chore: formatting

* chore: Appease clippy

---------

Co-authored-by: Timothy Maloney <tmaloney@influxdata.com>
* correct partition-id to field id in PartitionSpec

* correct partition-id to field id in PartitionSpec

* correct partition-id to field id in PartitionSpec

* xx
---
updated-dependencies:
- dependency-name: typed-builder
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* bucket transform rust binding

* format

* poetry x maturin

* ignore poetry.lock in license check

* update bindings_python_ci to use makefile

* newline

* python-poetry/poetry#9135

* use hatch instead of poetry

* refactor

* revert licenserc change

* adopt review feedback

* comments

* unused dependency

* adopt review comment

* newline

* I like this approach a lot better

* more tests
* feat(scan): add row group and page index row selection filtering

* fix(row selection): off-by-one error

* feat: remove row selection to defer to a second PR

* feat: better min/max val conversion in RowGroupMetricsEvaluator

* test(row_group_filtering): first three tests

* test(row_group_filtering): next few tests

* test: add more tests for RowGroupMetricsEvaluator

* chore: refactor test assertions to silence clippy lints

* refactor: consolidate parquet stat min/max parsing in one place
* feat: SQL Catalog - namespaces

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>

* feat: use transaction for updates and creates

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>

* fix: pull out query param builder to fn

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>

* feat: add drop and tests

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>

* fix: String to str, remove pub and optimise query builder

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>

* fix: nested match, remove ok()

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>

* fix: remove pub, add set, add comments

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>

* fix: refactor list_namespaces slightly

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>

* fix: add default properties to all new namespaces

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>

* fix: remove check for nested namespace

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>

* chore: add more comments to the CatalogConfig to explain bind styles

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>

* fix: edit test for nested namespaces

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>

---------

Signed-off-by: callum-ryan <19956159+callum-ryan@users.noreply.github.com>
Signed-off-by: Xuanwo <github@xuanwo.io>
Bumps [crate-ci/typos](https://github.com/crate-ci/typos) from 1.24.3 to 1.24.5.
- [Release notes](https://github.com/crate-ci/typos/releases)
- [Changelog](https://github.com/crate-ci/typos/blob/master/CHANGELOG.md)
- [Commits](crate-ci/typos@v1.24.3...v1.24.5)

---
updated-dependencies:
- dependency-name: crate-ci/typos
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Partition compatability

* Partition compatability

* Rename compatible_with -> is_compatible_with
* SortOrder methods should take schema ref if possible

* Fix test type

* with_order_id should not take reference
@chenzl25 chenzl25 closed this Sep 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.